Skip to content

[MoE] Apply router scores before W2 projection - #5543

Open
Mystri wants to merge 4 commits into
pytorch:mainfrom
Mystri:router-score-pre-w2-review
Open

[MoE] Apply router scores before W2 projection#5543
Mystri wants to merge 4 commits into
pytorch:mainfrom
Mystri:router-score-pre-w2-review

[MoE] fp64 parity tests for absorbed router scores

84ba2c8
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar