Skip to content

[Fix] Improve MTP compatibility and mitigate MoE load imbalance by skipping pad tokens - #1952

Open
tina-wen wants to merge 5 commits into
InternLM:mainfrom
tina-wen:mem-opt-bugfix
Open

[Fix] Improve MTP compatibility and mitigate MoE load imbalance by skipping pad tokens#1952
tina-wen wants to merge 5 commits into
InternLM:mainfrom
tina-wen:mem-opt-bugfix

Commits

Commits on Jul 9, 2026

Commits on Jul 13, 2026

Commits on Jul 15, 2026

Commits on Jul 29, 2026