nemo-mbridge-perf-expert-parallel-overlap · AI Skill 用途与安装 · iSkills.cc
开启MoE专家并行通信Overlap以隐藏延迟。
分类：编程开发
来源仓库：nvidia/skills
适合用来做什么
- 请验证Megatron-Bridge中的MoE专家并行通信重叠。
- 如何在Megatron-Bridge中实现overlap_moe_expert_parallel_comm？
不适合的情况
- Do not use `--moe_a2a_overlap true` for this isolation test: the performance harness helper enables both `overlap_moe_expert_parallel_comm` and `delay_wgrad_compute`, so it does not isolate
安装 nemo-mbridge-perf-expert-parallel-overlap
npx skills add https://www.iskills.cc/skills/nvidia/skills/nemo-mbridge-perf-expert-parallel-overlap/SKILL.md在本机终端执行安装命令。安装前请阅读原始说明，确认所需工具、账号和权限。