中文 Source Card

MoE训练中的Top-K运算不会导致不可导(不连续)吗?

小冬瓜AIGC · Jun 5, 2025, 12:25 a.m.

Jun 5, 2025, 12:25 a.m.·小冬瓜AIGCscore 77.8llm-systemsmodels

MoE训练中的Top-K运算不会导致不可导(不连续)吗?

English triage

Chinese technical note: MoEtraining中的Top-K运算不会导致不可导(不连续)吗?

小冬瓜AIGC published a Zhihu answer relevant to AI engineering. The original Chinese excerpt is included below so the feed can preserve the raw source while giving English readers enough context to triage the item.

Zhihuanswer16 upvotes

原文链接

← English feed · 中文瀑布流