You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Every afdEP result so far is communication-only: one dispatch plus combine round trip under CUDA graphs. Nothing yet shows that the lower round trip becomes lower inter-token latency or higher throughput in serving.
A serving integration on v1's API, such as an afd-plugin connector for vLLM. SGLang's AFD path on sunfanyi/DeepEP serves as a comparison.
TPOT/ITL and throughput against Masked DeepEP and against the transport the stack uses today, at decode-heavy batch sizes and several Attention:FFN ratios (3:1, 7:1, 11:1), in one node and across nodes.
Profile where communication sits on the critical path: its overlap with attention and expert GEMMs, and SM contention under load.
Publish a record and a README section labeled as serving results.
Activity