Implement DeepSeek-V4 Compressed Attention Layers#3866

Draft

parambole wants to merge 2 commits into

dsv4-moe-routing-primitivesfrom

deepseek_v4_compressed_attention

Commits on May 11, 2026

feat(deepseek_v4): implement custom MoE HashRouter, TopKRouter, and sqrtsoftplus primitives with E2E parity verification
parambole
committed
Implement DeepSeek-V4 Compressed Attention Layers (Branch 2)
parambole
committed