Inside DeepSeek-V3 & R1: How Ultra-Dense MoE and Test-Time Compute Reshaped the Frontier
An architectural deep dive into Multi-head Latent Attention (MLA), DeepSeekMoE 256-expert routing, and how cold-start reinforcement learning eliminated supervised fine-tuning bottlenecks.