Mamba/S4: State Space Models | 3D Visualization

Mamba / S4
State Space Models — The Transformer Alternative
🏆 Validated Breakthrough 100

What You're Seeing

Green arrows = Mamba's selective state space: information flows linearly through hidden states, with selective gating choosing what to remember.

Red matrix = Transformer attention: every token attends to every other token (O(n²) complexity).

Transformer
O(n²)
1000 tokens = 1M ops
Mamba
O(n)
1000 tokens = 1K ops
⚠️ 1000x more compute at scale
→ SSM Data Flow
⊙ Selective Gate
⬚ Attention (O(n²))
Drag to rotate • Scroll to zoom