Upstream UpdateNullstack contributes Spectrum diffusion & CDNA3 attention upstream to SGLangRead PR log
Nullstackby NullStack
Back to all posts
TPUResearch

Zero-Overhead Paged Attention on Google Cloud TPU v5p

April 29, 2026โ€ขBy NullStack Research

Implementing custom XLA HLO fusions to unlock 92% MFU during long-context batch decoding on TPU v5p pods.

MM

NullStack Research

@nullstack_in

๐•

Low-level algorithms and hardware-aware systems power private, high-throughput AI inference for coding agents. Stay tuned as we release further benchmarks.