Essays··6 min read
You can buy GPUs but not memory Memory 🙈
The constraint on AI infrastructure in 2026 is not compute but memory bandwidth adjacent to the silicon, and the CoWoS packaging required to deliver it. TSMC's advanced packaging capacity is fully booked through 2027. Adding GPUs does not reduce LLM inference latency when the bottleneck is HBM bandwidth.
ai-infrastructuregpu-memoryhbmhardware-supply-chain
Read