AI Hardware & NPUs

Hardware for 70B models comes down to 35GB of 4-bit weights plus context, and bandwidth divided by model size — with four routes and the real speed each delivers.

What is an NPU and what does it change? Why efficiency per watt matters more than TOPS, and why it will not run large local models.