Comment by throwawaymaths - Hacker Neue

throwawaymaths May 28, 2025 parent

what's the memory bandwidth? IIRC that is the limiting factor in LLM hardware today

walterbell May 28, 2025

Slide 21, https://files.futurememorystorage.com/proceedings/2024/20240...

            TPUv3     TPUv4
  HBM2 BW   900 GB/s  1200 GB/s

This item has no comments currently.

It looks like you have JavaScript disabled. This web app requires that JavaScript is enabled. Please enable JavaScript to use this site (or just go read Hacker News).