Maybe Karpathy used an LLM too. The 44 TB number, happens to match exactly the currently largest available drives sold for Enterprise by Seagate, not 40 TB, not 50 TB but 44 TB...coincidence ? - [1]

For SSDs record seems to be 245 TB - [2]

[1] - https://www.seagate.com/stories/articles/seagate-delivers-in...

"Seagate’s Mozaic™ 4+ hard drives supporting capacities up to 44TB are now shipping in volume to two leading hyperscale cloud providers."

[2] - https://fudzilla.com/kioxia-showcases-245-76tb-lc9-enterpris...