logoalt Hacker News

justinc-md • yesterday at 7:14 PM • 0 replies • view on HN

What's your opinion of high bandwidth flash? It seems ideal for storing and retrieving model weights. Do you see that dramatically changing inference chip design over the next couple of years?