alt Hacker NewsNvidia GPUs let you load encrypted weights onto them and to decrypt on chip so Google would need to have some sort of Nvidia management firmware attack to read from HBM while the GPU is live
Replies
zeroxfe • today at 6:50 PM
Distillation does not require access to weights.
binlog • today at 5:41 PM
Doesn’t really matter what happens at the GPU level when Google can see all API traffic.
Isn't distillation more of a black box type affair?