logoalt Hacker News

fc417fc802yesterday at 8:04 PM1 replyview on HN

GPU scheduling only affects the result due to buggy optimizations. It's the exact same mechanism as fp rounding error on the CPU or updates to globally shared PRNG state. We use lots of buggy optimizations because they don't matter in practice in most situations (see ex -ffast-math).


Replies

qarlyesterday at 10:20 PM

I don't know the details but apparently it has something to do with multiprocess contention for the GPU and batch sizing.