logoalt Hacker News

bhoustonlast Monday at 3:59 PM1 replyview on HN

I am pretty sure OpenAI and Claude actually have a higher hardware cost per request that Microsoft. Github is actually most just a standard REST API app, although with some caching and git specific operations in the background. It is not as hardware intensive as GPU-based inference per quest with huge contexts and low latency.

Also Github's feature offering has been incredibly stable for the last 6 years. There isn't an excuse for it to be unstable like this.


Replies

pixelesquelast Monday at 4:06 PM

Yes, but come on...

That's due to the need for ultra-fast memory and inference compute, it's not the same thing.