alt Hacker NewsI was very excited about this comment until I got to this part:
> That's a seriously insane number to keep up with at GitHub's scale.
What exactly is it about GitHub's workload that makes us feel like the specific 23k things happening in that slice of one second are tantamount to insanity? In my experience, much of GitHub activity is changing labels on issues and posting plaintext comments.
Technically speaking, this rate of things happening per second is well within the territory of what one large server can handle. I know it sounds wild to imply that we could run all of the GitHub public cloud off a single machine, but how crazy is it in reality when we start to consider the actual I/O bandwidth that is available in a leading edge server platform? All of VisaNet circa 2009 could run off a single mainframe. That's global. It is plausible they still operate this way.
Virtually 100% of the aspects of GitHub that would quickly saturate I/O on the transactional core can be offloaded to horizontal systems like blob storage and CDNs.
Replies
> What exactly is it about GitHub's workload that makes us feel like the specific 23k things happening in that slice of one second are tantamount to insanity?
>
> Technically speaking, this rate of things happening per second is well within the territory *of what one large server can handle*
Just as a mental exercise, consider what is happening when a GH action kicks off and everything involved in that.
The amount of write I/O we're talking about here is absolutely massive just on the GH side of it.
A Netflix or Hulu serving videos isn't the same thing because that is a read-heavy workload that works great in CDNs. GitHub has massive amounts of write volume.
I have difficulty finding what exactly is talked about as 2b per day, but it is not all operations. GitHub saw 473.3 billion events per month lately (https://github.blog/engineering/architecture-optimization/bu...), or ~183K events per second on average. So the 2b number is something much more expensive.