logoalt Hacker News

GitHub Actions and Pages are experiencing degraded availability

354 pointsby Footkerchiefyesterday at 3:49 PM290 commentsview on HN

https://www.githubstatus.com/uptime/br0l2tvcx85d


Comments

Arubisyesterday at 5:08 PM

Github Actions are rapidly becoming an argument against dogfooding into your critical path.

denysvitaliyesterday at 4:44 PM

Was? Still is

g42gregoryyesterday at 10:45 PM

I may be wrong, but I think this could be traced to the Microsoft's increasing reliance on the outsourced engineering workforce. Regardless of the country it has been outsourced to, the quality of service will suffer, apparently greatly as we now see.

It seems to manifest in many places: AI slop, Github outages, recently Miscoroft sent me an email demanding that I subscribe to 365, in order for MS Office (which I already paid for) to continue to work. I simply moved on to the other, free, provider.

Perhaps, it's time to evaluate the use of the Microsoft products?

nnucerayesterday at 7:50 PM

MiniStack is currently affected to keep up the releases :(

earthpyyyesterday at 7:16 PM

That's why my CI on main branch didn't triggered.

ptxyesterday at 5:21 PM

Are there any other CI providers that offer free cloud-hosted Windows runners?

Or has Microsoft made sure (through Windows licensing terms and pricing) that it's not possible to compete with their own CI offering?

Edit: CircleCI seems to offer 750 minutes/month (whereas GitHub offers 1000 minutes/month).

show 1 reply
slicendiceyesterday at 10:21 PM

Github is a terrible platform. We have had multiple enterprise tickets open with no response for multiple weeks after they fraudulently charged our company for services we cancelled weeks in advance. If you value any kind of real customer support or response time, I would avoid Github like the plague. They will steal your money and there is no one to even talk to about it. Their customer support is non existent (probably because their platform is in shambles).

asxeemyesterday at 7:21 PM

It's been way too long now...is this normal?

classictrafficyesterday at 5:17 PM

This has been preventing me from merging a PR for over an hour. I'm really tired of the constant outages GitHub has

fir3pho3nixxyesterday at 5:45 PM

Are we even surprised anymore? Since microsoft (the IBM of its time) have taken this over all I can say is ... piss up ... brewery.

fir3pho3nixxyesterday at 5:44 PM

Ever since Microsoft has taken this over are we even surprised by the downtime anymore? Piss up ... brewery ...

dietr1chtoday at 3:29 AM

I'm surprised this still passes as news, gives water is wet vibes at this point.

asxeemyesterday at 7:21 PM

It's been way too long

dbg31415yesterday at 11:28 PM

GitHub needs to change their slogan. "60% of the time, it works every time."

throw03172019today at 1:40 AM

Degraded is an understatement. It’s been totally down all day. Crazy.

axodyesterday at 6:11 PM

Broken for almost 4 hours.

dlcarrieryesterday at 4:02 PM

So, it's a normal Thursday?

SoftTalkeryesterday at 7:24 PM

[flagged]

iamleppertyesterday at 7:54 PM

It's really crazy to me they can just be down for hours and can't recover their own systems. It shows they don't have the capability or infrastructure to roll back disastrous changes. These kinds of things are a tell on the organization and operational excellence (or not). As soon as a viable alternative surfaces for Github, I'm moving off and will advise all my clients to do so as well.

the_real_cheryesterday at 7:26 PM

My experience working at LinkedIn was that, after Microsoft took over, they offshored a huge part of their infrastructure and turned the entire culture into one of performative based engineering instead of results based engineering.

If you implemented a tool and it worked one time for your presentation to management that's all that mattered.

The actual company employees using it downstream in prod basically had to constantly QA the alpha software they were forced to use and the authors of the tool were hard to track down if they even still worked there. And if you did find the author or the team they would be very resistant to admitting there was an issue because it LOOKED bad.

So many tools I used were fragile and buggy, it was clear the authors just presented the happy path to management to get the note added to their promotion packet and the rest of the company just had to deal with the fallout.

My team implemented this product that the entire company used that was broken and buggy as hell but they kept presenting the product to management as this amazing product and nothing was ever done about how broken it was. One of my team members came from Apple and said Apple's tool to do the same thing was much better. The tool my team worked on was a well known pain point amongst the rank and file but management was very detached from the rank and file, which I guess ultimately was the primary problem.

If Github is having the same issues I feel for them.

canadiantimyesterday at 6:29 PM

Ah that checks out, was wondering why my PR's were piling up.

whateveracctyesterday at 4:49 PM

any 9s left?

show 3 replies
timetraveller26yesterday at 6:09 PM

If anybody is looking for alternatives, self host Woodpecker is really easy and it's a very capable CI/CD https://woodpecker-ci.org/docs/intro

homeonthemtnyesterday at 6:02 PM

Still twiddling thumbs over here

richwateryesterday at 10:10 PM

Gotta wonder what they're up to over there.

Is the AI slop that bad? Culture change?

show 2 replies
gajusyesterday at 7:17 PM

so... what happened?

show 1 reply
dborehamyesterday at 4:58 PM

Someone needs to work on improving the way Actions deals with resource exhaustion like this. Today it exploded all the CI jobs with "failed" and an inscrutable message about "The job was not acquired by Runner of type hosted even after multiple attempts" then "Internal server error". It should say "Timed out due to no runner available, our apologies, try again later, or pay $$$ here to get priority for runners".

show 1 reply
homeonthemtnyesterday at 4:33 PM

Ah. So that's why.

swyxyesterday at 8:29 PM

i guess this is a good time to mention that smol forge is open for the first 100 alpha users!

point clanker to forge.smol. ai/llms.txt

for now its just a fast agent native git remote and u can check docs for the extras.

sitzkriegyesterday at 7:38 PM

using github in the big 26 is self ownage

dwoldrichyesterday at 7:34 PM

Spin 'em off Microsoft, you are terrible at this.

shevy-javayesterday at 8:19 PM

Ever since Microsoft took over, and then when AI Skynet took control, things started to decay. AI companies owe all of use a lot of money. By the way, why do I have to pay for increasing RAM prices here? Why are we so dependent on a few greedy corporations, anyway?

dinnyyesterday at 4:36 PM

man.. again?

rvzyesterday at 7:27 PM

As I said 6 years ago. [0] You would be better off self-hosting than using GitHub or GitHub actions. No CEO of GitHub exists and now it is falling over again.

There is no better time to self-host.

[0] https://news.ycombinator.com/item?id=22868406

waterTanukitoday at 1:07 AM

When the barrier to entry for software was high, free unlimited publicly hosted git repositories made sense. Not only did you have to have some basic understanding of software, but a grasp on git itself.

Now that the calculus has changed, I think we should start asking ourselves whether anyone has the right to unlimited free public repositories.

We can all agree that trying to attribute any single metric to repo quality is subject to Goodhart's Law[1] (e.g. what happened to GitHub stars) yet we can also agree that the Linux Project is a much more vital repository to keep public infrastructure availble for than say, someone's vibe-coded to-do app. Is it impossible then to make any quantitative distinction between these two? We can't have both an uncontrollable firehose of AI slop and unlimited free public storage/compute at the ready for it. I say we actually need to decide what software is worthy of using up these resources for free. We already have companies like JetBrains[2] using dynamic pricing for their products. It's time Github do the same. If you want a hosted VCS for vibe coded projects that aren't being used or depended upon widely, then host the repo yourself.

[1]: https://en.wikipedia.org/wiki/Goodhart%27s_law

[2]: https://www.jetbrains.com/community/opensource/

monkaijuyesterday at 9:49 PM

Im shocked this is still going on... We moved our repos at work to a self-hosted Forgejo 2 months ago because the regular outages were getting ridiculous, looks like a pretty good call now.

Honestly I dont think I've seen a tool I used regularly with such a moat lose it simply because they cant keep the service up. Also its hard to not see a pretty strong correlation between a bunch of these big companies doubling down on AI and just having their service go to s%#$. We've had similar issues with Digital Ocean recently, which is pretty lined up with them adding a bunch of "inference" services and rebranding the site to add all the "agent" marketing slop. Looking to move to Hertzner when the time allows.

crmsystemsyesterday at 10:38 PM

actions been down for hours wtf going on.. AI bullshit

rvzyesterday at 5:09 PM

Do we need to say this again? GitHub appears that they are never going to improve. Just look at how GitHub spark has deprecated, now we have this.

After 6 years of this nonsense of "centralizing everything on GitHub", it is not a good idea at all.

You might as well self host like I said before [0].

[0] https://news.ycombinator.com/item?id=22868406

rwzyesterday at 6:18 PM

[dead]

sehwyesterday at 7:28 PM

[dead]

sondelaliyesterday at 11:02 PM

[dead]

andrewmcwattersyesterday at 4:51 PM

[dead]

hacker_88yesterday at 7:33 PM

Azure