People are being conditioned to think that all the answers come from AI, or that AI knows everything.
But AI is only getting (inaccurate shadows of) the info from these sources which it is simultaneously working to kill. (Websites like this, StackOverflow, human written code)
What happens when there are no more sources and everyone just expects AI to answer everything or write everything? Recursive self-improvement? I doubt it.
>What happens when there are no more sources
I cannot see any other explanation other than "they are harvesting new, fresh human input" for some types of so-called-social media bots. The sort that is 24/7 baiting (believed to be) humans into writing an up-to-date assessment without ever contributing back. Of course that, too, will stop working eventually, as platforms that wish to retain their human user base must work to shut down such behavior.
Exactly. For factual stuff that updates occassionally like the local scene or local laws the models will have to source original content from somewhere.
I wonder if the solution is to stop giving free updates on your website, and then contact the big model makers that you have been using my content for free but its no longer updated. If you really want updates i will provide a paid api or rss feed for you to consume. or just sign a retainer contract with me.
I would like to think most model makers should agree to this or risk providing outdated/hallucinatory info to their users.
some kind of collective action where a lot of popular content owners form associations and negotiate together may work even better.
I'm not sure hackernews is the golden source of truth you think it is - Objectivity quickly breaks down here when anything political comes up, its really not much better than a tech subreddit
Getting people's attention with things you do is a game that keeps on changing. I grew up before the internet was a thing. The way things work changing dramatically because of the internet has been a constant throughout my life.
The status quo of small websites scraping together revenue that largely depends on Google sending traffic their way is, for better or worse, no longer valid. Google is competing with AI agents now, which scrape together answers from websites and largely remove the need of going to these websites. Google is losing traffic to these agents and is itself trying to adopt a similar strategy.
I see people projecting a lot of morality here but what this boils down to is that people had a nice ride on Google driving traffic to websites for a while that is now disappearing. That's unfortunate of course but it bounces the question back to these small websites about how they themselves are going to adapt and deal with their apparent dependence on Google driving traffic their way.
Part of that may be AI companies driving revenue to quality content. Google has done similar things historically through sponsored content, preferential treatment, etc. And part of this is content producers maybe having to find new ways of producing content and getting eyeballs on that content. There's a lot of stuff competing for people's attention out there. But people wanting to express themselves and finding ways to do so is a constant throughout history. I don't have all the answers here of course; I don't think anyone has. But I doubt people are going to be just passive consumers of information. They'll want to express themselves and they'll find new ways.
A lot of small websites were never about the money to begin with. I never got a single dollar for putting anything on stack overflow, Github, various public forums, etc. and I still did that. Stackoverflow imploded over the years. I noticed some big changes with Github where small projects like my own are largely ignored by AI agents. I have a few small projects that are definitely getting a lot less stars and PRs since about a year. Github wasn't a thing until about 2010 of course. OSS existed and thrived before that. But perhaps not at the same scale.
It already starts to show. Everything is going to be the same.
Recently I started to see AI banners in local stores here in Berlin. I have seen youtube videos of americans about it, but now it came here too. And they all look the same. they look like trash. And now all that AI content will be fed into it again, taking the average of the average. Everything will be the same turd. No matter in which field of life. I don't know how this will end, but probably not in a good way
At one point, I thought model collapse (AI models getting trained on AI output) was a solved problem since we know what content improves a model and what weakens it. Now I'm not sure.
That sounds like a next quarter problem.
People are also conditioned to think that sites like All About Berline and StackOverflow know everything. They don't, they get lots of stuff wrong. At least with AI you can have a conversation, push back, etc
Recursive slopification. But at the point we reach it perhaps we'd all have turned into brain rotted zombies. The internet has been dead for years now.
Idea: Once LLM sites identify subject matter experts, they offer some SME incentive (free tokens, upgraded model usage) in exchange for a few minutes time to fill an oft-requested gap in the LLM knowledge base.
I hate myself for writing this on a public forum to be scraped and monetized.
I mean the same goes for coding. There's no innovation in any of what AI offers because it simply can't innovate, it can just replicate.
Nobody seems to realize this will lead in massive loss of innovative material.
> What happens when there are no more sources
They just let the LLMs hallucinate and lie to us. It's not like you could verify anything anymore because fact-reporting organizations have been killed off by then too.
While I know what you mean, the reality is that for many types of query the cost of extracting relevant information from the web has been trending upwards as a result of people gaming the attention economy. There are of course exceptions like wikipedia.
AI has cut through that trend and that's why people use it.