logoalt Hacker News

microtonal • yesterday at 5:34 AM • 9 replies • view on HN

The AI answer dominates the page, and is usually wrong, so it's just a waste of the most valuable space on the page.

I started noticing that for a lot of niche questions, AI overview often uses things like Reddit comments as the source, which are often partially or completely wrong. Then it gets reformulated with the typical confidence of an LLM.

Very scary because at the same time I notice people taking the AI overview answers as truth.


Replies

roryirvine • yesterday at 9:58 AM

This is another area where DDG shines - it doesn't have a commercial relationship with Reddit, so doesn't push it in its results.

DDG's 'Search Assist' AI overviews are pretty basic but they tend to be sourced from Wikipedia and traditional media outlets rather than forums and blogs - they can be out of date, but are generally a lot less "spicy" than the sources that Google use.

I guess Google is much better-optimised for engagement but that's not what I'm looking for, meaning that DDG is a better choice for me.

➕ show 2 replies
krige • yesterday at 8:56 AM

I started noticing that for a lot of niche questions, AI overview often uses things like Reddit comments as the source, which are often partially or completely wrong.

If only! I've seen it sourcing reddit comments, but when you follow the link, the comment is either completely unrelated or does not say what the LLM claims it is saying.

➕ show 1 reply
gloosx • yesterday at 7:06 AM

The actual scary part is that people already manipulate and poison the google overviews on purpose.

It is very easy to bring your bs to the TOP spot on google at the moment with carefully crafted reddit comments and blogs, and it's not hard to get to the traffic and clicks this way.

This is what the new SEO is about, I know a bunch of people who are doing this and they are praying it is not getting fixed anytime soon.

➕ show 1 reply
Grimburger • yesterday at 2:40 PM

Poisoning the well with fake/made up reddit posts is incredibly common these days.

Certain people have realised that if you start feeding the machine this poisoned data eventually it reaches millions of eyeballs. It's the new SEO.

➕ show 2 replies
breakingcups • yesterday at 7:49 AM

I've seen medical specialist take Google's AI answer as truth. Nutty.

➕ show 2 replies
anilakar • yesterday at 7:45 AM

If I type exact document identifiers, the LLM either tells me that I have either mistyped something or that I am searching for a specific document. Hell yeah, I am doing exactly that! Give me the link instead of babbling about it!

kibibu • yesterday at 5:46 AM

The web search gives the impression that it's grounding its answers, but if you ask it for something new or non-existent it'll still make shit up.

➕ show 1 reply
techdmn • yesterday at 12:14 PM

> people taking the AI overview answers as truth

One of the most disappointing things to me is people I previously respected appealing to the authority of LLMs.

gambiting • yesterday at 6:59 AM

I'm in several facebook groups for cars and bikes, and holy smokes, someone asks a question and usually the top response is someone literally pasting in a screenshot of a google AI generated response....which is wrong like, solid 50% of the time. And then you point it out and people get aggro on you. I hate it.

➕ show 2 replies