alt Hacker NewsAnd this is were the misconception appears. LLM's are a type of AI, but AI != LLM. The top part of the results, also called the AI summary. Is _not_ the only thing that is AI about search. Embeddings, a commonly used element of search, or ranking algorithms, use AI as well. More specifically, the techniques are known as machine learning, but it is AI. If you truly want to have no AI at all, then you are back to boolean retrieval systems. That basically boils down to: Count the amount of times the terms of your query appear in the document and return the top x results (which is impossible to do at Google's scale).
Replies
If Google's switch promises to disable the use of all "AI" techniques down to the implementation level, that would imply it also disables spam filtering in gmail. I haven't seen that reported and it isn't in the original announcement post, so it probably isn't how they're thinking.
You’re right that there are other kinds of AI frequently used in search, but why do you claim having an inverted index is impossible at Google’s scale? How do you think exact term search works?
oh my god we're all talking about the AI summary results
> That basically boils down to: Count the amount of times the terms of your query appear in the document and return the top x results (which is impossible to do at Google's scale).
It is very possible to do at google's scale. Jeff Dean and co built Map Reduce to help implement algorithms of this type. For example, https://en.wikipedia.org/wiki/Tf%E2%80%93idf is entirely based on counts. Combined with a sparse encoding and distributed lookups, this is how ALL retrieval worked for decades. In fact, any large scale retrieval system today uses a combination of sparse searches followed by a ranking or scoring with dense methods. You can roughly call sparse methods count-based and dense methods neural network based.
Source: the field of information retrieval https://web.stanford.edu/~jurafsky/slp3/