logoalt Hacker News

PaulHoule • yesterday at 3:34 PM • 0 replies • view on HN

Length-dependence has been a thing in vector search since bag-of-words!

https://en.wikipedia.org/wiki/Okapi_BM25

was one of very few useful results of the first decade of TREC research... And the main thing it addresses is balancing various factors which could cause a full text search engine to privilege either long or short documents.