logoalt Hacker News

DoctorOetker • today at 5:32 PM • 1 reply • view on HN

@DeepSeek teams, why not train your next series of LLM models with source-aware training?

https://arxiv.org/abs/2404.01019

LLM's would be able to answer questions, delineating exactly which facts/assumptions/reasonings are prior work and from where (this URL, that book, etc.), and which parts are it's own deductions, or the user's.


Replies

londons_explore • today at 6:03 PM

Notable that humans can't cite the source for a huge chunk of their knowledge. Eg. When/where and from who did you learn the meaning of the word "garden".

Your understanding of the world "garden" probably came from 5+ encounters with the word in different contexts, and you cannot separate them - instead your understanding is some kind of average of the knowledge from each encounter.

Interestingly, adjacent and overlapping-meaning words like park, meadow, yard, grassland etc often have disputed boundaries - ie. One person might call something a garden, whilst someone else calls it a meadow. Neither can explain quite why they have chosen their specific word for the object in question, but it might stem from the source of where the meaning of each word was initially learned.

➕ show 1 reply