alt Hacker NewsUS companies published their research on transformers. The only reason Chinese companies have any models at all is open US research...
Add distillation to that, and the entire Chinese AI sphere is really just an offshoot of public US AI information...
Replies
etdznots • yesterday at 5:59 PM
All LLM’s are distillation of stolen copyrighted materials, some of which are the outputs of other LLM’s.
adrian_b • yesterday at 4:58 PM
US companies started by publishing their research, but then they have stopped abruptly, seduced by the mirage of heaps of money that could be obtained by having a monopoly on AI.
During the last few years, the published research from USA was only a small fraction from that published from China.
Science doesn't work this way, someone could claim only reason World is successful because Chinese invented paper, so please don't go there.
Regarding distillation, you can also say Anthropic and OpenAI stole /distilled books, articles, blogs from everyone who published things without knowing their work might be used against them