logoalt Hacker News

petcatyesterday at 9:27 PM1 replyview on HN

> Tencent has released and open-sourced Tencent Hy4 preview, a next-generation large language model with 770B total parameters and 49B active parameters, and a context window exceeding 1M tokens.

There are no open source models, at least not useful ones (yet) [0]. Open weight is not the same as open source. The current "open weight" models are just opaque binary blobs you can run on your own computer instead of through a web API.

[0] https://allenai.org/

Imagine thinking that running a Photoshop binary on your own computer instead of through a SaaS web app means that it's "open source". Of course you think that's ridiculous.


Replies

mirekrusinyesterday at 10:03 PM

You can open source dataset without all the details how it was assembled.

Models are lossy compressed datasets you can pick up and amend (fine tune / continue training / alter) according to license they were released under.

Hy4 is released under OSI approved Apache License 2.0.

show 3 replies