logoalt Hacker News

harttrav • yesterday at 1:56 PM • 1 reply • view on HN

umap (https://umap-learn.readthedocs.io/en/latest/) or tsne (https://scikit-learn.org/stable/modules/generated/sklearn.ma...) might be an interesting alternative to pca for dimensionality reduction


Replies

deepsquirrelnet • yesterday at 3:44 PM

About a year ago, I made a very simple language detection model from the token embedding tensor of gemma 3. I used UMAP to show the projections of how languages separated into a 2D space. It's very interesting to look at IMO.

https://huggingface.co/blog/dleemiller/wordllama-detect

If you just want to see the plot directly: https://cdn-uploads.huggingface.co/production/uploads/65ff92...