logoalt Hacker News

subsetyesterday at 4:25 AM2 repliesview on HN

I had good fun transliterating it to Rust as a learning experience (https://github.com/stochastical/microgpt-rs). The trickiest part was working out how to represent the autograd graph data structure with Rust types. I'm finalising some small tweaks to make it run in the browser via WebAssmebly and then compile it up for my blog :) Andrej's code is really quite poetic, I love how much it packs into such a concise program


Replies

ameliusyesterday at 3:53 PM

Storing the partial derivatives into the weights structure is quite the hack, to be honest. But everybody seems to do it like that.

hei-limayesterday at 11:15 AM

Great work! Might do it too in some other language...

show 2 replies