Yeah, I kinda figured that head was the whole model, the way you phrased it. scikit-learn?
No, plain numpy. It's full-batch Adam on cross-entropy against soft targets, about 80 lines.
alt Hacker News
No, plain numpy. It's full-batch Adam on cross-entropy against soft targets, about 80 lines.