logoalt Hacker News

ennucorelast Monday at 5:08 PM2 repliesview on HN

How do you tokenize the mouse inputs?


Replies

nee1rlast Monday at 5:14 PM

good question! we use exponential binning (map the mouse movements onto a plane with exponentially increasing tick marks https://si.inc/fdm1/exponential_binning.webp) but tried a bunch of other methods (linear creates too many tokens for the model to learn well). Polar coordinates seem like a better solution but empirically didn't work well because the tokens got too coarse too fast.

show 1 reply
g413nlast Monday at 5:14 PM

we do exponential binning but fwiw I think we can do way better just hasn't been the main research area initially