logoalt Hacker News

fookeryesterday at 11:07 AM3 repliesview on HN

Fun fact - single bit neural networks are decision trees.

In theory, this means you can 'compile' most neural networks into chains of if-else statements but it's not well understood when this sort of approach works well.


Replies

smokelyesterday at 1:59 PM

> single bit neural networks are decision trees.

I didn't exactly understood what was meant here, so I went out and read a little. There is an interesting paper called "Neural Networks are Decision Trees" [1]. Thing is, this does not imply a nice mapping of neural networks onto decision trees. The trees that correspond to the neural networks are huge. And I get the idea that the paper is stretching the concept of decision trees a bit.

Also, I still don't know exactly what you mean, so would you care to elaborate a bit? :)

[1] https://arxiv.org/pdf/2210.05189

show 2 replies
Almondsetatyesterday at 11:31 AM

Do you know of any software that does this? Or any papers on the matter? It could be a fun weekend project

show 2 replies