alt Hacker NewsI have a question for people with knowledge of both LLMs and GOFAI: Why can’t we use LLMs to write as many symbolic rules as needed to fit the data while keeping the ruleset reviewable and maintainable?
Replies
sorry this may be way off, but feels analogous to me.
reminds me of http://www.thai-language.com/ (it's safe). it was around long before Google Translate got good enough. i don't know the authors/maintainers, but afaik, everything is entered manually. this is the "analytical" approach to language. most translations before Google Translate went full ML used an analytical approach.
anyway, long story short, turns out "analyzing" a language to "understand" it GREATLY underperforms probabilistic/statistical methods like ML.
also reminds me of trying to label parts of speech in Vietnamese. there's a school of thought that finds it useful...then there's another school of thought that plainly points out words that can be verbs, nouns, adjectives all in different contexts.
We can and do! Here's one you can help maintain and review!
Define reviewable and maintainable
The amount of finite rules necessary (that the LLM will write) to handle the noise and complexity of real data generates such a dense graph that it breaks the premise of a human-maintainable and auditable system.