logoalt Hacker News

synapsomorphy • today at 10:39 AM • 1 reply • view on HN

Sokoban is cool, but far from the most interesting thing here, which is the design of experiment factories for verifiable domains.

The base building blocks you need to make this work:

- dataset

- unhackable success metric

- hardened, isolated f(dataset, solver) -> metric

- helps a ton but not required: human with strong intuitive domain understanding

This is exactly the kind of RL environment in which the models are forged, so they're truly excellent at basically all stages of this process.

I'm working on something similar for image and video compression. The SOTA approach for these things currently is mostly deep neural networks. But agent powered experiment factories let you cover FAR more ground in algorithm-space than before, which makes deterministic and explicit algorithms, with little or no heuristics (aka floating point weights) feasible once again.

Explicit algorithms (SGD) grew implicit ones (neural nets) that are more powerful and general, but also more opaque and less efficient. Now those implicit ones have made search over explicit algorithms vastly faster, which is making them increasingly competitive with neural methods.


Replies

joe-esquibel • today at 3:46 PM

Exactly, I think algorithm development is becoming more like scientific research with hypotheses and evidence. Experiment factories is new to me but I guess it's also what I've been unconsciously developing towards after I created functional code factory for my own project.