logoalt Hacker News

dannykwells • yesterday at 11:31 PM • 2 replies • view on HN

Well you can’t verify a prediction about human biology without a phase 3 clinical trial so…


Replies

criemen • today at 12:23 AM

The thing that I've not fully groked here (might be relevant) is that OAI is generating "paper" proofs first, and only then formalizes them in Lean as a separate step. They've as far as I'm aware not said anywhere how many write ups failed formalization due to a bug in the proof. If we assume that number is low, models would be quite good at one-shotting math proofs. Then it depends if you can replicate the math RL training for chemistry/biology/medicine. Is there enough data out there for that? No idea.

➕ show 2 replies