logoalt Hacker News

ameliustoday at 8:22 AM2 repliesview on HN

Having not been formally verified, almost all software today feels cheap. Maybe an AI can change that at some point.


Replies

andaitoday at 8:48 AM

By Dijkstra's standards, we've been vibe coding for an entire century!

I had similar thoughts recently, that now that machines are good at writing proofs, this could help with their reliability in software development.

Then I had a funny incident where an LLM implemented a feature completely backwards. Plenty of tests were supplied which demonstrated that the completely broken feature was correctly implemented.

I realized that formal verification would not have helped here, if I had left the task to the machine. It would simply have written a mathematical proof of the correctness of the incorrect feature!

Apparently this is an issue for humans as well, called the "spec gap" or something like that.

show 1 reply
ChrisGreenHeurtoday at 8:25 AM

Yay let’s lock ourselves into the formal verification toolsets, so that we can never use new language features again.

show 3 replies