> As a CTO of an Ai first law firm I would like to add that most human lawyers are absolutely terrible

This is many people at many jobs. We continue to see this weird thing when AI comes into an industry that suddenly the product being produced by the people was perfect/amazing/whatever. Maybe that's true for the majority of HN who are lucky enough to work with experts in every field, but in the general population that's simply not the case.

Many doctors, lawyers, and programmers are not very good at their jobs - I've seen it first hand. AI gives the general population a way to steer around these people a bit, and maybe ask the right questions. Is it perfect? Nope, but it's often better than the people someone has access to.

> most human lawyers are absolutely terrible.

I think this extends to the other areas that AI is also disrupting.

Software engineers are also absolutely terrible: In being sloppy with handling errors, doing coercions, etc. All because always engineering after best practice simply takes too much time and mental load.

The real disruption from AI is likely that it does not get mentally fatigue. It can keep on, launch adversarial audits, make sure that everything is up to all standards.

Wonderful, I'm tired of lawyers. Happy to see that evolve and figure out how to provide actual value for its cost.

But the real question is 1) whether other human lawyers would catch the error 2) in how much time 3) which of the errors introduced by AI vs. human would have bigger consequences. On 1 and 2 the answers are very likely to be "yes" and "it would take humans more time", but the question that really matters is 3.

> most human lawyers are absolutely terrible. We review 100s of old contracts every week

I hope the irony is lost on no one that "Attention Is All You Need" was the paper that kicked the LLM boom off.

Part of the distinction between a how good one lawyer will be vs another is exactly that: attention to detail. And, as a trade, a practice, it seems like a skill that they try to hammer into the people who pursue this career (to varying degrees of success clearly).

It makes the last 20 years of leet code hiring look downright wrong. Your ability to recall what sorting algo to use, or solve some brain teaser conveys nothing about your ability to read (massive amounts) of code, and think critically about it.

Most people are terrible at what they do, period, regardless of profession.

I have the impression that most law firms consume and produce documentation by means of a cadre of paralegals who are minimally trained, minimally experienced, and maximally stressed by the pressure of deadlines and case loads. These paralegals are probably working to read hundreds of pages of legal filings and make sense out of them, and on the other end, they are working to produce as much documentation as possible and that's going to be by cut-and-paste assembly. So no, they are not going to understand stuff very well, and no, their output is not really going to be consistent or intelligible. But the managing attorneys depend on these paralegals to get anything done, just like Congresspeople rely on their staffers to actually read bills and draft legislation.

At the end of the day, I think these paralegals have been quite weak links, and nearly nobody will notice a difference in quality when it's all handed over to LLMs. But the paralegals will lose their jobs, and probably have nothing better to do than purchase angle grinders and cut down Flock camera poles, or crown the front hood of Waymos with a traffic pylon.