logoalt Hacker News

samayasharyesterday at 10:13 AM0 repliesview on HN

Amazing work by the team! Looks like they've traded accuracy for speed and this is most likely going to be the case with the next class of models.

This is a valid tradeoff for one-off responses but if we're dealing with a distributed system (eg: Kafka), then only the high-confidence responses (>0.8) should move forward as input to the next service. If a low confidence output is propagated, then it can break the entire chain.