logoalt Hacker News

measurablefunctoday at 8:26 PM2 repliesview on HN

Great. How do I use this in my life to make things better?


Replies

glialtoday at 9:06 PM

The SPRT is probably already making your life better: it's used to decrease the cost of medical trails, optimize classifications in high-stakes examinations (i.e. for medical certifications), detect defective manufacturing processes, etc. It sounds like this paper extends the method to groups of hypotheses, whereas the basic version is limited to a null hypothesis and an alternative hypothesis.

data-ottawatoday at 9:11 PM

This helps with determining when have you observed enough data to make a decision.

A/B tests, monitoring metrics, health, quality control all use this.

If you use LLMs, you might use this to determine if a model update or prompt change impacts results using fewer tokens.