logoalt Hacker News

romaaeterna • yesterday at 10:14 PM • 1 reply • view on HN

If you graph actual NAEP since 1998 versus a 1998 group-fixed score, you'll see increases (1998-2002, 2005-2013, 2015-2017) and multiple declines twice taking the line back down to the 1998 linear trend prediction (2002-2005, 2017-2024).

It is wrong to get overly exact here though. We are talking about a overall score variance of just 10pts in the face of an achievement gap of nearly 30pts, with an absolutely massive 20% decline in white population share over the 26 year period.


Replies

tdb7893 • today at 12:01 AM

If you're seeing trends in your residuals that's a violation of the independence assumption of linear models (assuming you're using about a linear model since you're talking about "linear predictions").

I'm in a different field but an arbitrary 27 years (1998-2024) of data and the autocorrelation both would get flagged in a review for me. Not to give statistics homework but you should test and correct the autocorrelation issue you're describing in the model and if the data goes farther back I would go farther back, too (with how you're describing the errors going off pattern then back on it sounds like the inference here would be at least somewhat unstable depending on year chosen).

Edit: these are the assumptions and basics of how to correct for violations, in particular you're describing a violation of assumption 2 but you should test for all of them - https://www.statology.org/linear-regression-assumptions/