i'd interpret that as rounding error. that is unchanged
swe-bench seems really hard once you are above 80%
it's not a great benchmark anymore... starting with it being python / django primarily... the industry should move to something more representative
alt Hacker News
it's not a great benchmark anymore... starting with it being python / django primarily... the industry should move to something more representative