I agree, with the caveat that it probably matters how novel the paper is, the effect size, and the confidence interval. A reputed new psychological phenomenon I'd be more skeptical of than, idk, a newly detected exoplanet.

That alleged superconductor from a few years ago - everybody kind of held their breath and waited for the reproduction.