It means that modern neural networks are way more interpretable than older ones. We can understand how they work way more easily than earlier ones.
For context: Goodfire has expertise in interpretability through a Sparse Auto Encoder technique of their own
https://www.goodfire.com/blog/a-practical-guide-to-saes
For context: Goodfire has expertise in interpretability through a Sparse Auto Encoder technique of their own
https://www.goodfire.com/blog/a-practical-guide-to-saes