It's an interesting example of the metric becoming a target. Simon started drawing pelicans because it wasn't something that existed before.
There’s a small albeit nonzero chance that frontier labs want Simon to stop using the pelican thing so they can draw attention to better benchmarks
There’s a small albeit nonzero chance that frontier labs want Simon to stop using the pelican thing so they can draw attention to better benchmarks