Well yeah, because music is not a modality of the models involved at all. It's literally just an LLM with the timestamps of each line injected into its context, and then making an API request to image / video generators. I don't really understand what the point of this project even was; stitching together dumber models with bespoke glue logic like this takes us further away from general intelligence and confuses the public.

While it's made huge improvement in just the past few years, AI still hasn't quite solved motion, especially human motion. The humans in these videos are rendered really well, but move unnaturally. Like someone did a motion capture of a real human, and then played it back with a very high quality 3d model--something hard to describe is lost in the processing. Everything seems to move just too smoothly, at too exactly constant a speed. Same for camera movement. A real life camera doesn't precisely follow some exact 3D Bézier curve at an exactly constant speed. AI doesn't get this yet.

To me nearly all of the real world dancing looks like that. The dancers could literally be olympic level and I still don't see the connection between their movements and the sounds of the music. Music videos sometimes do sync for me but only on very simple motions, and for whatever reason shuffle dance on video almost always looks great.