logoalt Hacker News

minimaxir • yesterday at 11:31 PM • 0 replies • view on HN

Numbers update on my hypothetical tool after Opus 5.5 added support for image and audio input (plus video support via ffmpeg, why not) using my M3 Pro:

- Text: 78 embeddings/second on small texts

- Image: 4 embeddings/second

- Audio: 6 embeddings/second for 30 second chunks (which is how the encoder works)

- Video: 0.2 embeddings/second per minute of video (not entirely surprising since the encoder does 1fps).

Not bad numbers for a local laptop running a model this large, although the M3 Pro is a few years old and I suspect a M5 Ultra will 5x them at minimum.