logoalt Hacker News

benbojangles • yesterday at 4:33 PM • 1 reply • view on HN

My halftop macbook m1 max 64gb is doing all my ai locally, i have not paid for any ai subscription for over a year.

things i run locally using apple mlx models: general llm, coding llm, text-to-image, text-to-video, image-to-video, text-to-music,

everything is holding up well. I may eventually swap the m1 max for a higher memory bandwidth device once they are available for a reasonable price in 6+ years


Replies

jjcob • today at 4:03 AM

Can you explain how you use a local llm on your Macbook Pro to someone who has no experience with LLM?

➕ show 1 reply