alt Hacker Newsso many inference project, omlx already supports all of this and has a 1000 people trying to optimize it constantly
Replies
carloslfu • today at 2:15 AM
Interesting! I'll check it out
so many inference project, omlx already supports all of this and has a 1000 people trying to optimize it constantly
Interesting! I'll check it out
Both projects are different in scope. Think of slotstream as optimizing for memory and for this specific model for now, my intention is not to build an inference engine the same as oMLX