Here's a video of a previous 1T K2 model running using MLX on a a pair of Mac Studios: https://twitter.com/awnihannun/status/1943723599971443134 - performance isn't terrible.
Is there a catch? I was not getting anything like this on a 70B model.
EDIT: oh its a marketing account and the program never finished... who knows the validity.
Is there a catch? I was not getting anything like this on a 70B model.
EDIT: oh its a marketing account and the program never finished... who knows the validity.