Fair didn't think about batching makes more sense for self hosted models then.