> an SLM of around 100-400M parameters at crazy high speeds and with minimal power usage

Software support for that kind of usage, when available, will be immensely impactful.