Wow. Big question.
So Nerves folks typically run Elixir on the Erlang VM. So you have the Phoenix web framework, Membrane media framework, Nx (nx_eigen) for basic inference, Emerge does well for embedded UI.
I've played around with clustering a bunch of these devices over Tailscale across my home. Opening cameras from one device and streaming to anothers display, willy-nilly. All experimental for me.
I've put Homex and Espex on them to have them integrate with Home Assistant. Feeding sensor data up or whatever I feel like.
Elixir already has a production embedded ecosystem through Nerves and web services have been the bread and butter for a long time. So you can do almost anything.