I wouldn't quite go that far. Linux runs on nommu systems. With some psram you should be able to get a version to run on at least the rp2350 using the riscv cores with relatively minimal fuss.

Is that a good idea? Well, not really.