I believe Intel has a winner with the upcoming Crescent Island GPUs with up to 480GB of LPDDR5 memory. A lot of SMEs will need local AI with large open weights models (i.e. >1.5TB of VRAM), but they don't need a watercooled 8x Nvidia GB300 box. Besides, it's difficult to deploy and very expensive.

Crescent island is air cooled and likely fast enough for a group of users running something like GLM 5.2 or Kimi K3.