It's exceptionally optimized... 890 bytes per token. At standard 32K context, that's less than 30MB.

1. https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash

2. https://www.mindstudio.ai/blog/deepseek-v4-1-flash-specs-arc...

yeah they mention:

> Required for a complete inference service (not included in this release):

> A KV cache system

> VE/Prefill/Decode disaggregation (most required engine functionality is already implemented)

> Load balancing across data-parallel replicas for both prefill and decode

They use 3FS [0] also open sourced [1]

[0] https://github.com/deepseek-ai/DeepInfer/blob/main/doc/infer... [1] https://github.com/deepseek-ai/3fs

important note