logoalt Hacker News

dwighsonlast Monday at 11:41 AM1 replyview on HN

Building Warp (https://warp.thegeeksquad.io), a storage engine where each entity is its own actor with its own SQLite shard.

I've been doing DDD and event sourcing for years but always had to squeeze aggregates and domain events into Postgres tables. I kept looking at what scaling would mean with CockroachDB or ScyllaDB and it scared me. So I asked what happens if you just make SQLite the storage and let the BEAM handle concurrency, one actor per entity.

Turns out it works pretty well. 1.5M events/sec on an M1 in Docker with 5 cores. ScyllaDB on the same hardware does 49K. Written in Gleam, but there's a TypeScript SDK if you just want to use it from Node.


Replies

aristofunlast Monday at 11:46 AM

How do you solve HA?

show 1 reply