We have a continuously updated, publicly accessible hackernews database in BigQuery, in case more of you folks are interested in building similar projects:

https://console.cloud.google.com/marketplace/product/y-combi...

Clickhouse equivalent, updated in real-time: https://play.clickhouse.com/play?user=play#U0VMRUNUIG1heCh0a...

Relevant post: https://news.ycombinator.com/item?id=40644563

What's missing are entity-level extracted data, and embeddings.