logoalt Hacker News

snapetom • yesterday at 10:15 PM • 1 reply • view on HN

Is this basically a table format like Delta/Iceberg but with an SQL engine built in via DuckDB?


Replies

Lucasoato • yesterday at 10:37 PM

Nope, from my understanding the delta log (the files that say which of your data files are actually valid or not) isn’t saved in json/parquet but directly in a database.

Much faster, but adds a dependency... that you would have added anyway with database based catalogs (that are not the only kind of catalogs)