logoalt Hacker News

gopalvtoday at 2:56 AM1 replyview on HN

This was basically Vertica's party trick for quite a long time to have a WOS and ROS formats for the same row and anti-caching between those two.

You could've built a similar system with dezebium and delta lake for quite some time but it would fail compactions, if you run it fast enough. I've seen Oracle GoldenGate 12c do this trick in 2014 or so, using Mysql as the cheap replica. But they are all fragile to schema updates in some direction.

The closest batteries-included equivalent to this is the Aurora -> Redshift bridge[1].

[1] - https://aws.amazon.com/rds/aurora/zero-etl/


Replies

bastawhiztoday at 3:11 AM

Aurora zero etl was a nightmare for us. Almost any schema changes require a VACUUM FULL for it to continue functioning. On a few occasions, it just stopped running without an obvious explanation, requiring slow and lengthy back and forth threads with AWS support. If it worked as advertised, it would be great, but I can't recommend it for any serious production system.

show 1 reply