Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Why I'm not a fan of zero-copy Apache Kafka-Apache Iceberg (jack-vanlightly.com)
4 points by vinhnx 51 days ago | hide | past | favorite | 1 comment


I disagree wit the author. Many companies use the Medallion Architecture. Even if Kafka saves the logs to Iceberg for it's own advantageous format, you skip the Landing layer and Bronze is just a view. There is definitely gain. Plus, you keep only stream loads on the brokers.

Silver and Gold tables are optimized for querying and correctness.

But it is an interesting, high quality article.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: