Supermetal recently added Iceberg sink support, and I wanted to take it for a spin. A couple of months ago, I tested the newly announced Kafka sink, so you can think about this post as a continuation of this blog post series.
I wanted to compare Supermetal with typical open-source tools for writing data to Iceberg: Kafka Connect, Flink, and Spark. My goal was to measure a realistic end-to-end pipeline: getting data from Postgres and writing it to Iceberg.
These workloads are typically used for data archival, so I didn’t want to…
