3 years ago

Category: Data, kafka

by Change Data Capture Architecture Using Debezium, Postgres, and Kafkawas a tutorial on how to use Debezium for change data capture from Azure PostgreSQL and send them to Azure Event Hubs for Kafka - it used the wal2json output plugin.

I will not be repeating a lot of details and use containerized versions (using Docker Compose) of Kafka connect, Kafka (and Zookeeper) to keep things simple.

Update the connector config file (pg-source-connector.json) with details of your Azure PostgreSQL instance and then create the connector

As I mentioned earlier, you need to work around this by creating the publication manually for specific tables only