Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

Fastest open-source tool for replicating Databases to Apache Iceberg or Data Lakehouse. ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supporting Postgres, MongoDB and MySQL

Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift, Databricks) in real-time.

Distributed Data Transfer Service for MySQL

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

A scalable Netflix DBLog implementation for PostgreSQL

Kuvasz-Streamer is a Postgres-to-Postgres data consolidation and change data capture project.

Open Source Cloud Native Ingestion engine

etl engine 轻量级 跨平台 流批一体ETL引擎 数据抽取-转换-装载 ETL engine lightweight cross platform batch flow integration ETL engine data extraction transformation loading

go-pq-cdc is lightweight and efficient Change Data Capture (CDC) system designed for PostgreSQL

Near real time cloud native data pipeline in AWS (CDC+Sink). Hosts code for RedshiftSink. RDS to RedshiftSink Pipeline with masking and reloading support.

Go application to capture inserts into PostgreSQL table and produce events to Apache Kafka using replication slot and WAL

PostgreSQL Logical Replication CDC Module for Streaming Database Changes with Golang

Microservices Golang Saga Orchestration - Use Case using Transactional Outbox + Change Data Capture with Debezium

A Golang package that implements CDC chunkers with a generic interface

Postgres Logical Replication plugin for benthos

A stateless app to read events from MySQL binlog and write on Kafka using the Transactional Outbox Pattern.

Split large files into smaller ones using deterministic Content Defined Chunking

simple incremental pull of immutable large files