Senior Software Engineer - Clickpipes (CDC/Streaming)
Core
Building high-throughput database integrations (CDC/Streaming) to replicate data from various sources into ClickHouse at petabyte scale.
Role type
Senior Software Engineer (Distributed Systems/Database Integrations)
Builds
Real-time data replication platform (ClickPipes/PeerDB) for databases, data lakes, and warehouses.
Domain
Data Engineering / Distributed Systems / Cloud-Native
Deliverable
production ML models | product features | infrastructure
Required skills
Go, systems programming, Kubernetes, cloud-native architecture (AWS/GCP/Azure), production debugging, distributed systems design
Preferred skills
CDC/replication technologies, durable execution frameworks (Temporal), data formats (Avro/Parquet/Protobuf), modern data processing (Kafka/Spark/Flink), open-source contribution
Technologies
Go, Kubernetes, AWS, GCP, Azure, ClickHouse, PeerDB, Postgres, MySQL, MongoDB, Iceberg, Delta Lake, BigQuery, Snowflake, Kafka, Spark, Flink, Temporal, Avro, Parquet, Protobuf
Responsibilities
Design and develop high-throughput integrations with databases and data warehouses; handle edge cases in production scenarios (upgrades, failovers, large transactions); debug complex production issues using runtime diagnostics and observability tools; build infrastructure and tools to increase system reliability; write technical documentation; participate in on-call rotation.
Seniority
Senior, hands-on IC
