[C3F] Data Platform Engineer
Core
Build and operate change-data-capture (CDC) pipelines from PostgreSQL into Azure to support scalable, configurable screening programs for global clients.
Role type
Senior Data Platform Engineer (CDC/Streaming)
Builds
Stateful CDC pipelines, connector configurations, and automated data protection workflows for a global risk and talent screening platform.
Domain
Financial services / Risk management / Talent screening
Deliverable
production ML models | product features | infrastructure
Required skills
Kafka Connect, Debezium, PostgreSQL (WAL, logical replication), Python automation, Azure data services (Event Hubs, ADLS, Databricks), Kubernetes (AKS), Infrastructure as Code
Preferred skills
Production Debezium snapshot strategies, AKS StatefulSets, Terraform/Bicep, Databricks/ADF at scale, data masking and hashing
Responsibilities
Configure and deploy Kafka Connect connectors end-to-end; Run stateful workloads on Kubernetes; Monitor and troubleshoot pipeline failures and throughput; Automate platform onboarding and recovery workflows; Integrate CDC streams with Azure data stack; Apply data protection controls to sensitive data
Seniority
Senior, hands-on IC