Senior Data Engineer
Core
Design and evolve end-to-end data pipelines streaming operational data from MySQL/PostgreSQL into Snowflake for a logistics delivery management platform.
Role type
Senior IC data engineer (streaming/ELT)
Builds
Templated CDC frameworks, stream processing pipelines, and automated ETL/ELT workflows
Domain
Logistics + Data Engineering
Required skills
CDC (Debezium), Kafka (Connect, SMT, Schema Registry), Apache Flink, Snowflake (Snowpipe, tasks, streams), Apache Airflow, SQL/RDBMS design, Python, Azure
Preferred skills
Databricks, dbt, Infrastructure as Code (Terraform/Bicep), CI/CD
Technologies
MySQL, PostgreSQL, Snowflake, Kafka, Confluent Platform, Apache Flink, Apache Airflow, Python, Microsoft Azure
Responsibilities
Design and evolve CDC pipelines using Debezium and Kafka; Extend templated pipeline frameworks for new data sources; Handle schema changes without breaking consumers; Build stream processing with Kafka Connect SMTs and Flink; Orchestrate ETL/ELT with Airflow; Automate ingestion in Snowflake; Design data archiving and reprocessing strategies; Monitor data quality and incident response; Tune cloud and Snowflake costs; Build data models for reporting; Translate business requirements into technical tasks; Document pipeline decisions.
Seniority
Senior, hands-on IC
