Senior Data Engineer
Core
Design and operate repeatable data pipelines to move varied source data into a single platform for a large-scale migration.
Role type
Senior Data Engineer (Migration)
Builds
Data ingestion and transformation pipelines for a unified platform
Domain
Cloud Data Engineering / Data Migration
Deliverable
production ML models
Required skills
SQL, Python, PySpark, dbt, Terraform, Delta Lake, Cloud Orchestration, Data Validation
Preferred skills
Azure, AWS, Google Cloud, Databricks, Infrastructure as Code
Responsibilities
Design and operate repeatable pipelines for data ingestion and transformation; Develop maintainable code using SQL, Python, PySpark and dbt; Implement automated checks for data completeness and accuracy; Monitor, diagnose and recover failed data processing; Maintain auditable records of data mappings and transformations.
Seniority
Senior, hands-on IC
