Lead Data Engineer
Core
Design, build, and optimize scalable cloud data platforms and analytics pipelines.
Role type
Lead Data Engineer
Builds
Cloud data platforms, analytics pipelines, and data warehouse solutions
Domain
Cloud Data Engineering / Data Warehousing
Deliverable
production ML models
Required skills
Amazon Redshift, Fivetran, Databricks, Apache Spark, Delta Lake, dbt, SQL, Python, Git, CI/CD
Preferred skills
AWS services (S3, IAM, Glue, Lambda, CloudWatch), data cataloging, Apache Airflow, AWS/Databricks/dbt certifications
Technologies
Amazon Redshift, Fivetran, Databricks, Spark, Delta Lake, dbt, Python, AWS, Git, Airflow
Responsibilities
Design and maintain batch and streaming data pipelines; Build and optimize Amazon Redshift data warehouse solutions; Configure and manage Fivetran connectors; Develop scalable data processing workflows in Databricks; Create modular transformation models using dbt; Implement data quality checks and governance controls; Partner with stakeholders to translate requirements into data products; Troubleshoot pipeline failures and improve platform reliability.
Seniority
Lead, hands-on IC with mentorship