Lead Data Engineer
Core
Design, maintain, and improve data pipelines and infrastructure to power the company's data platform, enabling teams to work with data confidently and effectively.
Role type
Lead Data Engineer
Builds
Data platform pipelines and infrastructure for internal company teams
Domain
Technology / Data Engineering
Deliverable
production ML models
Required skills
Apache Airflow, Spark, Flink, Kafka, dbt Labs, Apache Iceberg, Terraform, Bash, Python, SQL, OLAP/OLTP/Document/Vector databases, Google Cloud Platform (GCP)
Preferred skills
Data security and access controls for SOX Compliant data, Elastic stack
Technologies
Apache Airflow, Spark, Iceberg, Kafka, Flink, dbt Labs, Terraform, Google Cloud Platform
Responsibilities
Design, maintain, and improve data pipelines and infrastructure; collaborate with stakeholders to define data flow and co-create data contracts; monitor and refine pipeline performance; provision and manage resources on GCP using Terraform; review code to ensure good practices; process access requests and support compliance with platform policies
Seniority
Senior, hands-on IC with leadership responsibilities