Senior Data Engineer
Core
Senior Data Engineer migrating a data lakehouse architecture to a dbt and BigQuery model on GCP, evolving pipelines and ensuring data quality, governance, and performance.
Role type
Senior hands-on IC data engineer
Builds
Data pipelines, dbt models, and distributed processing jobs for the company's data ecosystem
Domain
Cloud data engineering (GCP)
Deliverable
production ML models | product features
Required skills
GCP (BigQuery, Cloud Storage, Dataproc), dbt, Python, Apache Spark, Apache Iceberg, Cloud Composer (Airflow), Kubernetes, Git, CI/CD
Preferred skills
Data architecture migration experience, GCP certifications, data observability, Terraform/IaC
Technologies
GCP, BigQuery, dbt, Spark, Iceberg, Airflow, Kubernetes, Python
Responsibilities
Develop and optimize data pipelines in a lakehouse environment; Migrate existing workloads to dbt + BigQuery including modeling and testing; Build and maintain distributed processing jobs with Spark; Work with Iceberg tables for versioning and performance; Write Python code for orchestration and automation; Orchestrate pipelines using Cloud Composer; Collaborate with data, product, and engineering teams; Support technical decisions on data architecture including containerization.
Seniority
Senior, hands-on IC
