Senior Data Engineer
Core
Design and build scalable data pipelines on GCP to replace legacy ETL tools and power analytics and reporting.
Role type
Senior Data Engineer
Builds
Scalable data pipelines, core data models (Silver and Gold Layers), and CI/CD pipelines for data transformation jobs.
Domain
Cloud data engineering on Google Cloud Platform (GCP)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
GCP Data Stack (BigQuery, Cloud Composer, Cloud SQL, Dataplex), SQL (Advanced), Python, DBT, Dataform, Terraform, Docker, CI/CD (GitHub Actions), Legacy ETL migration (Oozie/Pig/Hive)
Preferred skills
None stated
Technologies
GCP, BigQuery, Cloud Composer, Cloud SQL, Dataplex, DBT, Dataform, GitHub Actions, Terraform, Docker, Oozie, Pig, Hive
Responsibilities
Design and implement GCP-based ETL/ELT pipelines; Build core data models in BigQuery; Implement data governance and quality checks; Perform large-scale historical data migrations; Develop CI/CD pipelines for data transformation jobs
Seniority
Senior, hands-on IC