Senior Data Engineer - Consumer Data Platform
Core
Design, develop, and maintain scalable data platforms and backend systems on Google Cloud to support multi-billion-dollar projects and drive business outcomes.
Role type
Senior Data & Backend Engineer
Builds
Data platforms, backend applications, data pipelines, data warehouses/lakes, and BI reports
Domain
Consumer goods, cloud data engineering, big data analytics
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
PySpark, Python, SQL, Google Cloud Platform (GCP), Cloud Composer, Airflow, Spark, Terraform, Github, data modeling, dimensional modeling, data governance, GDPR/CCPA compliance
Preferred skills
Microsoft Azure Cloud, Looker Studio, Databricks, DevOps tools, CICD tools
Technologies
Google Cloud (Spanner, Cloud Composer, Looker Studio, Big Query, Cloud SQL), PySpark, Python, SQL, Terraform, Github, Azure, Databricks
Responsibilities
Design and develop robust backend systems and APIs; build and maintain data ingestion pipelines; implement data transformation and cleansing processes; develop data models and schemas; build data warehouses and lakes; integrate data from on-premises and cloud sources; implement data governance and security practices; optimize pipeline performance; monitor and troubleshoot data issues; build BI reports and dashboards; document data engineering processes
Seniority
Senior, hands-on IC with mentorship responsibilities