SR ENGINEER, DATA,SMAI
Core
Design and implement scalable, reliable data architectures and end-to-end ETL/ELT pipelines on Google Cloud Platform.
Role type
Senior Data Engineer (Cloud Infrastructure)
Builds
Production data pipelines, data warehouses, and data lakes for Micron's data economy.
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, PySpark, BigQuery, GCP services (Dataproc, Cloud Functions, Pub/Sub), Terraform, CI/CD, Data Modeling, ETL/ELT, Data Migration, Query Optimization, Data Governance
Preferred skills
Vertex AI, Kafka, Streaming frameworks, Data Warehousing concepts
Technologies
Google Cloud Platform, BigQuery, GCS, Dataproc, Cloud Run, Cloud Functions, Pub/Sub, Cloud Composer, Cloud Build, Terraform, Kafka
Responsibilities
Design and implement scalable data architectures on GCP; Build and maintain end-to-end ETL/ELT pipelines; Develop batch and real-time data processing pipelines; Implement CI/CD pipelines for data workflows; Design and execute data migration strategies from on-prem to GCP; Optimize BigQuery queries and pipeline performance; Work closely with Data Scientists, Data Analysts, and Product teams to translate business requirements into technical solutions.