Senior Data Engineer (IC5/IC4)
Core
Design, build, and evolve data solutions and pipelines foundational to AI/ML-powered personalization for Yahoo Mail, serving 220+ million monthly active users.
Role type
Senior IC Data Engineer (Cloud & Big Data)
Builds
Robust, self-healing batch and streaming data pipelines and automated data governance frameworks for petabyte-scale datasets.
Domain
Consumer Email / Big Data / AI/ML Infrastructure
Deliverable
production ML models
Required skills
Python, Java, SQL, PySpark, Java Spark, Data Orchestration (Airflow/Composer), Cloud Architecture, Data Quality Frameworks, AI Coding Assistants, LLMs
Preferred skills
Hadoop, Google Cloud Platform (GCP), DataProc, Dataflow, Looker Studio, Email Systems experience, Master's degree
Technologies
PySpark, Java Spark, Airflow, Composer, GCP, Hadoop, DataProc, Dataflow, Looker Studio
Responsibilities
Lead design and build of data pipelines for AI/ML personalization; Establish automated data quality and compliance frameworks; Act as primary technical liaison between Dublin and US teams; Integrate AI tools to automate engineering tasks; Optimize data workflows for cost, quality, and speed.
Seniority
Senior, hands-on IC
