Senior Data Engineer (IC5/IC4)
Core
Design, build, and evolve foundational data solutions and pipelines enabling AI/ML-powered personalization for Yahoo Mail's 220+ million users.
Role type
Senior IC Data Engineer (Cloud & Big Data)
Builds
Robust, self-healing batch and streaming data pipelines and automated data governance frameworks for petabyte-scale datasets.
Domain
Consumer Email / Big Data / Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, Java, SQL, PySpark, Java Spark, Data Orchestration (Composer/Airflow), Cloud Architecture, Data Quality Frameworks, AI Tool Integration
Preferred skills
Google Cloud Platform (GCP), DataProc, Dataflow, Looker Studio, Email Systems Experience, Master's Degree
Technologies
PySpark, Java Spark, Composer, Airflow, GCP, DataProc, Dataflow, Looker Studio
Responsibilities
Lead design and evolution of data solutions foundational to AI/ML personalization; Establish automated frameworks for data quality and compliance; Act as primary technical liaison between Dublin and US teams; Proactively integrate AI tools to automate engineering tasks; Lead continuous improvement of data workflows for cost, quality, and speed.
Seniority
Senior, hands-on IC
