Senior Data Engineer
Core
Design, build, and deploy scalable data pipelines and infrastructure to power Generative AI, personalization, recommendation systems, and revenue science applications for a news media platform.
Role type
Senior IC data engineer (AI/ML infrastructure)
Builds
Large-scale data pipelines, event-driven architectures, and cloud-based data solutions for AI and advertising insights
Domain
News media, Generative AI, Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python, PySpark, SQL, AWS Data Lakehouse (Redshift, Athena, EMR, Glue), Apache Airflow, Docker, ECS, Pub/Sub, event-driven architecture
Preferred skills
Apache Iceberg, Postgres, MySQL, DynamoDB, Tableau, Superset, Google Ad Manager data, Ad Tech vendors, Splunk, Datadog
Technologies
Python, PySpark, AWS (EC2, S3, RDS, Lambda, Batch), Apache Airflow, Docker, ECS, Redshift, Athena, EMR, Glue, Iceberg, Postgres, MySQL, DynamoDB, Tableau, Superset, Splunk, Datadog
Responsibilities
Design and deploy scalable, secure data pipelines; write maintainable code following CI/CD best practices; mentor junior engineers; collaborate with cross-functional teams to define technical solutions; manage project timelines and identify blockers; document technical specifications and share knowledge
Seniority
Senior, hands-on IC with mentorship responsibilities
