Sr. Data Engineer
Core
Architect, design, and develop scalable real-time and batch data pipelines to power personalized experiences for millions of users.
Role type
Senior Data Engineer
Builds
Cloud-native data solutions, real-time and batch data pipelines, data quality frameworks
Domain
E-commerce, Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, Java, Scala, Kafka, Spark, Flink, Airflow, Databricks, AWS, DBT, Monte Carlo, Great Expectations
Preferred skills
Agile/Scrum, e-commerce domain knowledge, library architecture, MVC design
Technologies
Kafka, Spark, Flink, Airflow, Databricks, AWS, DBT, Monte Carlo, Great Expectations
Responsibilities
Design and develop robust real-time and batch data pipelines; Build and manage complex workflow orchestrations; Implement automated data quality frameworks; Leverage Databricks and AWS to build cloud-native solutions; Own major data engineering projects from design to deployment; Identify technical risks and propose architectural improvements
Seniority
Senior, hands-on IC
