Data Engineer
Core
Architect, design, and develop high-performance real-time and batch data pipelines to process massive volumes of data and enable real-time insights for millions of users.
Role type
Senior IC Data Engineer (Real-time & Batch)
Builds
Scalable, reliable data pipelines and cloud-native data platforms
Domain
Ecommerce / Marketplace / Big Data
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Java, Scala, Kafka, Apache Spark, Apache Flink, Apache Airflow, dbt, AWS, Databricks, distributed systems architecture, data modeling, NoSQL, relational databases
Preferred skills
High-volume low-latency streaming platforms, reusable library architecture, performance optimization, ecommerce domain experience, Agile/Scrum
Technologies
Kafka, Flink, Spark, Databricks, Airflow, dbt, Monte Carlo, Great Expectations, AWS
Responsibilities
Design and operate robust real-time and batch data pipelines; Build and manage complex workflow orchestration; Implement automated data quality and validation frameworks; Develop scalable transformations using dbt; Drive major data engineering initiatives from architecture to production support; Identify technical risks and recommend architectural improvements; Partner with Data Science, Product, and Engineering teams to deliver solutions.
Seniority
Senior, hands-on IC
