Director, Data Engineer
Core
Lead a small team of Data Engineers to build and manage analytics and production data ETL/ELT systems for high-volume data ingestion, ensuring data quality and reliability for the Search and Discovery team.
Role type
Senior IC Data Engineering Manager (Search & Discovery)
Builds
Production data ETL/ELT systems, datasets for search model optimization, and logging/implementation pipelines for Search data.
Domain
E-commerce, Search, Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Data modeling, ETL, Python, SQL, distributed processing frameworks (Spark, HDFS, S3), ETL schedulers (Airflow, Dagster, DBT), team leadership, SLA management, system optimization for performance and cost.
Preferred skills
Experimentation and statistics, ML concepts and model configuration impact, massive dataset optimization, e-commerce and search domain expertise.
Technologies
Spark, HDFS, S3, Airflow, Dagster, DBT, Python, SQL
Responsibilities
Lead a small team of Data Engineers to ideate, build, and manage analytics and production data ETL/ELT systems for high-volume data ingestion from diverse sources; Analyze customer interactions with search results to determine improvements to customer experience and business performance; Lead experiment ideation, design, measurement, and interpretation; Partner with Data Science, Engineering, and Product to enable reliable, accurate logging/implementation and usage of Search data; Ensure data quality, observability, and reliability across the data lifecycle; Optimize systems for performance, cost efficiency, and scalability.
Seniority
Senior, hands-on IC with people management
