Senior Data Engineer
Core
Designing and optimizing large-scale data pipeline architecture and data flow for an advertising platform serving publishers and brands.
Role type
Senior IC data engineer (big data & ML infrastructure)
Builds
Scalable data pipelines and infrastructure for ad transaction processing and analytics
Domain
Digital advertising, big data, machine learning operations
Deliverable
production ML models | infrastructure
Required skills
Data pipeline architecture, big data processing, SQL, Python, Spark, Kafka, data modeling, database technologies (OpenSearch, Druid, Clickhouse, InfluxDB), containerization, Kubernetes, ArgoCD
Preferred skills
ML/AI operations, MLFlow, Feast, Ray, cross-functional data modeling
Responsibilities
Create and maintain optimal data pipeline architecture; explore and assemble large, complex data sets; identify and implement internal process improvements for automation and scalability; build infrastructure for ETL from diverse data sources; support cross-functional teams with data infrastructure needs.
Seniority
Senior, hands-on IC
