Senior Data Engineer
Core
Designing and optimizing large-scale data pipeline architecture and data flow for cross-functional teams in digital advertising.
Role type
Senior IC data engineer (big data/ML pipelines)
Builds
Scalable data extraction, transformation, and loading (ETL) infrastructure
Domain
Digital advertising, big data, machine learning operations
Deliverable
production ML models
Required skills
Big data pipeline architecture, Spark, Kafka, SQL, Python, Scala, Java, containerization, Kubernetes, ArgoCD, data modeling, database technologies (OpenSearch, Druid, Clickhouse, InfluxDB)
Preferred skills
ML/AI operations, MLFlow, Feast, Ray, cross-functional data modeling
Responsibilities
Create and maintain optimal data pipeline architecture; explore and assemble large, complex data sets; identify and implement internal process improvements; build infrastructure for ETL from various data sources; support software engineers, product managers, analysts, and data scientists with data infrastructure needs.
