Senior Data Engineer
Core
Designing and optimizing large-scale data pipeline architecture and data flow for cross-functional teams to support product initiatives.
Role type
Senior IC data engineer (big data & ML pipelines)
Builds
Scalable data infrastructure and optimized data pipelines for product teams
Domain
Digital advertising, big data, machine learning operations
Deliverable
production ML models
Required skills
Data pipeline architecture, big data processing, data modeling, SQL, Python, Spark, Kafka, containerization, Kubernetes, ArgoCD
Preferred skills
ML/AI operations, MLFlow, Feast, Ray, OpenSearch, Druid, Clickhouse, InfluxDB
Responsibilities
Create and maintain optimal data pipeline architecture; explore and assemble large, complex data sets; identify and implement internal process improvements; build infrastructure for ETL from diverse data sources; support cross-functional teams with data infrastructure needs
Seniority
Senior, hands-on IC
