Senior Data Engineer, AI Systems
Core
Building and scaling Spark-based data pipelines and infrastructure to power AI-driven marketing personalization for global brands.
Role type
Senior Data Engineer (AI Systems)
Builds
Production data pipelines, ML Data Lake, and data products for the DaVinci Personalization platform.
Domain
Marketing technology / AI-driven content personalization
Deliverable
production ML models
Required skills
Apache Spark (PySpark), Python, GCP Dataproc, Kafka, Parquet, Delta Lake, cloud computing, advanced query optimization, CI/CD (Docker, Kubernetes, GitHub Actions)
Preferred skills
None stated
Technologies
Apache Spark, GCP Dataproc, Kafka, Parquet, Delta Lake, Docker, Kubernetes, GitHub Actions
Responsibilities
Build and optimize production data pipelines for AI personalization; manage Spark cluster configuration and tuning; maintain the ML Data Lake; support ML engineers with data needs; resolve performance bottlenecks; collaborate on platform architecture; release data products.
Seniority
Senior, hands-on IC