Senior Software Engineer, Data Pipeline
Core
Develop reliable, high-throughput data pipelines processing tens of thousands of requests per second for a global personalization platform.
Role type
Senior Software Engineer (Data Pipeline)
Builds
Real-time data ingestion, transformation, and export services for marketing automation and analytics.
Domain
SaaS / Personalization / Data Engineering
Deliverable
production ML models
Required skills
Python, Go, ETL pipelines, high-volume data processing, cloud infrastructure management, code review
Preferred skills
Kubernetes, Google Cloud Platform, PySpark, Apache Beam, Apache Kafka, MongoDB, Redis
Technologies
Python, Go, Apache Kafka, Kubernetes, GitLab, Google Cloud Platform, DataFlow, PySpark, Apache Beam, BigQuery, BigLake Table, DataProc, Flink, Mongo, Redis
Responsibilities
Develop data pipelines for real-time tracking and analysis; improve infrastructure efficiency, monitoring, and autoscaling; implement data imports and integrations; export data to BigQuery; run and support production services; participate in code reviews and on-call rotation.
Seniority
Senior, hands-on IC
