Senior Software Engineer, Data Pipeline
Core
Develop reliable, high-throughput data pipelines processing tens of thousands of requests per second for marketing automation and client data access.
Role type
Senior Software Engineer (Data Pipeline)
Builds
Real-time data ingestion, transformation, and export services for marketing platforms.
Domain
E-commerce / Marketing Technology / Data Engineering
Deliverable
production ML models
Required skills
Python, Go, ETL pipelines, Google Cloud Platform, Kubernetes, Apache Kafka, PySpark, Apache Beam, MongoDB, Redis
Preferred skills
Experience with large-scale data ingestion, autoscaling infrastructure, on-call rotation
Technologies
Python, Go, Apache Kafka, Kubernetes, GitLab, Google Cloud Platform, DataFlow, PySpark, Apache Beam, BigQuery, BigLake, Table DataProc, Flink, Mongo, Redis
Responsibilities
Develop data pipelines processing large amounts of data reliably at high rates; Improve efficiency of workers, monitoring, and autoscaling of infrastructure; Implement integration with data storage and export data to BigQuery; Run and support services in production handling high-volume traffic; Review peer code to maintain high code quality standards.
Seniority
Senior, hands-on IC
