Software Engineer, Ingestion Platform
Core
Refine and maintain data infrastructure supporting ML and analytics workflows, owning the Data Movement Platform for batch and streaming data processing.
Role type
Senior IC software engineer (data infrastructure)
Builds
Scalable, fault-tolerant data movement and processing systems
Domain
Data engineering / Cloud infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, Scala, Go, Java, Spark, Flink, Airflow, Kubernetes, cloud services, large-scale system design, automated self-service solutions
Preferred skills
Open source contribution, proactive leadership across diverse projects
Technologies
Spark, Flink, Airflow, Kubernetes
Responsibilities
Refine and maintain data infrastructure supporting ML and analytics workflows; Own and improve the Data Movement Platform for batch and streaming data processing; Build infrastructure for Spark, Flink, and Airflow; Develop automated, declarative, self-service solutions for data users; Share on-call responsibilities and support monitoring and alerting to improve reliability, scalability, latency, and efficiency; Collaborate with teammates and partner teams to build scalable, fault-tolerant systems
Seniority
Senior, hands-on IC
