Software Engineer - Data Movement Platform
Core
Building and maintaining scalable, fault-tolerant, self-serve data infrastructure to support batch and streaming ML and BI workloads for Reddit's business teams.
Role type
Senior IC software engineer (data platform)
Builds
The Data Movement Platform enabling efficient data processing and orchestration for ads, feed generation, and ML experimentation.
Domain
Internet / Big Data Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, Scala, Go, Java, large-scale system design, cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink
Preferred skills
Open source contribution, proactive leadership, self-starter mindset
Technologies
Spark, Flink, Airflow, Kubernetes, CI/CD
Responsibilities
Refine and maintain data infrastructure technologies to support ML and analytics workflows; Own the Data Movement Platform for batch and stream data processing; Build new infrastructure for Spark, Flink, and Airflow; Develop automated solutions for a declarative, self-service data experience; Collaborate on on-call duties and monitoring/alerting to improve platform reliability and efficiency.
