Software Engineer, Ingestion Platform
Core
Build and maintain scalable, fault-tolerant data infrastructure to ingest 100B+ daily events and enable batch/streaming ML and BI workloads for Reddit's business teams.
Role type
Senior IC software engineer (data platform)
Builds
Data Movement Platform for batch and stream data processing
Domain
Internet / Big Data Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, Scala, Go, Java, Spark, Flink, Airflow, Kubernetes, CI/CD, cloud services
Preferred skills
Open source contributions, self-service system design, proactive leadership
Technologies
Spark, Flink, Airflow, Kubernetes
Responsibilities
Refine data infrastructure technologies for ML/analytics workflows; Own the Data Movement Platform; Build automated solutions for data users; Collaborate on on-call and monitoring/alerting
Seniority
Senior, hands-on IC
Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.