Lead Product Software Engineer - Data Systems
Core
Designing and building scalable distributed systems, data platforms, and infrastructure to power real-time personalization and recommendation services for ESPN's media business.
Role type
Lead Product Software Engineer (Data Systems)
Builds
Foundational data platforms, APIs, and infrastructure for real-time personalization and recommendation services.
Domain
Sports media streaming, real-time data processing, personalization
Deliverable
production ML models | product features | infrastructure
Required skills
Distributed data processing (Spark, Flink, Beam, Kafka Streams), Real-time streaming pipelines, SQL and schema design, Cloud data platforms (AWS), ML workflow support, Data quality frameworks, Python/Java/Scala
Preferred skills
Personalization/recommendation system infrastructure, MLOps tools (MLflow, TFX, Kubeflow), Data validation/lineage tools, Real-time ML serving architectures, 0→1 product development
Technologies
Spark, Flink, Beam, Kafka Streams, AWS, Databricks, Snowflake, Apache Airflow, Python, Java, Scala, MLflow, TFX, Kubeflow, dbt, Kubernetes
Responsibilities
Design and operate scalable software systems for content discovery and personalization; Develop distributed data processing platforms; Build foundational platform capabilities including feature serving and model inference integration; Design reliable APIs for personalization; Lead architecture for high-availability, low-latency systems; Partner with ML and Product teams to translate objectives into solutions; Establish engineering standards and observability; Drive technical strategy for next-gen platforms; Mentor engineers and influence practices.
Seniority
Senior, hands-on IC with leadership responsibilities
