Senior Data Scheduling Infra Developer
Core
Design, develop, and operate a high-performance job scheduling and execution engine built on Apache Airflow to improve availability, security, and orchestration across large-scale data and AI workflows.
Role type
Senior IC data infrastructure developer (Airflow)
Builds
Scalable job scheduling and execution engine for eBay's Unified Data Platform
Domain
Ecommerce data infrastructure & workflow orchestration
Deliverable
production ML models | infrastructure
Required skills
Python, Apache Airflow (DAGs, Operators), cloud platforms, containerization (Docker, Kubernetes), CI/CD, AI coding agents
Preferred skills
Apache Airflow source code customization, open-source contribution, big data technologies (Hadoop, Spark, Kafka, Flink)
Technologies
Apache Airflow, Python, Docker, Kubernetes, CI/CD tools, Hadoop, Spark, Kafka, Flink, Claude Code, Codex
Responsibilities
Analyze and customize Apache Airflow source code to develop new features; Implement best practices for Airflow architecture including security and scalability; Develop and optimize complex Airflow DAGs and Operators; Collaborate with the Airflow community by contributing patches and enhancements; Use AI coding agents to build production-grade software and improve engineering velocity.
Seniority
Senior, hands-on IC