Staff Backend Engineer (Orchestration Platform)
Core
Designing, deploying, and operating a job scheduling and execution platform for data processing across Coupang's business domains.
Role type
Staff Backend Engineer (Orchestration Platform)
Builds
A scalable, self-service orchestration platform for managing Hive/Spark jobs and Airflow DAGs.
Domain
E-commerce / Data Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Java, Python, Kubernetes, Apache Airflow, Netflix Genie, Docker, Terraform, ArgoCD, AWS, GCP
Preferred skills
None stated
Technologies
Apache Airflow, Netflix Genie, Docker, Kubernetes, ArgoCD, Terraform, Java, Python, Hive, Spark, AWS, GCP
Responsibilities
Lead design and deployment of job scheduling and execution platform; Develop self-service tools to improve cluster efficiency and user experience; Collaborate with stakeholders and lead engineers on mission-critical projects; Participate in business and technical improvement projects from a Data Platform perspective; Research and develop latest data engineering technologies.
Seniority
Staff, hands-on IC