Principal MTS, Software Engineer
Core
Design and develop Hadoop infrastructure to serve as the backbone for eBay's mission-critical applications, ensuring reliability, scalability, and high performance for petabyte-scale data.
Role type
Principal MTS, Software Engineer (Hadoop Infrastructure)
Builds
Distributed storage (HDFS), distributed compute (Spark), distributed scheduling (Yarn/Yunikorn), and advanced data formats (Iceberg/Hudi)
Domain
Ecommerce, Big Data Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Java, Scala, Linux/Unix internals, distributed systems architecture, Hadoop ecosystem, Spark, Yarn, YuniKorn, Apache Iceberg, Apache Hudi, performance tuning, root-cause analysis
Preferred skills
Open-source project contributions, upstream community engagement
Technologies
Hadoop, Spark, HDFS, Yarn, YuniKorn, Iceberg, Hudi, Java, Scala
Responsibilities
Lead architectural enhancements across massive Hadoop and open-source data platforms; Own end-to-end technical execution of complex data processing pipelines; Design and deliver advanced internal and customer-facing tools for data access and cluster management; Champion seamless interoperability between Hadoop data layers and broader enterprise platforms
Seniority
Principal, hands-on IC with strategic leadership
