Senior Software Engineer
Core
Designing and operating scalable, multi-tenant data compute infrastructure supporting Apache Spark workloads across public and private clouds.
Role type
Senior IC distributed systems engineer (data infrastructure)
Builds
Distributed compute platforms and resource management tools for analytics
Domain
Cloud infrastructure + big data processing
Deliverable
infrastructure
Required skills
distributed systems design, resource scheduling, concurrency control, high availability, fault tolerance, system observability, cost-efficient scaling, API design, microservices architecture, unit/integration testing, security principles
Preferred skills
Apache Spark, Kubernetes, YARN, algorithmic thinking, data structures, REST/gRPC, Java/Scala/Go/C++, load balancing, technical writing
Technologies
Apache Spark, Kubernetes, YARN, REST, gRPC
Responsibilities
Design and debug distributed software systems across multiple platforms; Develop tools for resource management and scheduling; Balance system design trade-offs for resilience and observability; Support large-scale data workloads with focus on performance and cost
Seniority
Senior, hands-on IC
