Senior System Software Engineer
Core
Develop open-source plugins to accelerate Apache Spark applications on GPUs without code changes, enabling C++ native execution of Spark operations on CUDA.
Role type
Senior IC systems software engineer (GPU acceleration)
Builds
Open-source libraries for GPU-accelerated data processing (RAPIDS, CCUC, UCX) and production-grade Spark acceleration
Domain
Data engineering + High-performance computing (HPC) + AI infrastructure
Deliverable
production ML models | product features
Required skills
C++, CUDA, distributed systems, data platform development, open source contribution, enterprise customer support
Preferred skills
Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, AI tools in software development
Technologies
CUDA, C++, Java, Scala, Parquet, ORC, JSON, RAPIDS, CCCL, UCX
Responsibilities
Enable C++ native execution of Spark operations on CUDA; Develop CUDA/C++ libraries to accelerate DataFrames and I/O operations; Collaborate with distributed systems teams to solve large-scale processing challenges; Work with open source communities to enhance libraries; Provide recommendations on infrastructure, CI/CD, and testing strategy; Build, test, and optimize across different platforms
Seniority
Senior, hands-on IC