Senior System Software Engineer
Core
Developing an open source plugin to accelerate Apache Spark applications on GPUs without code changes, enabling C++ native execution of Spark operations on CUDA.
Role type
Senior IC systems software engineer (GPU acceleration)
Builds
CUDA/C++ libraries for accelerating DataFrames and I/O operations on file formats like Parquet, ORC, and JSON
Domain
Data processing, distributed systems, GPU computing
Deliverable
production ML models
Required skills
C++, CUDA, Java, Scala, distributed systems, open source ecosystem, enterprise customer support, AI tools in development
Preferred skills
Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion
Technologies
CUDA, C++, Java, Scala, Parquet, ORC, JSON, RAPIDS, CCCL, UCX
Responsibilities
Enable C++ native execution of Spark operations on CUDA; Develop CUDA/C++ libraries to accelerate DataFrames and I/O operations; Collaborate with distributed systems teams to solve large-scale processing challenges; Work with open source communities to enhance libraries like RAPIDS, CCCL, and UCX; Build, test, and optimize across different platforms
Seniority
Senior, hands-on IC
