Senior System Software Engineer
Core
Develop an open source plugin to accelerate Apache Spark applications on GPUs without code changes, enabling C++ native execution of Spark operations on CUDA.
Role type
Senior Systems Software Engineer (Data Platform)
Builds
GPU-accelerated data processing libraries and plugins for Apache Spark
Domain
Data processing, Distributed systems, GPU computing
Required skills
C++, CUDA, Java, Scala, Distributed systems, Data platform development, Open source contributions
Preferred skills
Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, AI tools in software development
Responsibilities
Enable C++ native execution of Spark operations on CUDA, Develop CUDA/C++ libraries to accelerate DataFrames and I/O operations, Collaborate with distributed systems teams to solve large-scale processing challenges, Work with open source communities to enhance libraries like RAPIDS, CCCL and UCX, Build, test and optimize across different platforms
Seniority
Senior, hands-on IC
