Principal Systems Software Engineer
Core
Develop GPU-accelerated libraries for Apache Spark to enable code-free acceleration of large-scale data processing workloads across cloud and on-premise environments.
Role type
Principal Systems Software Engineer (Distributed Systems & GPU)
Builds
Open-source libraries (cuDF, CCCL, UCX) and production-grade Spark acceleration plugins for AWS, Databricks, Google Cloud, and others.
Domain
Data Engineering, Distributed Systems, GPU Computing
Deliverable
production ML models | product features
Required skills
C++, Java, Scala, CUDA, distributed systems design, open source ecosystem knowledge (Apache Spark, Apache Iceberg, Delta Lake, Apache Arrow)
Preferred skills
Database query optimization, meaningful OSS community contributions
Technologies
CUDA, C++, Java, Scala, Apache Spark, cuDF, CCCL, UCX, Apache Iceberg, Delta Lake, Unity Catalog, Parquet, ORC, JSON
Responsibilities
Develop Java, Scala, and CUDA/C++ libraries to accelerate DataFrames and I/O operations; Enable interoperability with table formats and metastores; Collaborate with distributed systems teams on large-scale processing challenges; Build, test, and optimize CUDA/C++ libraries across platforms.
Seniority
Principal, hands-on IC with strategy & mentorship
