Staff Software Engineer - Compiler & Spark Runtime
Core
Design and build compiler and runtime integration to translate Apache Spark workloads into efficient execution on Snowflake's cloud-native query engine.
Role type
Staff Software Engineer (Compiler & Runtime)
Builds
Production compiler infrastructure, query-plan lowering, and runtime integration for Spark workloads
Domain
Cloud Data Processing / Compiler Infrastructure
Required skills
Compiler architecture, Query processing, Systems fundamentals, Scala/Java/C++, Concurrency, Performance analysis, Technical leadership, Code review, Mentoring
Preferred skills
Apache Spark internals, Relational algebra, SQL generation, JVM performance, Differential testing, Production observability
Technologies
Apache Spark, Scala, Java, C++, Snowflake Query Engine
Responsibilities
Lead technical design of Spark query compilation and runtime integration; Own complex engineering initiatives from architecture to production rollout; Provide technical leadership and mentorship to project teams; Improve workload performance and cost-efficiency through profiling and optimization; Establish correctness and compatibility practices; Drive production quality and incident investigation; Partner with product teams to prioritize technical investments.
Seniority
Staff, hands-on IC with technical leadership