Sr. Staff Software Engineer - Managed Tables
Core
Design and implement next-gen autonomous analytical datasystems for enterprise-grade Managed Tables, optimizing exabytes of data and enabling storage lifecycle management and layout solutions for the ML world.
Role type
Sr. Staff Software Engineer (Distributed Systems & Storage)
Builds
Unity Catalog ManagedTables offering, including Predictive Optimization, Liquid Clustering, and control plane services
Domain
Data Intelligence, Distributed Systems, Storage Systems
Deliverable
production ML models | infrastructure
Required skills
large-scale distributed systems, database systems, storage systems, language design, performance optimization, algorithms and data structures, architecture design, product roadmap influence, automation and operability, production debugging
Preferred skills
multi-year vision planning, customer value delivery, cross-team collaboration, mentorship
Technologies
Unity Catalog, Iceberg Rest Catalog API, Apache Spark, Delta Lake
Responsibilities
Design and implement scalable, available, and interoperable architecture for Managed Tables; optimize storage lifecycle and background performance; debug and optimize large production clusters; lead complicated technical projects across multiple teams; mentor and up-level engineers
Seniority
Sr. Staff, hands-on IC with strategy & mentorship
