Sr. Staff Software Engineer - Managed Tables
Core
Design and implement next-gen enterprise-grade autonomous analytical datasystems for Unity Catalog ManagedTables, optimizing exabytes of data and enabling storage lifecycle management and efficient storage structures for the ML world.
Role type
Sr. Staff Software Engineer (Distributed Systems & Storage)
Builds
Predictive Optimization, Liquid Clustering, control plane services, and Data Intelligence offerings for Unity Catalog and Iceberg Rest Catalog.
Domain
Data & AI Infrastructure, Distributed Systems, Storage Systems
Deliverable
production ML models | product features | infrastructure
Required skills
Large-scale distributed systems, database systems, storage systems, language design, performance optimization, algorithms and data structures, architecture design, automation and operability
Preferred skills
Multi-year vision planning, cross-team collaboration, mentoring engineers
Technologies
Unity Catalog, Iceberg, Apache Spark, Delta Lake
Responsibilities
Design and implement scalable, available, and interoperable architecture for Managed Tables; perform low-level systems debugging and performance optimization on large production clusters; build architecture design and influence product roadmap; introduce tools for service automation; prevent and investigate production issues; plan and lead complicated technical projects; mentor and up-level engineers.
Seniority
Sr. Staff, hands-on IC with mentorship
