CareerPlanGet AI match score →

Staff Software Engineer, Metrics and Logging

Mountain View, California💼 Full-time💰 $190,000–$190,000🗓 2026-04-09 → 2026-07-31

Core

Designing and scaling the next-generation logging platform to process petabytes of logs daily, enabling deep system insights and efficient troubleshooting across Databricks services.

Role type

Staff Software Engineer (Infrastructure/Logging)

Builds

Scalable, low-latency log delivery pipelines and observability tools for a global data and AI infrastructure platform.

Domain

Cloud infrastructure, distributed systems, observability, data engineering.

Deliverable

production ML models | infrastructure

Required skills

Scala, Rust, Go, Python, Java, C++, large-scale distributed systems, log collection, health monitoring, observability tools, complex project leadership, cross-team collaboration.

Preferred skills

Structured logging best practices, cost-efficiency optimization, retention and indexing strategies.

Technologies

Apache Spark, Delta Lake, MLflow, petabyte-scale data processing.

Responsibilities

Design and scale the next-generation logging platform; develop and optimize log delivery pipelines for high-throughput ingestion; enhance log accessibility and usability tools; define best practices for structured logging; improve reliability and cost-efficiency of log retention and querying; mentor engineers and foster technical excellence.

Seniority

Staff, hands-on IC with strategic impact and mentorship.

Rewrite
## Responsibilities - Build the future of logging at Databricks by designing and scaling our next-generation logging platform that processes petabytes of logs daily. - Develop and optimize log delivery pipelines to support low-latency, high-throughput log ingestion and querying, ensuring seamless observability across all Databricks services. - Enhance log accessibility and usability, developing tools that enable engineers to efficiently search, analyze, and derive insights from logs. - Collaborate with teams across Databricks to define best practices for structured logging, standardizing formats and improving the developer experience. - Improve reliability and cost-efficiency by optimizing log retention, indexing, and query performance to reduce operational overhead. - Mentor and uplevel engineers, fostering a culture of technical excellence within the team and broader observability community. ## Requirements - BS (or higher) in Computer Science, or a related field. - 7+ years of production-level experience in one of: Scala, Rust, Go, Python, Java, C++, or similar languages. - Deep experience in software development, in large-scale distributed systems. - Experience driving complex projects involving multiple teams and stakeholders. - Familiarity with log collection, health monitoring, and observability tools. ## Nice to Have - N/A ## Benefits - Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page [here](https://www.databricks.com/sites/default/files/2024-08/us-pay-zone-mapping.pdf).
Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Greenhouse ↗