Senior Software Engineer - Search
Core
Building and optimizing ML-based search and discovery relevance models to help users find assets (tables, notebooks, pipelines, ML models) on the Databricks platform.
Role type
Senior ML Engineer (Search Relevance)
Builds
Search ranking systems, query understanding pipelines, and automated evaluation frameworks for Databricks' data intelligence platform.
Domain
Data & AI / Search & Discovery
Deliverable
production ML models
Required skills
Search relevance systems at scale, LLM application for search, Query understanding, NLP, Text mining, Model evaluation, Computer science fundamentals
Preferred skills
Recommendations, Personalization, Conversational AI, Open-source contributions
Technologies
LLMs, NLP frameworks, Search ranking algorithms
Responsibilities
Develop and deploy ML-based search relevance models integrated with Databricks products; Design and implement automated ML and NLP pipelines for data preprocessing, query understanding, and ranking; Collaborate with product teams to drive technology-first initiatives for the search experience; Build robust frameworks for evaluating search ranking improvements offline and online.
