Staff Machine Learning Engineer

## Responsibilities - Shape the direction of our applied AI areas and intelligence features in our products. Drive the development and deployment of state-of-the-art AI models and systems that directly impact the capabilities and performance of Databricks' products and services (e.g., Databricks Assistant and AI/BI Genie). - Develop novel data collection, fine-tuning, and LLM technologies that achieve optimal performance on specific tasks and domains. - Design and implement ML pipelines for data preprocessing, feature engineering, model training, hyperparameter tuning, and model evaluation, enabling rapid experimentation and iteration. - Work closely with cross-functional teams, including AI researchers, ML engineers, and product teams, to deliver impactful AI solutions that enhance user productivity and satisfaction. - Build scalable, reusable backend systems to support GenAI products across the company. Develop robust logging, telemetry, and evaluation harnesses to ensure reliable model performance. ## Requirements - 2-8 years of machine learning engineering experience in high-velocity, high-growth companies. Alternatively, a strong background in relevant ML research in academia will be considered as an equivalent qualification. - Strong track record of working with language modeling technologies. This could include the following: Developing generative and embedding techniques, modern model architectures, fine tuning / pre-training datasets, and evaluation benchmarks. - Proficiency in Python, TensorFlow/PyTorch, and scalable ML architectures. - Ability to drive end-to-end model development, from research and prototyping to deployment and monitoring. - Strong analytical and problem-solving skills, with a passion for improving AI-driven user experiences. - Strong coding and software engineering skills, and familiarity with software engineering principles around testing, code reviews and deployment. ## Nice to Have - Experience with LLM fine-tuning, prompt engineering, and retrieval-augmented generation (RAG). ## Benefits At Databricks, we are building state-of-the-art AI solutions that redefine how users interact with data and our products. You’ll have the opportunity to shape the future of AI-driven products at Databricks, work with cutting-edge models, and collaborate with a world-class team of AI and ML experts. If you're excited about pushing the boundaries of AI in real-world applications, we’d love to hear from you! Please note we are open to employees working from our Mountain View, CA office for this position.