Software Engineer II - AI Engineering
Core
Design, build, and ship scalable backend services and LLM-enabled capabilities (prompting, RAG, orchestration) for Fabric Data Engineering and Data Science experiences.
Role type
Software Engineer II (AI Engineering)
Builds
Scalable backend services, libraries, data pipelines, and distributed compute solutions for model/data workflows.
Domain
Data Engineering and AI/LLM Systems
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Apache Spark/PySpark, LLM systems (prompting, RAG, tool/function calling, agent orchestration), cloud-native engineering, data pipeline design, evaluation strategies, telemetry/monitoring, Responsible AI practices
Preferred skills
Azure cloud platform, A/B experimentation, cost/latency optimization
Technologies
Python, Apache Spark, PySpark, Azure
Responsibilities
Design and build scalable backend services and libraries; Develop LLM-enabled capabilities with attention to latency and reliability; Build robust data pipelines and distributed compute solutions; Define evaluation strategies for LLM features; Apply Responsible AI and security/privacy best practices; Maintain and operate services in production; Review code and mentor peers
Seniority
Mid-level IC (2+ years experience) to Senior IC (3+ years experience or Master's degree)
