CareerPlanGet AI match score →

Software Engineer II - Azure AI Services

Germany, Multiple Locations, Multiple Locations💼 Full-time💰 $71,700–$121,100🗓 2026-07-16 → 2026-07-31

Core

Design and build scalable, reliable cloud architectures and APIs for AI systems, including inference engines and services.

Role type

Senior IC Software Engineer (Cloud/AI)

Builds

Scalable cloud services, inference engines, and production APIs for AI systems

Domain

Cloud infrastructure and AI/ML platforms

Deliverable

production ML models | product features | infrastructure

Required skills

Distributed systems design, scalable cloud architecture, production API development, debugging large codebases, DevOps operations, cross-team collaboration, technical decision making, rapid iteration, end-to-end solution delivery, autonomous execution

Preferred skills

AI/ML fundamentals, AI-native engineering practices, code generation workflows, test automation, OpenAI/Azure OpenAI API experience

Technologies

Kubernetes, Docker, Azure DevOps, gRPC, FastAPI, Python, C++, C#, Rust, Semantic Kernel, AutoGen, LangChain

Responsibilities

Design and implement scalable cloud architectures for AI systems; debug and optimize large codebases; operate global cloud services and mitigate issues; collaborate with internal teams and external partners to deliver integrated solutions; identify and execute innovative technical approaches; articulate complex concepts and build consensus

Seniority

Senior, hands-on IC

Rewrite
## About the role * Architect and Implement Cloud Services for AI: design and build scalable, reliable architectures that meet high-performance requirements for AI systems, including inference engine, services, and APIs. Apply deep knowledge of distributed systems principles to create robust solutions. * Debug and Optimize Across the Stack: dive deep into large existing codebases to identify and resolve issues quickly. Ensure fast turnaround for critical fixes while maintaining system integrity. * Operate global cloud services: be part of the DevOps team responsible for operating our cloud services. Work on diagnosing and mitigating any issues together with partner teams. * Collaborate Across Teams and Partners: work closely with multiple internal teams and external partners to solve complex problems, align on technical decisions, and deliver integrated solutions. * Innovate and Drive Technical Excellence: identify non-obvious technical approaches that unlock new possibilities. Architect and execute features with measurable goals, iterating rapidly to achieve outcomes. * Full-Stack Ownership: engage with components across the entire stack—from infrastructure to APIs—to deliver end-to-end solutions. * Leadership and Influence: Articulate complex concepts clearly, build consensus, and create systems that accelerate team velocity. Demonstrate exceptional judgment and autonomy in execution. ## Requirements * Bachelor's Degree in Computer Science or related technical field AND technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. * Master's Degree in Computer Science or related technical field AND technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. * Experience designing and operating distributed systems, scalable cloud architectures, and production APIs. * Understanding of ML/AI fundamentals, with experience applying them to practical product or platform scenarios. * Familiarity with relevant technologies such as Kubernetes, Docker, Azure DevOps, gRPC, and FastAPI; programming languages such as Python, C++, C#, and Rust; and AI/ML or agent-development frameworks such as Semantic Kernel, AutoGen, and LangChain. * Experience in AI-native engineering practices, with hands-on experience applying AI to develop software solutions across the development lifecycle, including code generation, test automation, and related workflows. * Optional experience with OpenAI API / Azure OpenAI. ## What we offer * Software Engineering IC3 - The typical base pay range for this role across Germany is € 71,700.00 - € 121,100.00 per year. * Certain roles may be eligible for benefits and other compensation. ## About us * (No content provided in the original text)
Sourced via microsoft · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply at Microsoft ↗