ML - Principal Software Engineer
Core
Define long-term ML infrastructure strategy, build robust ML systems with high reliability and low latency, and lead cross-org alignment for engineering, product, and research.
Role type
Principal Software Engineer (ML Infrastructure)
Builds
Robust ML systems, ML inference pipelines for LLMs, and local model integrations in system or app level components.
Domain
Machine Learning Infrastructure, LLMs, Scalable Systems
Deliverable
production ML models | infrastructure
Required skills
ML infrastructure strategy, cross-org alignment, building robust ML systems, high reliability engineering, low latency optimization, platform integration, system architecture, mentoring engineers, technical leadership, C/C++/C#/Java/JavaScript/Python
Preferred skills
ML compiler design, hardware-aware optimizations, architecting ML inference pipelines for LLMs, building local model integrations, scalable infrastructure across heterogeneous platforms
Technologies
C, C++, C#, Java, JavaScript, Python
Responsibilities
Partner with stakeholders to determine user requirements for complex scenarios, provide technical leadership for design documents, lead multiple product project and release plans, monitor system/product/service for degradation or downtime, proactively seek new knowledge to improve availability and performance, share knowledge with other engineers
Seniority
Principal, strategy & mentorship
