Senior Software Engineer Modelzoo
Core
Implement model optimizations, specifically quantization, to improve the performance of machine learning inference on specialized hardware platforms.
Role type
Senior IC machine learning software engineer (model optimization & deployment)
Builds
Optimized ML inference pipelines on proprietary and commercial accelerator hardware
Domain
Hardware-accelerated deep learning inference
Deliverable
production ML models
Required skills
deep learning frameworks (PyTorch, TensorFlow), C++, Python, model quantization (Post-Training Quantization), GPU programming (CUDA/cuDNN), ML inference engines (TensorRT, OpenVINO, TensorFlow Lite), computer architecture principles, Git
Preferred skills
hardware-aware model design, compiler technologies for deep learning, real-time/embedded systems, cloud platforms (AWS, GCP, Azure), CI/CD pipelines for ML models
Technologies
PyTorch, TensorFlow, CUDA, cuDNN, TensorRT, OpenVINO, TensorFlow Lite, Git
Responsibilities
Port and deploy deep learning models to ML accelerator hardware, analyze and improve model performance for latency and throughput, contribute to model quantization efforts, use profiling tools to identify and fix performance bottlenecks
Seniority
Mid-level, hands-on IC
