Machine Learning/ Search Engineer - Services Special Projects
Core
Designing and optimizing large-scale, real-time search systems at the intersection of Generative AI and Information Retrieval to serve millions of users.
Role type
Senior IC Search Systems Engineer (Generative AI & IR)
Builds
Intelligent search systems merging keyword and vector-based semantic search
Domain
Search infrastructure, Information Retrieval, Generative AI
Deliverable
production ML models
Required skills
Large-scale search system design, Multi-stage ranking algorithms, NLP pipelines (intent classification, entity extraction), Vector search (embeddings, FAISS), Deep learning architectures (Transformers, Cross Encoders, GNNs), Real-time system optimization, Model tuning (quantization, batching), Cloud environments (AWS), Containerization (Docker, Kubernetes), Data processing (Spark, Flink), Streaming (Kafka), Search engines (OpenSearch, Elasticsearch), LLM serving (vLLM, SGLang, Triton, TorchServe)
Preferred skills
Graph databases (TigerGraph), Data/model versioning (DVC, MLflow, Weights & Biases), KV Stores (SSTables, Cassandra), Inference runtimes (ONNX Runtime, TensorRT)
Technologies
PyTorch, XGBoost, Go, Java, C++, Python, FAISS, Kafka, Spark, Flink, OpenSearch, Elasticsearch, AWS, Docker, Kubernetes, vLLM, SGLang, Triton, TorchServe, ONNX Runtime, TensorRT
Responsibilities
Design and implement machine learning models (Learning to Rank, Cross Encoder) and multi-stage reranking algorithms; Develop and optimize ranking, relevance, and retrieval through ML/AI models; Build offline and online evaluation metrics, A/B testing frameworks, and continuous improvement strategies for search quality; Merge traditional keyword search with vector-based semantic search using embedding models and vector databases; Design and maintain large-scale, low-latency, high-performance search systems; Partner with Research Scientists, Product, Data Engineering, MLOps, Search Infrastructure teams, and UX to align search features with business and user goals.
Seniority
Senior, hands-on IC
