Staff/Sr. Software Engineer, Search Data Infrastructure - Slack
Core
Design, develop, and maintain scalable offline indexing pipelines and distributed search infrastructure for Slack Search, enabling instant retrieval of messages, channels, and files for millions of users.
Role type
Staff/Senior Software Engineer, Search Data Infrastructure
Builds
Scalable, resilient offline indexing pipelines and distributed search systems for Slack
Domain
Enterprise collaboration software, Search infrastructure, Generative AI
Deliverable
production ML models | product features | infrastructure
Required skills
Distributed data processing (Spark, Hadoop, MapReduce), Search technologies (Solr, Elasticsearch, Lucene), Infrastructure tooling (Terraform, Kubernetes), Functional/Imperative programming (Java, Go, Python, C), High-availability system design, Software migration planning
Preferred skills
Large-scale data pipeline construction, Text mining and NLP techniques, Search relevance tuning and ranking models
Technologies
Java, Go, PHP/Hack, Python, MySQL, Solr, Kubernetes, Terraform, AWS, Linux, Spark, Hadoop, MapReduce, EMR
Responsibilities
Design and develop scalable offline indexing pipelines; Partner with product engineering to ship new features; Ensure high availability across distributed search systems; Deploy, configure, test, troubleshoot, and upgrade Solr clusters; Optimize Solr cluster infrastructure for performance; Conduct code reviews and champion engineering standards; Build production-grade software leveraging AI tools; Design systems where AI agents integrate into workflows; Evaluate code for correctness, quality, security, and performance
Seniority
Staff/Senior, hands-on IC with architectural influence
