Staff Software Engineer, Data Platform
Core
Design and develop core data storage, streaming, caching, and indexing platforms to support large-scale LLMs and generative models.
Role type
Staff Software Engineer, Data Platform
Builds
Foundational data platforms and systems for AI model training and evaluation
Domain
Generative AI, Data Infrastructure, Cloud Systems
Deliverable
production ML models
Required skills
Large-scale data storage, streaming, and warehousing systems, Distributed systems, Cloud platforms, Database technologies, Streaming/processing solutions, Indexing/caching, Data query engines, Containerization and deployment
Preferred skills
CI/CD tooling, Performance tuning, Cost optimizations, Data lifecycle strategy, Data privacy tooling, Hyper-growth startup scaling
Technologies
MongoDB, Postgres, Kinesis, Flink, Spark, ElasticSearch, Redis, Trino, Presto, Snowflake, Kubernetes
Responsibilities
Drive architecture, design, implementation, and reliability of foundational data platforms, Collaborate with cross-functional teams to define and deliver new features, Identify opportunities for process enhancements and tool upgrades, Present technical information and provide guidance on development processes, Provide technical leadership and mentor junior engineers