Senior Software Engineer, Platform - Data + AI (Back-End)
Core
Design, develop, and maintain scalable infrastructure, data pipelines, and distributed system components for a petabyte-scale AI/ML platform.
Role type
Senior IC backend software engineer (data infrastructure & AI/ML platform)
Builds
High-performance APIs, data pipelines, distributed computing components, and ML-specific data systems (feature stores, recommendation engines)
Domain
Enterprise AI/ML, large-scale distributed systems, data infrastructure
Deliverable
production ML models
Required skills
Java/C++/C#, Python, object-oriented programming, data structures, algorithms, Git, large-scale distributed systems, public cloud platforms (AWS/Azure/GCP), distributed computing (Spark/Kafka), data analysis libraries (Pandas/Koalas)
Preferred skills
REST/GraphQL APIs, scalable data pipelines, multi-source data integration, analytics engines, distributed computation, task schedulers (Dask/Ray), workflow orchestration (DAGs), Kubernetes
Technologies
Cassandra, PostgreSQL, Snowflake, AWS S3, Azure Blobs, HDFS, Apache Spark, Ray, Pandas, Koalas, Kubernetes
Responsibilities
Design and develop infrastructure and services for petabyte-scale data pipelines; Develop high-performance APIs for AI/ML applications; Build distributed system components for stream/batch processing; Develop ML-specific data systems like feature stores; Integrate with distributed computing technologies for ML workload orchestration; Develop production AI/ML models for failure prediction and schema inferencing; Work with architects and product managers in a collaborative environment; Write clean code using test-driven methodology; Deliver commitments following agile software development methodology
Seniority
Senior, hands-on IC
