Senior Software Engineer, Platform - Data + AI (Back-End)
Core
Design, develop, and maintain scalable infrastructure, data pipelines, and distributed system components for a petabyte-scale AI/ML platform serving enterprise clients.
Role type
Senior Software Engineer (Platform - Data + AI Back-End)
Builds
High-performance APIs, data pipelines, feature stores, and distributed computing integrations for enterprise AI applications.
Domain
Enterprise AI, Large-scale distributed systems, Data infrastructure
Deliverable
production ML models | infrastructure | product features
Required skills
Java/C++/C#, Python, Object-oriented programming, Data structures and algorithms, Git, Large-scale distributed systems, Public cloud platforms (AWS/Azure/GCP), Stream/batch processing, Data analysis libraries (Pandas/Koalas)
Preferred skills
REST/GraphQL APIs, Scalable data pipelines, Multi-source data integration, Analytics engines, Distributed computing frameworks (Spark/Kafka), Task schedulers (Ray/Dask), Kubernetes, DAG-based workflow optimization
Technologies
Cassandra, PostgreSQL, Snowflake, AWS S3, Azure Blobs, HDFS, Apache Spark, Ray, Pandas, Koalas
Responsibilities
Design and develop infrastructure and services to enable data pipelines for petabyte level scale; Design and develop abstractions over datastores and file systems; Develop and maintain high-performance APIs for AI/ML applications; Develop and production AI/ML models for failure prediction and schema inferencing; Work on frameworks for performance, scalability, and reliability tracking.
Seniority
Senior, hands-on IC