Big Data Platform & Distributed Systems (Mid/Senior/Lead/Principal)
Core
Design, build, and operate large-scale distributed data platforms and observability systems powering AI-driven intelligence and Spark workloads.
Role type
Senior IC distributed systems engineer (big data platform)
Builds
High-throughput data pipelines, telemetry/observability systems, and scalable Spark compute infrastructure for AI agents.
Domain
Cloud-native big data, distributed systems, AI infrastructure
Deliverable
production ML models | infrastructure
Required skills
distributed systems design, large-scale data pipeline architecture, Spark optimization, observability system design, cloud infrastructure operations, AI tool integration, code quality review
Preferred skills
advanced prompt engineering, AI-first development workflows, system context management for AI reliability
Technologies
Spark, Flink, Kafka, Trino, HBase, Kubernetes, AWS, GCP, Java
Responsibilities
Design and orchestrate complex systems where AI agents integrate into human workflows; build and maintain shared system context repositories for AI; critically evaluate human and AI-generated code for security and performance; operate enterprise-scale data platforms and monitoring services.
Seniority
Senior, hands-on IC
