Senior Staff Engineer, Big Data Infrastructure
Core
Technical leader for Big Data Infrastructure, guiding a 40+ person team to scale foundational data systems and build invisible infrastructure for AI agents.
Role type
Senior Staff IC distributed systems engineer (big data infrastructure)
Builds
Distributed data platforms (Airflow, Spark, Iceberg, S3, Azure Blob Storage) serving 2,000+ engineers and 600+ teams
Domain
Financial technology + Big Data Infrastructure
Deliverable
production ML models
Required skills
Distributed systems architecture, Kubernetes, Spark, Airflow, Data Lake management, Cloud migration (AWS/Azure), Operational excellence, Team leadership
Preferred skills
AI/ML infrastructure, Agentic workflows, Database internals, Multi-cloud strategy
Technologies
Airflow, Spark, Iceberg, Hive, S3, Azure Blob Storage, YARN, Kubernetes, Gluten, Velox
Responsibilities
Lead cross-team system migrations (YARN to K8s), Design multi-region/multi-cloud data strategy, Reduce operational overhead via platform automation, Mentor Staff+ engineers
Seniority
Senior Staff, hands-on IC with mentorship
