Sr Staff Software Engineer- Data Platform
Core
Architect and build the core data infrastructure (Data Lakehouse) serving the entire enterprise, enabling hundreds of engineers to move faster via high-performance engines and self-service frameworks.
Role type
Sr Staff Software Engineer (Data Platform)
Builds
Internal SDKs, CLI tools, automated orchestration frameworks, and the Data Lakehouse platform.
Domain
Enterprise Data Engineering / Distributed Systems
Deliverable
production ML models | infrastructure
Required skills
System architecture, Java/J2EE ecosystem, Python, Apache Iceberg/Hudi/Delta Lake, Spark, AWS (S3, EMR, Kubernetes, Lambda), Azure, Terraform, CI/CD automation, Vector databases
Preferred skills
Open-source data project contributions, AI Code Gen platforms, LLM-Ops, AI Agent infrastructure
Technologies
Apache Iceberg, Snowflake Horizon, Databricks Unity Catalog, Spark, dbt, Open Telemetry, Spring Boot, Git Actions
Responsibilities
Define 3-5 year technical roadmap for the Data Lakehouse; Build internal SDKs and automated orchestration frameworks; Prototype and benchmark emerging technologies; Architect compliance-by-design systems for data lineage and access control; Implement streaming support for AI Agent data; Lead cross-functional architecture reviews and mentor the data engineering organization.
Seniority
Sr Staff, hands-on IC with strategic influence