Senior Engineer, Data Platform
Core
Build and operate the data infrastructure supporting products, analytics, machine learning, and AI systems.
Role type
Senior IC data platform engineer
Builds
Lakehouse architecture, distributed compute, data quality, governance, lineage, security, and operational systems
Domain
Data infrastructure, distributed systems, cloud platforms
Deliverable
production ML models
Required skills
Python, Scala, Java, distributed data-processing frameworks, production data platforms, backend systems, AWS services, monitoring, alerting, deployment automation, incident response
Preferred skills
Kubernetes, Terraform, Airflow, Trino, ClickHouse, Starrocks, Pinot
Technologies
Spark, Lakehouse, Apache Iceberg, Hadoop, EC2 Spot, Athena, IAM, S3, Trino, ClickHouse, Starrocks, Pinot, Airflow
Responsibilities
Build and operate Lakehouse, Spark, and distributed data-processing systems; Improve performance, reliability, cost, and operational visibility of platform workloads; Develop capabilities for data quality, governance, lineage, metadata, discoverability, security, and access control; Build data context for trusted reporting, ML models, and AI agents; Evaluate compute and query engines for read-heavy workloads; Assess real-time OLAP technologies; Improve deployment, observability, incident response, and developer tooling; Partner with data scientists and data engineers; Contribute to open-source projects like Spark, Iceberg, and Airflow; Mentor engineers through code reviews and knowledge-sharing
Seniority
Senior, hands-on IC
