Senior Software Engineer, Data Platform
Core
Build and operate the data infrastructure supporting Zeta's products, analytics, machine learning, and AI systems.
Role type
Senior IC data platform engineer
Builds
Lakehouse architecture, distributed compute, data quality, governance, lineage, security, and operational systems
Domain
Marketing technology / Data infrastructure
Deliverable
production ML models
Required skills
Python, Scala, Java, distributed data-processing frameworks, production data platforms, backend systems, distributed systems, AWS services, monitoring, alerting, deployment automation, incident response
Preferred skills
Kubernetes, Terraform, Airflow, Trino, ClickHouse, Starrocks, Pinot, Lakehouse architecture, Apache Iceberg, query engines, real-time OLAP
Technologies
Spark, Hadoop, EC2 Spot, AWS (EC2, S3, Athena, IAM), Kubernetes, Terraform, Airflow, Trino, ClickHouse, Starrocks, Pinot, Iceberg
Responsibilities
Build and operate Lakehouse, Spark, and distributed data-processing systems; Improve performance, reliability, cost, and operational visibility of platform workloads; Develop capabilities for data quality, governance, lineage, metadata, discoverability, security, and access control; Build data context for trusted reporting, ML models, and AI agents; Evaluate compute and query engines for read-heavy workloads; Assess real-time OLAP technologies; Improve deployment, observability, incident response, and developer tooling; Partner with data scientists and data engineers; Contribute to open-source projects like Spark, Iceberg, and Airflow; Mentor engineers through code reviews and knowledge-sharing
Seniority
Senior, hands-on IC