Senior Compute Platform Engineer
Core
Building and running the data infrastructure (lakehouse platform) that powers Zeta's AI-powered marketing cloud, enabling data scientists and engineers to process terabytes of data efficiently.
Role type
Senior IC compute platform engineer (data infrastructure)
Builds
Reliable, cost-efficient data processing infrastructure and a Scala data warehouse framework for batch jobs
Domain
Marketing technology / Big data processing
Deliverable
infrastructure
Required skills
Scala, Spark, Hadoop, Airflow, Iceberg, open-source project contribution, mentoring
Preferred skills
JVM-based languages, large-scale data-processing frameworks
Technologies
Spark, Scala, Hadoop, Airflow, Iceberg, EC2 spot instances
Responsibilities
Operating and implementing new features in the framework and services; Engaging with data scientists to improve their experience with the framework; Identifying and implementing computational improvements; Making improvements and fixing bugs by submitting patches to open-source projects; Acting as an expert on Spark and Scala; Mentoring engineers and raising the bar on quality and reliability
Seniority
Senior, hands-on IC with mentorship responsibilities