Software Engineer, Big Data, Tech Enablement
Core
Build scalable, reliable data infrastructure, tools, and processes (data pipelines, ML frameworks, data documentation) to enable product teams at ZipRecruiter to deliver innovative services.
Role type
Senior Big Data Engineer (Tech Enablement)
Builds
Data pipelines, ML development frameworks, data documentation systems, and an agentic data exploration tool (Sift) for internal use.
Domain
Internet / Employment Marketplace / Big Data & MLOps
Deliverable
production ML models
Required skills
Apache Spark (batch/streaming), containerized services, distributed systems, data pipeline orchestration, data documentation tooling, MLOps frameworks
Preferred skills
AWS (S3, IAM, EC2, MSK), data lake stacks (Parquet, AWS Glue, Iceberg/Delta Lake), Kafka/Flink/Spark Structured Streaming, Apache Airflow, Kubernetes/Docker, schema evolution
Technologies
Apache Spark, Kafka, Apache Flink, Apache Airflow, AWS, Kubernetes, Docker, Apache Iceberg, Delta Lake, Parquet
Responsibilities
Design and maintain data ingestion pipelines and datalake systems; build and operate MLOps frameworks to accelerate ML development; develop and maintain the Sift data analysis agent; implement data documentation frameworks.
Seniority
Senior, hands-on IC