Senior Data Platform Engineer
Core
Design, architect, and maintain scalable data processing solutions and shared infrastructure to power batch pipelines, live inference, and streaming initiatives for the company's marketplace app and BI tools.
Role type
Senior IC data platform engineer
Builds
Reusable data infrastructure, ML workflows, data processing platforms, and self-service tooling for internal teams
Domain
Food waste reduction / Social impact / Cloud data engineering
Deliverable
production ML models
Required skills
Python, SQL, AWS Redshift, Airflow, Metaflow, dbt, Terraform, GitOps, CI/CD, observability, system design, mentoring
Preferred skills
Streaming (Kinesis, Flink), Kubernetes, Helm
Technologies
AWS (Redshift, Lambda, Kinesis, Firehose, S3, Glue, EMR, AppFlow), Airflow, Flink, dlt, dbt, Metaflow, Python, Terraform, GitHub Actions, Docker, OpenSearch, RDS
Responsibilities
Design scalable data processing solutions; Own shared infrastructure for ML and data teams; Build self-service tooling and infrastructure standards; Optimize system performance and cost governance; Partner with product and tech leads to translate use cases; Automate observability and data integrity tests; Drive best practices and mentor engineers
Seniority
Senior, hands-on IC with technical leadership
