Data Engineer
Core
Architecting end-to-end data systems and building recommendation engines that transform food waste data into actionable customer insights.
Role type
Senior Data Engineer (Recommendation Systems)
Builds
Customer-facing recommendation engine and scalable data pipelines for food waste management
Domain
Food waste technology / SaaS
Deliverable
production ML models | product features
Required skills
Python, SQL, cloud data warehouses (Snowflake/BigQuery/Redshift), dbt, Airflow, Fivetran, CI/CD, data quality monitoring, schema management, LLM integration
Preferred skills
Distributed systems concepts, Infrastructure as Code (Terraform/Pulumi), BI tools (Hex/Mixpanel/Tableau), data mesh patterns, event tracking
Technologies
Python, dbt, Airflow, Fivetran, Snowflake, BigQuery, Redshift, LLMs, Terraform, Pulumi, Hex, Mixpanel, Tableau
Responsibilities
Design and maintain scalable data pipelines; build and operate the customer-facing recommendation engine; design transformation pipelines for multi-source food data; partner with analytics teams to support self-serve tools; own data quality monitoring and observability; implement CI/CD discipline for pipelines; define and maintain business logic and metrics for stakeholders
