Data Engineer with experience to Python, Airflow, Databricks & SQL
Core
Building scalable batch and real-time data pipelines and lakehouse solutions for a rapidly expanding customer base, integrating data science workloads into products.
Role type
Senior Data Engineer (Big Data & Cloud)
Builds
Production-grade data pipelines (batch/streaming), data lakehouse solutions, and data services/APIs.
Domain
Consumer Intelligence / Retail Analytics / Big Data
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Scala, Apache Spark, Databricks, Apache Kafka, Apache Airflow, SQL, PostgreSQL, Delta Lake, Apache Iceberg, FastAPI, Pandas/Polars
Preferred skills
Kubernetes, Terraform/Pulumi, LangChain/LangGraph, React, Node.js
Technologies
Azure, Kafka, Airflow, Databricks, Spark, Delta Lake, Iceberg, MLflow, FastAPI, Kubernetes, Terraform, LangChain
Responsibilities
Own end-to-end data flows from requirements to production operations; Design and build scalable batch and real-time data pipelines; Partner with Data Science to productionize ML/AI workloads; Evaluate and adopt new technologies to scale the data ecosystem.
Seniority
Senior, hands-on IC
