Senior Data Engineer
Core
Building scalable batch and real-time data pipelines and lakehouse solutions to support large-scale data processing and productionize ML/AI workloads for the NIQ Activate platform.
Role type
Senior Data Software Engineer (Data Engineering)
Builds
Production-grade data systems, pipelines, and lakehouse architectures for consumer intelligence analytics.
Domain
Consumer Intelligence / Retail Analytics / Big Data
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Scala, Cloud platforms (AWS/Azure/GCP), Big Data processing (Spark, DataBricks), Event streaming (Kafka), Orchestration (Airflow), SQL, Data storage (Data Lake/Lakehouse, columnar DB, NoSQL), Containers (Kubernetes), CI/CD
Preferred skills
Delta Lake, Apache Iceberg, MLflow, FastAPI, LLM frameworks (LangChain/LangGraph), Infrastructure as Code (Terraform/Pulumi), Observability tooling, React, Node.js
Technologies
Spark, DataBricks, Kafka, Airflow, Kubernetes, Helm, LangChain, LangGraph, Delta Lake, Apache Iceberg, MLflow, FastAPI, Terraform, Pulumi, React, Node.js
Responsibilities
Design and build scalable batch and real-time data pipelines; Own end-to-end data flows from requirements to production operations; Partner with Data Science to productionize ML/AI workloads; Evaluate and adopt new technologies to scale the data ecosystem; Collaborate with cloud, DevOps, and client teams to deliver robust solutions.
Seniority
Senior, hands-on IC
