Data Engineer
Core
Designing and setting up data pipelines, ETL processes, and Delta lakehouse architectures on Microsoft Azure.
Role type
Senior Data Engineer (DevOps & Cloud Infrastructure)
Builds
Data platforms, ETL pipelines, and lakehouse architectures for enterprise clients.
Domain
Cloud Infrastructure (Azure), Data Engineering, DevOps
Deliverable
production ML models | infrastructure
Required skills
Kubernetes, Terraform, Apache Spark, Azure DevOps, Helm, Docker, GitOps, IaaS, Data Pipeline Design
Preferred skills
GitOps (ArgoCD), Kubeflow, Thingsboard, Apache Superset, Dremio, Delta Lake, Snowflake, Data Vault 2.0
Technologies
Kubernetes, Terraform, Azure DevOps, Apache Spark, Helm, Docker, Git, Azure, Databricks, Snowflake, Traefik, Nginx, HAProxy, KeyVault, EventHub, Postgresql
Responsibilities
Provisioning data platforms, managing Kubernetes resource templating, designing ETL processes, setting up Delta lakehouse architecture, managing CI/CD pipelines, handling cloud cost management and billing.
Seniority
Senior, hands-on IC