CareerPlan

Data Engineering Lead

Bangalore, Karnātaka, IndiaFull-time2026-06-26 → 2026-11-16

Core

Lead and manage execution of data engineering projects to build operational data platforms, ETL pipelines, data lakes, and streaming hubs for digital marketing, eCommerce, and BI clients.

Role type

Senior IC data engineering lead (management & hands-on)

Builds

Operational data platforms, ETL pipelines, data lakes, near real-time streaming data hubs, web services, and ML training/scoring models

Domain

Enterprise data warehousing, business intelligence, and ETL principles

Deliverable

production ML models

Required skills

Python, SQL, Distributed programming (Spark), Cloud (Azure), Data workflows, ETL, Apache Airflow, Unix/Linux, Bash, Git, Docker, Web services/APIs, Object-oriented programming, Data processing architecture, Security practices

Preferred skills

Azure, Apache Airflow, Containers/Docker

Technologies

Spark, Azure, Airflow, Docker, Git, Linux, Bash

Responsibilities

Lead and manage execution of data engineering projects; Engineer complete technical solutions for business challenges; Collect functional and non-functional requirements; Troubleshoot and quality check team work; Collaborate with partners, strategy consultants, and data scientists; Share knowledge via technical trainings; Communicate with clients at the executive level; Guide and mentor team members

Seniority

Senior, hands-on IC with management responsibilities