CareerPlan

Lead Data Engineer

Full-time2026-11-16

Core

Lead the design, delivery, and evolution of a modern data platform built on Microsoft technologies while mentoring a team of Data Engineers.

Role type

Senior Lead Data Engineer (Microsoft Cloud)

Builds

Scalable, secure, and high-performing data platforms and pipelines

Domain

Enterprise Data Engineering / Microsoft Cloud

Required skills

Team leadership and mentoring, Technical SME for Data Engineering, Solution design and implementation, PySpark and Spark SQL expertise, SQL query optimization and security, Pipeline orchestration, CI/CD management, Agile delivery

Preferred skills

Graph Databases (Neo4j), Snowflake, AI-assisted development tools, Microsoft Fabric certifications

Technologies

Microsoft Fabric, Databricks, Azure Synapse, Azure, PySpark, Spark SQL, Azure Data Factory, Azure DevOps

Responsibilities

Lead and mentor a team of Data Engineers, Act as the technical SME for Data Engineering, Lead technical delivery across projects, Design and optimize scalable data platforms, Develop and maintain robust data pipelines, Review code and establish engineering standards, Build and optimize SQL solutions, Manage Azure DevOps Boards, Repositories, and CI/CD Pipelines, Collaborate with Solution Architects and stakeholders, Drive Agile delivery and continuous improvement

Seniority

Senior, hands-on IC with people management