CareerPlan

Senior Data Engineer

India - HyderabadFull-time2026-08-04 → 2026-11-15

Core

Lead the design, development, and delivery of scalable enterprise data solutions, including batch and real-time pipelines, lakehouse architectures, and governed data platforms supporting analytics and AI.

Role type

Senior IC data engineer (cloud data platform)

Builds

Cloud-based lakehouse and data-platform solutions using Databricks and AWS

Domain

Cloud data engineering, distributed computing, regulated industries (biotech/pharma)

Required skills

Databricks, Apache Spark, PySpark, SQL, AWS, data modeling, data governance, CI/CD, workflow orchestration, performance tuning

Preferred skills

Unity Catalog, Data Fabric, Kafka, vector databases, AI/GenAI support (RAG, embeddings)

Technologies

Databricks, Apache Spark, AWS, Python, Delta Lake, Git, Kafka, Kinesis

Responsibilities

Lead design and development of scalable batch and real-time ETL/ELT pipelines; Own complex data solutions from requirements through production support; Build cloud-based lakehouse solutions; Develop reusable data integration frameworks; Optimize Spark workloads and Databricks compute; Implement workflow orchestration, monitoring, and data-quality controls; Define data models, contracts, and engineering standards; Mentor engineers and lead architecture reviews

Seniority

Senior, hands-on IC with technical leadership