CareerPlan

Senior Data Engineer

India Head OfficeFull-time2026-11-11 → 2026-11-20

Core

Design, build, and maintain scalable batch and streaming ELT/ETL data pipelines and large-scale datasets on Databricks and Snowflake, while building AI agents and agentic data products.

Role type

Senior individual contributor data engineer

Builds

Central data platform features, agent-ready datasets, and governed data tools for AI agents

Domain

Cloud data engineering and AI agents

Deliverable

production ML models

Required skills

Databricks, Snowflake, Apache Spark (Python/Scala), Delta Lake, Kafka, Apache Airflow, LangGraph, SQL, data modeling (Kimball/3NF), CI/CD

Preferred skills

dbt, data clean rooms, semantic layer tools (Looker/Tableau), MLOps, energy/utilities/IoT domain expertise

Technologies

Databricks, Snowflake, Apache Spark, Delta Lake, Kafka, Airflow, LangGraph, FastMCP, Python, Scala, SQL

Responsibilities

Design and build scalable batch and streaming pipelines; implement automated data quality checks, lineage tracking, and RBAC security; monitor and optimize compute and storage costs; build AI agents and expose governed data through MCP tools; translate architectural designs into production-ready code; review code and share best practices

Seniority

Senior, hands-on IC