Senior Data Engineer
Core
Design, build, and maintain scalable batch and streaming ELT/ETL data pipelines and large-scale datasets on Databricks and Snowflake, while building AI agents and agentic data products.
Role type
Senior individual contributor data engineer
Builds
Central data platform features, agent-ready datasets, and governed data tools for AI agents
Domain
Cloud data engineering and AI agents
Deliverable
production ML models
Required skills
Databricks, Snowflake, Apache Spark (Python/Scala), Delta Lake, Kafka, Apache Airflow, LangGraph, SQL, data modeling (Kimball/3NF), CI/CD
Preferred skills
dbt, data clean rooms, semantic layer tools (Looker/Tableau), MLOps, energy/utilities/IoT domain expertise
Technologies
Databricks, Snowflake, Apache Spark, Delta Lake, Kafka, Airflow, LangGraph, FastMCP, Python, Scala, SQL
Responsibilities
Design and build scalable batch and streaming pipelines; implement automated data quality checks, lineage tracking, and RBAC security; monitor and optimize compute and storage costs; build AI agents and expose governed data through MCP tools; translate architectural designs into production-ready code; review code and share best practices
Seniority
Senior, hands-on IC