Data Engineer Consultant
Core
Build and deploy production-grade data pipelines for major enterprise clients, modernizing legacy setups into cloud-native Lakehouses.
Role type
Senior IC data engineer (consulting)
Builds
Production data pipelines, Lakehouse modernizations, and automated ELT/ETL workflows
Domain
Enterprise data engineering, cloud data platforms
Deliverable
production ML models | product features
Required skills
Python, advanced SQL, Databricks (Delta Lake, PySpark, Unity Catalog), dbt, Terraform, Apache Airflow, Git
Preferred skills
Streaming tools (Apache Kafka, CDC), legacy warehouse migration experience (Teradata, Netezza, Snowflake, Redshift)
Technologies
Databricks, dbt, Python, Terraform, AWS, GCP, Apache Airflow, Delta Live Tables
Responsibilities
Convert legacy data setups into high-performance PySpark and Databricks SQL pipelines using Medallion Architecture; Write modular dbt models and SQL to transform raw data into trusted datasets; Provision cloud resources programmatically using Terraform and enforce governance with Unity Catalog; Build and monitor automated ELT/ETL workflows ensuring data quality and SLA compliance; Debug failing pipelines and tune SQL/Spark queries for performance and cost reduction.
Seniority
Senior, hands-on IC
