Senior Data Engineer (Contract)
Core
Build and run production data pipelines on a Databricks Lakehouse to support workforce forecasting and staffing products for financial institutions.
Role type
Senior Data Engineer (Contract)
Builds
Data pipelines, data warehouse migration (Redshift to Databricks), and analytics platform infrastructure.
Domain
Financial Services / Data Engineering
Deliverable
production ML models
Required skills
Python, PostgreSQL, Redshift, AWS DMS, Databricks (Delta, Jobs, DLT/Lakeflow, Unity Catalog), dbt, LookML, Infrastructure-as-Code (Terraform, DAB), CDC, PII handling
Preferred skills
AI coding agents (Claude Code), LLMs, financial services experience
Technologies
Databricks, dbt, Looker, AWS, Terraform, DAB
Responsibilities
Build and run production pipelines in Databricks; Lead Redshift to Databricks migration; Own replication and ingestion from production databases; Set data contracts with internal teams and external ML partners; Monitor pipeline health, data quality and Databricks cost; Document build artifacts (runbooks, lineage, design decisions)
Seniority
Senior, hands-on IC
