Data Engineering, Consultant
Core
Design, implement, and integrate advanced data engineering with AI solutions across the enterprise to support digital applications and data platforms.
Role type
Senior hands-on data engineering consultant
Builds
Scalable data pipelines, architectures, and AI-integrated enterprise data solutions
Domain
Insurance / Data Engineering / Cloud
Deliverable
production ML models | product features | infrastructure
Required skills
PySpark, SQL, Delta Lake, Databricks Platform, Lakehouse Architecture, Azure Databricks, ADLS Gen2, ADF, Azure DevOps, Streaming (Auto Loader, Structured Streaming, Kafka/Event Hub), Unity Catalog, Python
Preferred skills
Scala, Terraform, Databricks Asset Bundles, CI/CD pipelines
Technologies
Azure Databricks, ADLS Gen2, ADF, Azure DevOps, Kafka, Event Hub, Unity Catalog, Delta Lake
Responsibilities
Design and optimize scalable data pipelines and architectures; Drive integration of API services and enterprise data platforms; Oversee end-to-end project execution from design through deployment; Define and establish BAU support models; Serve as primary technical liaison with external vendors; Champion best practices in data engineering, cloud architecture, and AI integration.
Seniority
Senior, hands-on IC
