Senior Consultant/Manager - Data Engineer
Employee or contractor
Core
Build and maintain data pipelines on Databricks for a financial services/wealth management data platform using PySpark and medallion architecture.
Role type
Data Engineer
Builds
Scalable, secure data pipelines ingesting from multiple sources, transforming via bronze/silver/gold layers, and publishing via file exports and Kafka.
Domain
Financial services / Wealth management
Required skills
Python, PySpark, SQL, Databricks, Kafka, Medallion architecture
Preferred skills
Data engineering fundamentals, clean code practices, fast learning ability
Technologies
Databricks, PySpark, Kafka
Responsibilities
Write transform code, fix pipeline issues, maintain environment health across dev/qa/uat
Seniority
Mid-level, hands-on IC