Assistant Manager - Sr. Data Engineering | Databricks | ADF | Snowflake
Core
Build enterprise finance data pipelines on Azure, Databricks, and Snowflake, developing ingestion and transformation jobs to create Gold data products for reporting.
Role type
Senior Data Engineer
Builds
Ingestion pipelines, Bronze/Silver/Gold data layers, conformed dimensions and fact tables, Snowflake views
Domain
Finance data (general ledger, trial balance, sub-ledgers, bank statements) on Azure cloud
Required skills
PySpark, Spark SQL, Azure Data Factory, Snowflake SQL, Python, Dimensional modelling, Git, Azure DevOps
Preferred skills
Informatica CDC, Azure Functions, Service Bus, Unity Catalog, Delta Live Tables, Power BI
Technologies
Databricks, Delta Lake, Azure, Snowflake, Azure DevOps
Responsibilities
Build ingestion pipelines from finance source systems; Develop transformations across Bronze, Silver, and Gold layers; Load certified Gold data into Snowflake; Add data quality, reconciliation, and logging checks; Write unit tests and support UAT; Deploy code through Azure DevOps pipelines; Investigate and fix pipeline failures; Document pipelines and mappings.
Seniority
Senior, hands-on IC
