Data Platform Engineer
Core
Build, test, deploy, and automate a governed, compliant, and cost-effective Azure lakehouse foundation (NNDAP) and a managed Databricks environment (NNDL) to enable business units to build analytics platforms and data products faster.
Role type
Senior IC data platform engineer (Azure/Databricks)
Builds
Reusable data extraction, ingestion, harmonization, and quality components for internal business units
Domain
Financial services / Cloud data engineering
Deliverable
production ML models | product features
Required skills
Python (incl. PySpark), SQL, CI/CD, Infrastructure as Code (Bicep, Pulumi), Azure Data Factory, Databricks, Lakehouse & medallion design, data quality, lineage/metadata, cost/performance optimization, security & governance
Preferred skills
Monitoring/observability, event-driven patterns/streaming, API-driven data product exposure
Technologies
MS Azure, Azure Data Factory, Databricks, Python, PySpark, SQL, Bicep, Pulumi
Responsibilities
Refine and automate core functional data components; translate customer needs into modular solutions; design and optimize data platform architecture; mentor junior engineers and lead technical discussions; collaborate on code within the innersource community
Seniority
Senior, hands-on IC with mentorship