[GFA] Azure Senior Data Engineer
Core
Design and implement reusable, metadata-driven data pipelines and comprehensive data models on an Azure-based Data Analytics Platform to support scalable screening programs for global clients.
Role type
Senior IC Azure Data Engineer
Builds
Production data pipelines, ETL/ELT solutions, and data models for a global risk and talent screening platform
Domain
Financial services / Risk management / Data Engineering
Deliverable
production ML models | product features
Required skills
PySpark, Databricks Lakehouse architecture, Data modeling (fact/dimension tables, SCD Type 2), Event-driven architecture, Python, SQL, Azure data platforms, Large-scale data processing, CI/CD
Preferred skills
Spark Structured Streaming, Infrastructure as Code (Terraform, Bicep), Containerized applications (Kubernetes, Azure Container Apps), Azure cloud native solutions (Data Factory, Function App)
Responsibilities
Develop reusable data pipelines using Databricks and PySpark, Design and implement comprehensive data models, Build robust ETL/ELT solutions with Merge operations and incremental loads, Automate and optimize data platform processes, Build integrations using event-driven patterns, Cooperate with infrastructure engineering to set up cloud resources
Seniority
Senior, hands-on IC