Senior Azure Data Engineer
Core
Designing, building, and optimizing scalable data pipelines across cloud and distributed systems for analytics and reporting.
Role type
Senior Azure Data Engineer
Builds
Scalable data pipelines, data products, and metadata-driven frameworks
Domain
Cloud data engineering, Banking/Financial Services
Deliverable
production ML models
Required skills
PySpark, Spark SQL, Python, Java, Azure services, Databricks, Hive, Oracle, Power BI, QlikView, RPA, web-scraping, CI/CD tools, job schedulers, monitoring tools
Preferred skills
Banking domain knowledge (Basel 4, Regulatory Reporting), SQL (Advanced), Databricks certification
Technologies
Azure, Databricks, AWS, Bitbucket, GitHub, Jenkins, Control-M, Atlassian tools
Responsibilities
Build and maintain scalable data pipelines; Develop data products integrating customer data; Create metadata-driven frameworks for data quality; Write PySpark and Spark SQL scripts for complex transformations; Support ETL processes and ensure data integrity; Monitor data platforms and optimize for efficiency/cost; Perform root cause analysis for job failures; Collaborate with cross-functional teams; Participate in design reviews and production deployments; Apply governance best practices for security and compliance.
Seniority
Senior, hands-on IC