Azure Data Engineer
Core
Design, develop, and optimize large-scale data engineering solutions for Banking and Financial Services clients using Azure cloud platforms.
Role type
Senior IC Azure Data Engineer
Builds
Scalable data ingestion, transformation, and processing frameworks on Azure
Domain
Banking and Financial Services / Cloud Data Engineering
Required skills
Apache Spark, PySpark, Spark SQL, Azure Synapse Analytics, Python, Hive, HDFS, ADLS2, Jenkins, CI/CD, BMC Control-M, Git, Bitbucket
Preferred skills
Databricks, ServiceNow, Data Governance, Change Management
Technologies
Azure, Apache Spark, Databricks, Hive, MySQL, ServiceNow, BMC Control-M, Bitbucket, Jenkins
Responsibilities
Design and implement scalable data processing pipelines using PySpark and Spark SQL; Build and maintain data ingestion and transformation frameworks; Perform Spark performance tuning and optimization; Troubleshoot production issues via log analysis and root cause identification; Configure and manage enterprise data workflows using BMC Control-M; Mentor junior developers and provide technical guidance.
Seniority
Senior, hands-on IC with leadership responsibilities