Senior Data Engineer
Core
Design, develop, and maintain scalable data pipelines and ETL/ELT solutions to support enterprise data platforms using Azure services.
Role type
Senior Azure Data Engineer
Builds
Scalable data pipelines, ETL/ELT processes, and data solutions on Azure
Domain
Cloud data engineering, Big Data
Deliverable
production ML models
Required skills
Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Apache Spark, Python, Scala, SQL, Hadoop, Control-M
Preferred skills
CI/CD practices, version control, performance tuning
Technologies
Microsoft Azure, Apache Spark, Python, Scala, Hadoop, Control-M
Responsibilities
Design and develop scalable data pipelines; Optimize ETL/ELT processes for data ingestion and transformation; Build and manage pipelines using Azure Data Factory, Databricks, and Data Lake Storage; Develop and optimize Spark applications; Monitor pipeline execution and troubleshoot failures; Implement data validation and quality checks; Collaborate with data architects and analysts; Support production deployments and incident resolution.
Seniority
Senior, hands-on IC