Assistant Manager, Azure Data Engineer
Core
Design, develop, and maintain data integration and provision for analytics and reporting teams, transforming raw data into consumable datasets.
Role type
Assistant Manager Azure Data Engineer
Builds
Scalable data ingestion frameworks, ETL workflows, and optimized Spark jobs for high-volume datasets.
Domain
Cloud Data Engineering (Azure, Databricks)
Deliverable
production ML models | product features
Required skills
Apache Spark, PySpark SQL, Delta Lake, Azure SQL Data Warehouse, Data Modeling, ETL, Data Validation, CI/CD pipelines, Medallion Architecture
Preferred skills
Apache NiFi, Apache Flume, Elastic Stack, Flask
Technologies
Azure DevOps, GitHub Actions, Databricks, Delta Lake, PySpark
Responsibilities
Transform raw data into consumable datasets using business logic; Build and optimize Spark jobs and ETL workflows; Handle large dataset performance tuning; Develop scalable data ingestion for batch and streaming; Implement data validation and cleansing; Collaborate with DevOps on CI/CD pipelines; Design efficient data models following medallion architecture.
Seniority
Manager, hands-on IC