Data Engineer/ Data Analyst (on-site)
Core
Design, develop, and maintain data pipelines and storage solutions on Microsoft Azure while supporting analytical teams.
Role type
Data Engineer / Data Analyst
Builds
Data pipelines, ETL/ELT processes, and data storage structures on Azure
Domain
Technology / Data Engineering
Deliverable
production ML models
Required skills
Azure Data Factory, Databricks, Azure Data Lake Storage Gen2, SQL, Python, PySpark, ETL/ELT, Delta Lake, Parquet, Data Lakehouse architecture, Data modeling
Preferred skills
Power BI, CI/CD, Data Quality, Data Governance, Azure DevOps, Enterprise-scale Azure environments
Technologies
Azure, Databricks, Azure Data Factory, Azure Data Lake Storage Gen2, Delta Lake, Parquet, SQL, Python, PySpark, Power BI, Azure DevOps
Responsibilities
Design and develop data pipelines using Azure Data Factory and Databricks; manage storage structures in Azure Data Lake Storage Gen2; build and evolve robust ETL/ELT processes; diagnose and resolve pipeline and storage issues; optimize existing pipelines and implement data quality controls; collaborate with technical teams and business stakeholders to support Data Analysts and Power BI developers.
Seniority
Mid-Senior, hands-on IC