Data Engineer, Azure - Remote, Latin America
Core
Design and maintain ETL data engineering processes, data warehousing structures, and data pipelines within the Azure cloud ecosystem.
Role type
Senior Data Engineer (Azure)
Builds
Scalable data pipelines, data lakes, and data models for client applications
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python (PySpark), Azure Synapse Analytics, SQL (SparkSQL, MS SQL), ETL development, Data Warehousing (Star Schemas), Data Modeling, Git, Data Quality checks, Performance Tuning
Preferred skills
Data Fabric concepts (Delta Lakes, Lakehouses), Machine Learning, Data Visualization (Power BI, Tableau), Agile Methodologies
Technologies
Azure Synapse Analytics, PySpark, Azure Key Vault, REST APIs, Git, Azure DevOps
Responsibilities
Develop and maintain ETL processes using Python and Azure Synapse; Design and build data storage structures in MPP pools; Extract data from REST APIs, databases, and files; Optimize data notebooks and pipelines for performance; Implement data quality checks and validation; Collaborate with architects on data models; Monitor and troubleshoot ETL jobs; Ensure data security and compliance.
Seniority
Mid-to-Senior, hands-on IC
