Data Engineer
Core
Designing and maintaining data pipeline architecture and infrastructure for extraction, transformation, and loading of data to support business decision-making and operational efficiency.
Role type
Data Engineer
Builds
Data pipelines, data products, and visualizations for business insights
Domain
Construction and infrastructure
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
Azure Data Factory, Azure Data Lake, Azure Databricks, Python/PySpark, SQL, data warehousing methodologies, Power BI, API data ingestion, PowerShell, version control (Github), Azure DevOps
Preferred skills
Agile/Scrum methodologies, root cause analysis, stakeholder engagement
Technologies
Azure ecosystem (Data Factory, Data Lake, Databricks), Power BI, SSIS, SSAS, SSRS, Power Automate, Github, Azure DevOps
Responsibilities
Create and maintain optimal data pipeline architecture; Design, develop, and implement informative visualizations; Work with stakeholders to assist with data-related technical issues; Keep internal data separated and secure across national boundaries using well-architected sensitive data patterns
Seniority
Mid-level (3+ years experience)