Data Engineer
Core
Designing, developing, and implementing cloud-based data and analytics platforms (DAP) and pipelines that acquire, cleanse, transform, and publish data from diverse sources.
Role type
Data Engineer
Builds
Cloud-based data and analytics platforms (DAP) and pipelines
Domain
Cloud data engineering, Azure, Databricks
Deliverable
production ML models | infrastructure
Required skills
Python, PySpark, SQL, Databricks, Delta Lake, ETL/ELT, Azure, Git, CI/CD
Preferred skills
Power BI, DAX, Tabular models (TMDL)
Technologies
Azure, Databricks, Delta Lake, Spark SQL, Power BI, Git
Responsibilities
Assemble large complex data sets meeting business requirements; Partner with data asset managers and architects to ensure technical solutions fit architecture blueprints; Contribute to coding standards and best practices for efficient, reusable components; Identify, design, and implement internal process improvements.
Seniority
Experienced Professionals
