Data Engineer
Core
Design, develop, and maintain data pipelines; implement and optimize data models, storage, and integration solutions; perform data profiling, cleansing, and transformation.
Role type
Data Engineer
Builds
Data pipelines, data models, data storage, and data integration solutions
Domain
Finance, Energy, Gaming, Telco
Deliverable
production ML models | product features
Required skills
Python, PySpark, SQL, ETL, Data Warehousing (Kimball/Inmon, Data Vault 2.0), Cloud Platforms (Azure, Databricks), Microsoft BI (SQL Server, SSIS, SSAS, Azure Data Factory, Power BI), Workflow Orchestration (Airflow, Prefect, Dagster), Git
Preferred skills
None stated
Technologies
Azure, Databricks, SQL Server, SSIS, SSAS, Azure Data Factory, Power BI, Airflow, Prefect, Dagster, Git
Responsibilities
Design and develop data pipelines; Optimize data models and storage; Perform data profiling and cleansing; Monitor and troubleshoot data pipelines
Seniority
Mid-level (3+ years experience)
