Consultant Data Engineer
Core
Design, develop, and maintain reliable data pipelines for ingestion, transformation, and delivery to business and data teams.
Role type
Data Engineer
Builds
Data pipelines and data assets
Domain
Data Intelligence / Serverless Architecture
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, Cloud platforms (Azure, AWS, GCP), Data orchestration (Airflow, Azure Data Factory, Prefect), Data processing frameworks (Spark, PySpark, Pandas), Data quality and governance
Preferred skills
Modern BI tools (Power BI, Tableau, Azure Data Factory), Cloud-native development
Technologies
Databricks, Apache Spark, PySpark, Airflow, Azure Data Factory, Prefect, Azure, AWS, GCP, Python, SQL
Responsibilities
Design and maintain reliable data pipelines; Integrate and transform data from diverse sources (SQL, APIs, ERP, CRM); Deploy and administer solutions on Cloud environments; Orchestrate and automate data processing; Implement data quality, consistency, and security controls; Optimize processing performance; Document data flows and ensure traceability; Collaborate with Data Analysts, Data Scientists, and business teams; Participate in technology scouting and propose stack improvements
Seniority
Mid-level, hands-on IC
