Data Engineer
Core
Design, deliver, and optimize scalable, secure, and resilient data platforms and solutions across diverse infrastructure projects.
Role type
Senior Data Engineer (Infrastructure & Consulting)
Builds
End-to-end data pipelines, data architectures, and analytical solutions for public and private sector clients.
Domain
Infrastructure consulting, public/private sector, cloud data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, data modeling (dimensional, star/snowflake, data vault), ETL/ELT pipeline design, workflow orchestration (Apache Airflow, Azure Data Factory), cloud data engineering, CI/CD, data governance, metadata management, PII protection, monitoring and alerting, troubleshooting complex infrastructure issues.
Preferred skills
Scala, Java, C#, feature engineering, exploratory analysis, model operationalisation, big data analysis.
Technologies
Apache Airflow, Azure Data Factory, Azure Functions, relational databases, non-relational stores, data warehouses.
Responsibilities
Develop concepts through the solution lifecycle ensuring scalability and cost optimization; oversee end-to-end data processes including ingestion, transformation, and integration; demonstrate solutions meet client performance, quality, security, and governance expectations; collaborate with cross-functional teams to gather requirements; uphold data engineering best practices including code quality, testing, and documentation; develop monitoring and alerting strategies; troubleshoot complex issues across infrastructure and custom analytical products.
Seniority
Senior, hands-on IC with client-facing responsibilities
