Data Engineer
Core
Design, build, optimize, and maintain end-to-end scalable data pipelines and enterprise-grade data platforms to support analytics, reporting, and decision-making.
Role type
Mid-level hands-on Data Engineer
Builds
End-to-end data pipelines, data integrations, and cloud-based data engineering solutions
Domain
Public sector transportation (road access, licensing) + Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Apache Spark, Databricks, AWS, SQL, Python, CI/CD, data modeling, ETL/ELT, data orchestration
Preferred skills
Spark/Databricks workload optimization, infrastructure automation, data governance
Technologies
Databricks, Apache Spark, AWS, Azure DevOps, Kafka, dbt
Responsibilities
Designing and developing scalable, secure, and resilient data pipelines; Building and maintaining data integrations across multiple platforms; Optimising pipeline performance and data processing workloads; Supporting cloud-based data engineering solutions and platform enhancements; Applying engineering best practices across automation, testing, deployment, and monitoring; Contributing to data governance, security, reliability, and continuous improvement initiatives
Seniority
Mid-level, hands-on IC
