Data Engineer
Core
Designing, developing, and implementing robust data architectures and scalable data pipelines for storage and processing to underpin AI and analytics initiatives.
Role type
Data Engineer
Builds
Scalable data solutions, ETL pipelines, and data architectures for high-profile local and international clients.
Domain
Professional services, Artificial Intelligence & Data
Deliverable
production ML models | infrastructure
Required skills
Data modelling, integration, ETL pipeline development, distributed computing (Hadoop, Spark), programming (Python, Scala, R), SQL, relational databases, real-time streaming analytics, cloud platforms (Azure Analytics, Databricks, AWS Glue), data visualisation (Power BI, Tableau)
Preferred skills
Stakeholder engagement, project delivery, mentoring junior team members
Technologies
Hadoop, Spark, NiFi, Azure Analytics, Databricks, AWS Glue, Power BI, Tableau
Responsibilities
Designing and implementing robust data architectures and scalable data pipelines, ensuring data quality and security, optimizing data processes for performance, integrating diverse data sources into cohesive ETL solutions, collaborating with cross-functional teams to translate business needs into data-driven solutions, managing and mentoring junior team members
Seniority
Mid-level to Senior, hands-on IC with project leadership
