Intermediate Data Engineer
Core
Building and managing data pipelines, notebooks, and Delta Lake artefacts using Databricks and Python for data transformation and automation.
Role type
Intermediate Data Engineer
Builds
Production data pipelines and data integration workflows
Domain
Telecommunications / Fibre industry data engineering
Deliverable
production ML models
Required skills
Databricks, Python, Informatica / IDMC, Grafana, SQL, relational database design, data governance, data security, batch/streaming data processing
Preferred skills
AWS or Azure, PowerBI, OSS/BSS data environments, PostgreSQL, Microsoft SQL Server, Microsoft 365 / SharePoint
Technologies
Databricks, Python, Informatica, IDMC, Grafana, PowerBI, PostgreSQL, Microsoft SQL Server, AWS, Azure, Microsoft 365, SharePoint
Responsibilities
Designing and maintaining data integration workflows and mappings, configuring and interpreting monitoring dashboards for pipeline observability, building and managing data pipelines and Delta Lake artefacts, performing data querying, transformation, and analysis
Seniority
Intermediate, hands-on IC
