Data Engineer
Core
Build and manage high-quality, scalable data pipelines on cloud platforms to support network performance, analytics, and AI/ML model training for an Australian telecommunications company.
Role type
Senior Data Engineer (Telecommunications)
Builds
End-to-end data pipelines for network telemetry, performance, fault, capacity, and configuration data.
Domain
Telecommunications / Network Analytics / Big Data
Deliverable
production ML models | product features | infrastructure
Required skills
Cloud platforms (GCP, Azure, AWS), Distributed processing (Spark/PySpark, Databricks), SQL, Python, Data pipeline architecture, Data quality frameworks, CI/CD practices, Containerization (Kubernetes), Network concepts and KPIs.
Preferred skills
Experience in telecommunications or network environments, Feature engineering, Anomaly detection, Forecasting, Model deployment.
Technologies
GCP, Azure, AWS, Spark, PySpark, Databricks, Kubernetes, CI/CD tools.
Responsibilities
Design and maintain data pipelines for network telemetry and performance data; Develop scalable data transformations using SQL and Python; Collaborate with data scientists to enable model training and deployment; Ensure data quality, governance, and compliance through monitoring and metadata management.
Seniority
Mid-Senior, hands-on IC
