Senior Data Engineer
Core
Designing and optimizing data pipelines, applications, and dashboards for a telco's AI-first digital infrastructure.
Role type
Senior Data Engineer (Platform & Application)
Builds
Data pipelines, streaming/batch data applications, frontend dashboards, and data lake/streaming platforms.
Domain
Telecommunications, Big Data, Cloud Infrastructure
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
Python, PySpark, SQL, Apache Airflow, Hadoop/MapR/Cloudera, React/Angular, Django/FastAPI/Springboot, Linux shell scripting, Data API development, Data security standards
Preferred skills
NoSQL, kSQL, Zeppelin Notebook, DevOps/DataOps practices
Technologies
Hadoop, mapR, Cloudera, HPE, Apache Airflow, Zeppelin, React, Angular, Django, FastAPI, Springboot, Python, PySpark, SQL, noSQL, kSQL
Responsibilities
Develop and improve data pipelines on Big Data platforms; Build and enhance data applications for streaming and batch datasets; Design high-level and detailed architecture for data solutions; Lead and monitor junior data engineers; Manage DevOps, DataOps, and Streaming Operations; Perform R&D and PoC for new data solutions; Drive optimization and testing for data quality and efficiency.
Seniority
Senior, hands-on IC with mentorship responsibilities