Data Engineer with Python
Core
Designing, developing, and testing scalable Big Data solutions and constructing a central Data Lake for a telecommunications group.
Role type
Data Engineer (Big Data & Data Warehousing)
Builds
Scalable Big Data solutions, central Data Lake, near real-time data pipelines
Domain
Telecommunications / Big Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Linux scripting, Data pipeline design, Data warehousing, Batch processing, Near real-time processing
Preferred skills
Apache Spark, Cloudera
Technologies
Python, SQL, Linux, Cloudera, Pandas, Numpy, PySpark, Spark
Responsibilities
Designing and developing scalable Big Data solutions; Constructing and architecting the central Data Lake; Optimizing data flow and assessing data processing accuracy; Testing and comparing new technologies; Collaborating with Data Scientists and stakeholders
Seniority
Mid-level (3+ years experience)
