Data Engineer
Core
Design, develop, and manage scalable, high-performance data pipelines for IT projects.
Role type
Data Engineer
Builds
Scalable data pipelines
Domain
IT / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python, Hadoop ecosystem (HDFS, Hive, Yarn), Apache Spark, PySpark, Pandas, SQL (PostgreSQL), REST/SOAP/FTP integration, Apache Airflow
Responsibilities
Design and develop data pipelines, manage data infrastructure, integrate data via APIs and protocols
Seniority
Mid-level, hands-on IC
Sourced via adzuna · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.