Data Engineer
Core
Building and maintaining data pipelines, ETL workflows, and data services using Python, SQL, and cloud technologies.
Role type
Data Engineer
Builds
Data pipelines, ETL workflows, data services, and REST API integrations
Domain
Data Engineering / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, ETL tools (Dataiku), Apache Airflow, Big Data technologies (Hadoop, Hive, Kafka, Spark, Presto, HBase), Cloud platforms (GCP, Azure), REST APIs, Python frameworks (Django, Flask, FastAPI), NoSQL/SQL databases (Oracle, Cassandra, Druid), Linux/Windows environments
Preferred skills
Version control (GitHub), Agile methodologies (Scrum/Kanban), performance optimization for large data volumes
Technologies
Python, SQL, Dataiku, Apache Airflow, Hadoop, Hive, Kafka, Spark, Presto, HBase, Automic, Aorta, GCP, Azure Blob Storage, Oracle, Cassandra, Druid, Django, Flask, FastAPI, GitHub, Linux, Windows
