Data Engineer / Apache Airflow Specialist
Core
Design, implement, and optimize large-scale ETL workflows, data indexing, and performance tuning for data-driven projects.
Role type
Senior Data Engineer / Apache Airflow Specialist
Builds
Scalable data pipelines, optimized data retrieval systems, and automated deployment workflows
Domain
Data Engineering, ETL, Search Infrastructure
Deliverable
production ML models | product features
Required skills
Apache Airflow DAG orchestration, Python (ETL focus), Elasticsearch indexing & optimization, Unix/Linux scripting, Oracle/PostgreSQL database management, GitLab CI/CD pipeline implementation
Preferred skills
Flask API development, Great Expectations, Airflow on Kubernetes, performance tuning
Technologies
Apache Airflow, Python, Flask, Elasticsearch, Unix/Linux, Oracle, PostgreSQL, GitLab
Responsibilities
Develop and maintain complex Apache Airflow DAGs for ETL pipelines; Build and optimize Python-based ETL scripts; Design and manage Elasticsearch indexing workflows; Handle Unix/Linux scripting for automation; Work with Oracle and PostgreSQL for large-scale data processing; Implement and maintain GitLab CI/CD pipelines
Seniority
Senior, hands-on IC