Airflow Python Developer
Core
Design, build, and orchestrate scalable ETL/ELT data pipelines and automation workflows using Python and Apache Airflow.
Role type
Python Data Engineer (Data Pipeline & Orchestration)
Builds
Automated data ingestion, transformation, and scheduling workflows for cloud data platforms.
Domain
Cloud Data Engineering / ETL/ELT
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python (advanced scripting/automation), Apache Airflow (DAG design, orchestration), SQL (advanced querying, optimization), AWS services (S3, Glue, Lambda, Athena), ETL/ELT workflows, data validation, data quality checks
Preferred skills
Snowflake, Redshift, BigQuery, Databricks, Git, CI-CD
Technologies
Apache Airflow, AWS, Snowflake, Python, SQL
Responsibilities
Develop and maintain data pipelines using Python, Airflow DAGs, and AWS/Snowflake components; Build and automate data ingestion, transformation, and scheduling workflows; Develop Airflow DAGs including custom operators, sensors, hooks, and manage pipeline monitoring; Work on Snowflake-based ELT solutions including data loads, stored procedures, and queries; Write efficient SQL queries and optimize performance for data transformations; Troubleshoot pipeline failures and ensure high availability of production workflows
Seniority
Mid-level, hands-on IC
