Senior Airflow/ Cloud Engineer (Workload Automation)
Core
Architect, design, and develop features for centralized workload automation platforms (Control-M, Automic, Airflow, Google Cloud Composer) serving the bank's batch job management and API orchestration needs.
Role type
Senior IC Airflow/Cloud Engineer (Workload Automation)
Builds
Production workload automation services and batch scheduling pipelines
Domain
Banking / Cloud Infrastructure & Workflow Orchestration
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Apache Airflow, Google Cloud Platform (GCP), Control-M, Automic, REST API orchestration, Terraform, Ansible YAML, DAG design and performance tuning, cluster configuration and monitoring
Preferred skills
ServiceNOW integration, BigQuery, Dataflow, Cloud Functions, Dataproc, Google Transfer Service, Postgres
Technologies
Apache Airflow, Google Cloud Composer, Control-M, Automic, Terraform, Ansible, ServiceNOW, BigQuery, Dataflow, Cloud Functions, Dataproc, Google Transfer Service, Postgres
Responsibilities
Drive adoption of Apache Airflow within the IT landscape; Design and implement concepts for replacing legacy automation tools (Control-M/Automic) with Airflow or GCP solutions; Integrate, configure, upgrade, and maintain critical workload automation products; Develop guidelines for Airflow clusters and optimize DAG performance; Identify automation opportunities and execute development activities independently.
Seniority
Senior, hands-on IC