Senior Full Stack Developer
Core
Build and maintain robust data infrastructure, pipelines, and platforms for an AI Centre of Excellence to support intelligent solutions at scale.
Role type
Senior Data Engineer (AI Infrastructure)
Builds
Data pipelines, lakehouse architecture, and feature datasets for ML consumers
Domain
Financial data / AI infrastructure
Deliverable
production ML models
Required skills
Apache Airflow (expert), Kubernetes, Python, Apache Iceberg, Databricks, dbt, ETL/ELT pipeline design
Preferred skills
Apache Kafka, Apache Spark, Infrastructure as Code, Data Governance
Technologies
Apache Airflow, Kubernetes, Apache Iceberg, Databricks, dbt, Python, PySpark, Terraform
Responsibilities
Own Apache Airflow end-to-end including DAG development and Kubernetes deployment; Build fault-tolerant ETL/ELT pipelines; Design and maintain lakehouse architecture using Apache Iceberg; Partner with data scientists to deliver feature pipelines; Instrument pipelines with metrics and alerts; Contribute reusable components and mentor the team
Seniority
Senior, hands-on IC
