Data Engineer AWS, Python & Data Pipelines - 206022
Core
Design, build, test, deploy, and operate secure and reliable data pipelines and engineering services on AWS for business applications, credit operations, reporting, and AI workloads.
Role type
Senior IC data engineer (cloud infrastructure & pipelines)
Builds
Production data ingestion, processing, and integration services
Domain
Financial services / Cloud data engineering
Required skills
Python, AWS, Spark, Kafka, Terraform, Kubernetes/EKS, Airflow, SQL, CI/CD, automated testing
Preferred skills
Banking/financial data experience, AWS certifications, legacy data migrations, dbt, large-scale batch/streaming platforms
Technologies
AWS, Python, Spark, Kafka, Terraform, EKS, Airflow, S3, IAM
Responsibilities
Build and maintain production data pipelines; Develop batch and streaming data ingestion services; Provision and configure AWS infrastructure using Terraform; Implement automated testing, CI/CD, and data validation; Monitor production pipelines and investigate incidents; Apply security controls and optimize pipeline performance; Document technical solutions and data lineage.
Seniority
Senior, hands-on IC
