AWS Data Engineer
Core
Design and implement large-scale data pipelines and architectures on AWS for financial institutions, handling ingestion, transformation, and storage.
Role type
Senior AWS Data Engineer
Builds
Data pipelines, data models, and cloud data solutions for financial clients
Domain
Finance + Cloud Data Engineering
Deliverable
production ML models
Required skills
AWS Glue (PySpark/Spark), Python/C#, SQL, ETL, Data Modeling, AWS Lambda, RDBMS (Postgres/SQL Server/MySQL), Kafka, CI/CD, DevOps
Preferred skills
AWS Certified Machine Learning – Specialty, Financial industry experience, Realtime ingestion expertise
Technologies
AWS (S3, RDS, Redshift, Lambda, DynamoDB, Kinesis, IAM), PySpark, Kafka, PowerShell, Bash
Responsibilities
Design and implement complex data solutions (batch/streaming), ingest data into AWS S3, perform ETL into RDS/Redshift, utilize AWS Lambda for event-driven transformations, design security measures, maintain data integrity via backup/recovery, automate migration processes, deliver data content for business decisions, manage SDLC delivery.
Seniority
Senior, hands-on IC