Senior Data Platform Engineer AWS, Spark
Core
Design, build, test, and maintain AWS-based data pipelines and data lake solutions for fraud-related data assets, connecting them into Experian's Data Analytics Platform.
Role type
Senior hands-on IC data platform engineer
Builds
AWS data pipelines, data lake solutions, and integrations for fraud data
Domain
Financial services / Data engineering
Deliverable
production ML models
Required skills
AWS data services (Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge, SQS), Apache Spark, Scala/Python, Terraform, CI/CD, Infrastructure as Code, DevSecOps
Preferred skills
AWS Developer Certification, Kubernetes/OpenShift, automated testing (pytest/Scalatest), RESTful APIs, data mesh concepts
Technologies
AWS, Terraform, Git, Jenkins, Apache Spark, Snowflake
Responsibilities
Design and build AWS data pipelines; support data ingestion and transformation; develop new data flows and automation; ensure security and compliance patterns; contribute to technical design discussions; produce documentation; support junior engineers
Seniority
Senior, hands-on IC
