AWS Lead Software Engineer - Big Data ETL
Core
Design, code, test, and deliver automation including LLMs and agents to reduce manual operational work and streamline remediation efforts.
Role type
Lead Software Engineer (Big Data ETL & AI Automation)
Builds
Scalable data processing and Big Data/ETL pipelines, automation tools, and resilient production services.
Domain
Financial Services / Cloud Infrastructure / Big Data
Required skills
Java, Python, AWS, Docker, Kubernetes, ETL pipeline design, SRE practices, network troubleshooting, AI-assisted development validation, security compliance
Preferred skills
AWS certification (Cloud Practitioner, Solutions Architect, SysOps, Developer), DevOps/automation certifications (CI/CD, IaC)
Technologies
AWS, Java, Python, Docker, Kubernetes, Datadog, Dynatrace, Grafana, Prometheus, Splunk, CI/CD, IAM
Responsibilities
Design and deliver automation including LLMs and agents; govern application risk, controls, and compliance; own security and data accountability; coordinate across product and engineering teams; run resilient production services end-to-end; demonstrate and champion site reliability culture; lead initiatives to improve reliability using data-driven analytics; drive adoption of enterprise-authorized AI-assisted engineering practices.
Seniority
Lead, hands-on IC with team influence