Lead Software Engineer, Java/AWS
Core
Design, build, maintain, and optimize resilient ETL data pipelines and data lake/warehouse solutions using Databricks and AWS services.
Role type
Lead Software Engineer (Data Engineering)
Builds
Data pipelines, data lake and data warehouse solutions, observability and automation systems
Domain
Financial services / Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
Java, Python, Apache Spark, Databricks, AWS (EMR, Athena, Glue, S3), CI/CD, DevOps, Infrastructure-as-Code, Leadership/Mentoring
Preferred skills
Spring Boot, RESTful API development, Kubernetes, Docker, Kafka, Financial products knowledge (FX, commodities, equities)
Technologies
Databricks, AWS Lambda, EMR, Athena, Glue, S3, Spark, Kafka, Kubernetes, Docker, Spring Boot, Dynatrace, Splunk, Grafana, Prometheus
Responsibilities
Design and optimize ETL pipelines; architect data lake and warehouse solutions; partner with stakeholders on data engineering best practices; lead and mentor engineers; monitor and troubleshoot pipelines for performance and reliability; promote observability standards and automation.
Seniority
Senior, hands-on IC with leadership responsibilities
