Lead Software Engineer - Databricks/AWS
Core
Design, develop, and troubleshoot secure software solutions and data pipelines using cloud-native technologies to support enterprise functions.
Role type
Lead Software Engineer (Data Engineering & Cloud)
Builds
Production code, ETL pipelines, data solutions, and API-driven applications on AWS.
Domain
Financial Services / Cloud Infrastructure / Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
System design, application development, statistical data analysis, Python, ETL, Spark, Snowflake, SQL, NoSQL, Terraform, AWS services (ECS, Lambda, API Gateway), CI/CD, API-driven development, AI-assisted development validation, data migration, agile practices.
Preferred skills
Experience with FastAPI, Git, Jenkins, Spinnaker, True CD, responsible AI use in engineering, visualizations and reporting, distributed processing.
Technologies
AWS Lambda, API Gateway, ECS, FastAPI, Git, Jenkins, Spinnaker, Terraform, Snowflake, Databricks, Spark, Python, SQL, NoSQL, AI APIs
Responsibilities
Design and develop secure, high-quality production code; drive adoption of AI-assisted engineering practices; implement and manage data solutions in Snowflake; develop workflows and ETL pipelines using Python, Databricks, and Spark; analyze data to identify issues and support decision-making; lead projects and provide technical guidance to junior engineers.
Seniority
Senior, hands-on IC with leadership responsibilities