Lead Software Engineer - Big Data
Core
Lead Software Engineer owning development of software products, improving product quality throughout the SDLC, and mentoring other engineers.
Role type
Senior IC Lead Software Engineer (Big Data)
Builds
Scalable, distributed data processing solutions and enterprise-level applications
Domain
Financial Services / Big Data Engineering
Deliverable
production ML models
Required skills
Hadoop, Spark, Hive, Trino, Python, Scala, SQL, AWS (S3, EMR, Glue, Lambda, Athena, EKS), System Design, DevOps/CI/CD, Object-Oriented Development, Performance Tuning, Data Modeling
Preferred skills
AI tool proficiency (Copilot, Q Developer, ChatGPT), Agile/Scrum/Kanban, Test Automation
Technologies
Hadoop, Spark, Hive, Trino, Python, Scala, AWS, Kubernetes, Docker
Responsibilities
Design and develop industry-leading solutions meeting quality standards; manage processes and projects to improve efficiency; coach and train less experienced colleagues; identify gaps between system components and deliver solutions; implement methods for managing software development environments; analyze software development trends and communicate integration recommendations.
Seniority
Senior, hands-on IC with mentorship
