Lead Data Engineer
Core
Leads a data engineering team to build, integrate, and maintain scalable applications and ETL workflows within a big data platform, ensuring data quality and security across the organization.
Role type
Senior IC Lead Data Engineer (Big Data Platform)
Builds
Scalable data applications, ETL pipelines, and data warehouse solutions
Domain
Insurance / Financial services / Big Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
SQL/NoSQL, Python (ETL), Big Data batch computing (Hadoop/Spark), Cloud platforms (AWS/GCP/Azure), Data modeling (dimensional/star schemas), Database internals, Infrastructure-as-code (Docker/Terraform), CI/CD workflows
Preferred skills
Machine learning toolkits (sklearn/SparkML/H2O), Web services development, Business acumen in insurance/finance
Technologies
Hadoop, Spark, AWS, GCP, Azure, Docker, CloudFormation, Terraform, Jenkins, Git, RDBMS, analytic databases, document stores
Responsibilities
Lead engineering team to meet project deadlines; Supervise data engineering team members; Ensure data quality, completeness, security, and privacy; Develop scalable code for data loading and manipulation; Provide technical oversight on application architecture; Create maintainable, reusable code and libraries
Seniority
Senior, hands-on IC with team leadership
