Big Data Engineering Lead
Core
Lead the Data Foundation platform, building and maintaining enterprise data pipelines, data products, and canonical data models to enable analytics, AI, and operational reporting.
Role type
Senior IC Big Data Engineering Lead
Builds
Enterprise data pipelines, data products, canonical data models, and data services
Domain
Financial, healthcare, and manufacturing sectors; enterprise data platforms
Deliverable
production ML models
Required skills
Technical leadership, Python, PySpark, SQL, data modeling, ETL/ELT architecture, incident reduction, technical debt reduction
Preferred skills
Master Data Management, RESTful APIs, GraphQL, microservices, event-driven processing, data quality frameworks, metadata management, data lineage
Technologies
PySpark, Python, SQL
Responsibilities
Provide technical leadership and engineering delivery for the Data Foundation platform; Lead the team in building and maintaining enterprise data pipelines and data products; Partner with Architecture and Platform teams to deliver scalable data solutions; Ensure data pipeline reliability, performance, and scalability; Drive data quality improvements and reduce technical debt; Increase reuse of canonical data models and engineering frameworks
Seniority
Senior, hands-on IC with leadership responsibilities