Lead Data Engineer
Core
Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions.
Role type
Lead Data Engineer
Builds
End-to-end data solutions, data processing pipelines, and scalable data models
Domain
Technology Consultancy / Big Data
Deliverable
production ML models
Required skills
System design, Big Data architecture, Data pipeline development, Data modeling, Distributed systems, SQL/NoSQL databases, Data governance, Data security, Data privacy, Stakeholder management
Preferred skills
Coaching and mentoring, Technical leadership, Risk management, Continuous delivery practices
Technologies
Distributed storage platforms, Distributed processing platforms, TDD, Continuous delivery tools
Responsibilities
Lead and manage data engineering projects from inception to completion, Design and develop intricate data processing pipelines, Collaborate with data scientists to design scalable implementations, Lead the team to implement technical solutions, Define strategy for data quality, Ensure data governance, security, and privacy compliance
Seniority
Senior, hands-on IC with leadership responsibilities