Senior Team Lead - Data Pipelines & Agentic Web Extraction
Core
Lead a team of 6 engineers to own the data-pipeline infrastructure for ingesting web data at scale and the agentic AI system that generates Extraction Templates for turning webpages into structured data.
Role type
Senior Team Lead (Backend & AI)
Builds
Data-pipeline infrastructure and Agentic AI systems for web extraction
Domain
Enterprise AI, Web Intelligence, Data Engineering
Deliverable
production ML models (via careerplan.io/jobs/09-00F-CF-271-senior-team-lead-data-pipelines-agentic-web-extraction-at-nimbleway)
Required skills
Team leadership, Backend engineering, Python, LLMs, Agentic architectures, AI/LLMOps, System design, Stakeholder management
Preferred skills
Startup experience, Enterprise experience, AI product shipping
Technologies
Python, LLMs, Agentic frameworks
Responsibilities
Own end-to-end architecture and delivery of data-pipeline infrastructure; Analyze and improve pipeline efficiency, scalability, and stability; Design and implement supporting interfaces (API, UI, Plugins); Mentor team on AI-native development practices; Improve Extraction Template generation capability's coverage and accuracy; Make build-vs-buy and architecture calls for AI systems.
Seniority
Senior, hands-on IC with leadership
