Lead Data Engineer
Core
Design, build, and manage data pipelines and AI solutions (Generative AI, Agentic AI) for the Enterprise Data Organization.
Role type
Lead Data and AI Engineer
Builds
Data ingestion, transformation, distribution, storage, and AI operationalization platforms
Domain
Enterprise Data & Generative AI
Deliverable
production ML models | infrastructure
Required skills
Data pipeline design, Generative AI, Agentic AI, SQL, Python, Cloud platforms (Azure/AWS/GCP), DevOps (CI/CD), Infrastructure as code, LLM agent development, RAG, vector/hybrid search, Apache Airflow, data modeling, performance tuning
Preferred skills
Snowflake, ETL tools (Informatica, Talend, Azure Data Factory), BI tools (Tableau)
Technologies
Azure OpenAI, AI Search, Temporal, Pydantic AI, GitHub Copilot, Azure ADLS, Blob, Tableau, Apache Airflow
Responsibilities
Lead and guide technical data engineering team members; design, develop, and deploy AI solutions from concept to operationalization; implement Infrastructure as code and automated testing strategies; mentor team members and grow engineering culture; collaborate with product owners and architects to design data jobs; develop and enhance data processes (Ingest, Transformation, Store, Management, Quality); establish data engineering best practices; document technical artifacts; integrate emerging AI technologies to improve system performance
Seniority
Senior, hands-on IC with leadership responsibilities