AI/Data Engineer
Core
Designing and shipping data ingestion, vector indexing, and RAG pipelines for an enterprise AI search application.
Role type
AI/Data Engineer (RAG & Enterprise Search)
Builds
Scalable ingestion pipelines, semantic chunking strategies, hybrid search systems, full RAG pipelines, and agentic workflows.
Domain
Enterprise AI, Search, Retrieval-Augmented Generation
Deliverable
production ML models | product features
Required skills
Python, data engineering fundamentals, Elasticsearch/OpenSearch/Azure AI Search, LLM orchestration frameworks (LangChain/LlamaIndex/Haystack), embedding models, cross-encoders, re-ranking, retrieval techniques, agentic AI workflow, tool-calling
Preferred skills
None stated
Technologies
Python, Elasticsearch, OpenSearch, Azure AI Search, LangChain, LlamaIndex, Haystack, FastAPI, PDF, Word, PPT, HTML
Responsibilities
Design and build scalable data ingestion pipelines from SharePoint, web crawls, and enterprise content sources; implement semantic chunking and document conversion; develop hybrid search combining keyword, vector, and metadata filtering; construct full RAG pipelines with retrieval and prompt orchestration; build agentic workflows with tool calling and API integration; deploy secure, scalable FastAPI endpoints.
Seniority
Mid-level, hands-on IC