Senior Data Engineer - Agentic AI Engineering
Core
Architecting and building scalable, secure data infrastructure to power agentic AI systems, including LLM-based agents and multi-agent workflows.
Role type
Senior Data Engineer (Agentic AI)
Builds
Robust batch and real-time data pipelines, vector database solutions, and data frameworks for AI training and evaluation.
Domain
Agentic AI / Enterprise Data Infrastructure
Deliverable
production ML models
Required skills
Python, SQL, batch and real-time data pipelines, streaming systems (Kafka/Kinesis), cloud platforms (AWS/Azure/GCP), Snowflake, vector databases (Pinecone/Milvus), DataOps/MLOps tools (Airflow/dbt/Lavender/MLflow), data governance and security.
Preferred skills
agentic AI systems, multi-agent architectures, agent memory models, synthetic data generation, prompt engineering workflows.
Technologies
Kafka, Kinesis, Snowflake, Pinecone, Milvus, Airflow, dbt, Lavender, MLflow, AWS, Azure, GCP
Responsibilities
Architect scalable data infrastructure for LLM-based agents; design and operate data pipelines for embeddings and RAG; develop vector database solutions; build frameworks for AI system evaluation; implement data governance and security controls; optimize data systems for performance and cost.
Seniority
Senior, hands-on IC
