Data Engineer
Core
Architect high-performance data infrastructure and real-time pipelines to power autonomous systems and agentic AI reasoning over complex enterprise environments.
Role type
AI Data Engineer (Infrastructure & Pipelines)
Builds
Real-time data pipelines, vector databases, semantic layers, and knowledge graphs for agentic AI.
Domain
Enterprise IT modernization, Autonomous Systems, AI Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Data mining, ETL processes, Data pipelines development, Relational and NoSQL databases, Vector database management, Semantic layer engineering, CI/CD pipeline management
Preferred skills
Cloud modernization, Data modelling, Professional data engineering certifications, Cloud platform certifications, Social coding and IDEs
Technologies
Glue, Databricks, Synapse, Dataproc, Pinecone, Milvus, Weaviate, PostgreSQL, DB2, MongoDB, GitHub, Visual Studio
Responsibilities
Design and scale RAG pipelines for Retrieval-Augmented Generation, Ensure health and performance of vector databases, Build knowledge graphs and semantic layers, Automate data guardrails for noise/bias/PII detection, Resolve data quality issues at the source, Build and maintain CI/CD pipelines for data infrastructure
