Data Engineer
Core
Architect high-performance data infrastructure and real-time pipelines enabling agentic AI to reason over complex enterprise environments.
Role type
Senior AI Data Engineer
Builds
Real-time data pipelines, RAG systems, vector databases, semantic layers, and CI/CD infrastructure for AI agents.
Domain
Enterprise AI, Data Engineering, Cloud Infrastructure
Deliverable
production ML models
Required skills
Data mining, ETL processes, Data pipelines development, Relational and NoSQL databases, Vector database management, Semantic layer design, Automated data guardrails, CI/CD pipeline management
Preferred skills
Cloud modernization, Data modelling, Professional data engineering certifications, Cloud platform certifications, Social coding and IDEs
Technologies
Glue, Databricks, Synapse, Dataproc, PostgreSQL, DB2, MongoDB, Pinecone, Milvus, Weaviate, GitHub, Visual Studio
Responsibilities
Design and scale pipelines for Retrieval-Augmented Generation (RAG), ensure health and performance of vector databases, build knowledge graphs and semantic layers, automate data quality guardrails, resolve data quality issues at the source, build and maintain CI/CD pipelines for data infrastructure
Seniority
Senior, hands-on IC