Senior Data Engineer (with AI/ML experience) India
Core
Designing, building, and maintaining end-to-end data pipelines, architecture, and design for a warehouse, LLM-driven applications, and AI-based BI.
Role type
Senior Data Engineer (AI/ML & LLM focus)
Builds
Centralized feature stores, model-training workflows, real-time inference services, and LLM-powered applications
Domain
Financial services / Communications / AI & Machine Learning
Deliverable
production ML models | product features | infrastructure
Required skills
Apache Spark, Hadoop, Kafka, SQL, PLSQL, Python, Snowflake, Redshift, Vector databases, RAG architectures, Open-source LLM frameworks, AWS/Azure Machine Learning, Unix/Linux/Windows, Version control systems
Preferred skills
DataStax AstraDB, LangChain, LlamaIndex, Hugging Face Transformers, LLaMA-4, MLOps tooling, CI/CD pipelines
Responsibilities
Design scalable data pipelines for ingestion, transformation, and delivery into feature stores and inference services; Optimize ETL/ELT pipelines and data structures within cloud data warehouses; Build workflows for extracting and storing semantic representations of unstructured data; Architect analytics and dashboarding solutions for natural language query experiences; Manage prompt engineering, orchestration flows, and model fine-tuning routines; Oversee vector data stores and develop indexing methodologies for RAG workflows; Partner with stakeholders to translate language-model initiatives into scalable solutions; Create and maintain documentation for data processes and model deployment routines
Seniority
Senior, hands-on IC
