Senior Data Engineer
Core
Design, build, and maintain end-to-end data pipelines, architecture, and design for a warehouse, LLM-driven applications, and AI-based BI.
Role type
Senior Data/ML Engineer (Data Infrastructure & LLM Ops)
Builds
Centralized feature stores, model-training workflows, real-time inference services, and AI-backed BI dashboards.
Domain
Telecommunications / AI & Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, Apache Spark, Hadoop, Kafka, SQL, PLSQL, RDBMS, Cloud databases (Snowflake/Redshift), Unix/Linux, Version control
Preferred skills
Vector databases (DataStax AstraDB), LangChain, LlamaIndex, Prompt engineering, RAG, MLOps, CI/CD, Hugging Face Transformers, LLaMA-4
Technologies
Apache Spark, Hadoop, Kafka, Snowflake, Redshift, DataStax AstraDB, LangChain, LlamaIndex, Hugging Face
Responsibilities
Design scalable data pipelines for ingestion, transformation, and delivery to feature stores and inference services; Build workflows for extracting and storing semantic representations of unstructured data; Architect lightweight analytics and dashboarding solutions with natural language query capabilities; Manage prompt engineering, orchestration flows, and model fine-tuning routines; Oversee vector data stores and develop indexing methodologies for RAG workflows; Partner with stakeholders to translate language-model initiatives into scalable solutions; Create and maintain documentation for data processes and model deployment routines.
Seniority
Senior, hands-on IC