Senior Data Engineer
Core
Design and build scalable end-to-end data pipelines powering BI, AI, and LLM-driven applications, including ingestion, transformation, feature stores, and real-time inference.
Role type
Senior Data Engineer (LLM & MLOps focus)
Builds
Scalable data pipelines, feature stores, real-time inference services, and LLM-powered applications
Domain
Data Engineering, AI/ML, LLM Operations
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Apache Spark, Hadoop, Kafka, SQL, PL/SQL, Snowflake, Amazon Redshift, Unix/Linux, Vector databases, RAG, Prompt engineering, LangChain, LlamaIndex, MLOps, CI/CD
Preferred skills
DataStax AstraDB, Hugging Face Transformers, LLaMA-4, fine-tuning, inference optimization
Responsibilities
Design and maintain scalable data pipelines for ingestion, transformation, and delivery to feature stores and inference services; Build processes for extracting, storing, and retrieving semantic representations of unstructured data; Develop lightweight analytics and dashboarding solutions for natural-language querying; Define and manage prompt engineering techniques, orchestration workflows, and model fine-tuning; Oversee vector data stores and implement indexing strategies for RAG workflows; Create and maintain comprehensive documentation for data processes and model deployment routines
Seniority
Senior, hands-on IC