Principal Data Engineer, LLM/AI Platforms (Remote)
Core
Design, build, and deploy cutting-edge data infrastructure and AI platforms to power next-generation AI-driven security products at Exabyte scale.
Role type
Principal Data Engineer (LLM/AI Platforms)
Builds
Scalable data platforms, pipelines, and agentic workflows for LLMs and RAG systems
Domain
Cybersecurity, Large Language Models, Distributed Systems
Deliverable
production ML models | infrastructure
Required skills
LLM engineering (fine-tuning, deployment), RAG, agentic workflows, distributed data processing (Spark, Dask, Flink), cloud platforms (AWS, GCP, OCI), containerization (Docker, Kubernetes), data warehousing (Snowflake, BigQuery), MLOps/DataOps
Preferred skills
Cybersecurity industry experience, open-source contributions
Technologies
MLflow, Sagemaker, Vertex AI, LangChain, LlamaIndex, Kafka, Pulsar, Airflow, Kubeflow
Responsibilities
Architect and optimize data platforms for LLMs and agentic systems; drive adoption of agentic workflows; design fault-tolerant data solutions; write production-ready code; provide technical leadership in data modeling and semantic cataloging; establish MLOps best practices; mentor engineers; collaborate to transform prototypes into production services; own end-to-end lifecycle of critical data services
Seniority
Principal, hands-on IC with technical leadership