Technical Director, Data Engineering
Core
Design and build scalable data platforms, distributed processing systems, and AI/LLM infrastructure powering products and internal platforms.
Role type
Senior IC Technical Director, Data Engineering
Builds
Production-grade data ingestion, transformation, retrieval pipelines, and AI/LLM systems (RAG, vector search, agentic workflows)
Domain
Enterprise SaaS (Governance, Risk, Compliance) + AI/ML Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Distributed systems architecture, Kubernetes, Spark, Python, API design, Event-driven systems, Vector databases, LLM integration patterns, RAG architectures, CI/CD, Observability
Preferred skills
Java, Go, TypeScript, Search relevance tuning, Semantic retrieval, Legacy platform modernization, Agentic systems
Technologies
Airflow, Elasticsearch, OpenSearch, MongoDB, PostgreSQL, DynamoDB, AWS, AWS CDK, LangChain, LlamaIndex, DSPy
Responsibilities
Design scalable data platforms and distributed processing systems; Develop ingestion and retrieval pipelines for structured/unstructured data; Build systems supporting AI/LLM applications and vector search; Evaluate and standardize frameworks and infrastructure patterns; Improve performance, reliability, and cost efficiency of data systems; Mentor engineers through design reviews and architecture guidance
Seniority
Senior, hands-on IC with architectural leadership
