CareerPlan

Sr. Data Engineer AI

San Francisco, CaliforniaFull-time$146k–$235k2026-11-09 → 2026-11-20
Hybrid

Core

Design, develop, and deliver AI-powered features including autonomous agents, RAG systems, and data pipelines for business-critical data analysis.

Role type

Senior individual contributor data engineer (AI/ML)

Builds

AI agent orchestrations, RAG systems, scalable data pipelines, and validated data sets for AI applications.

Domain

Enterprise data analytics and AI/LLM implementation

Deliverable

production ML models

Required skills

Python, Java, SQL, dimensional and relational data modeling, agentic orchestration, RAG-based architectures, LLM implementation, vector database management, data quality validation

Preferred skills

LangChain, Langgraph, CrewAI, Arize, Snowflake, BigQuery, Redshift, AWS, Spark, Data Lake environments, dbt, Matillion, Airflow, Claude Code, Cortex, VSCode Copilot

Technologies

AWS, Snowflake, dbt, Airflow, CrewAI, LangChain, Langgraph, Arize, Vector Databases

Responsibilities

Build and maintain scalable, efficient data pipelines and AI agent orchestrations; Develop and deploy autonomous agents using frameworks like CrewAI and LangChain; Implement Retrieval-Augmented Generation (RAG) systems and manage Vector Databases; Utilize Langgraph/CrewAI for complex stateful multi-agent orchestration; Implement robust Evaluations (e.g., Arize) to monitor and improve model performance; Analyze and develop data quality and validation procedures; Execute projects using Agile Scrum methodologies.

Seniority

Senior, hands-on IC