Senior Lead Data & AI Engineer
Core
Architect and deploy AI agents into business workflows, focusing on Databricks and AWS environments to power real-time business decisions.
Role type
Senior Lead Data & AI Engineer
Builds
Scalable, production-grade AI architectures and agent-driven systems
Domain
Cloud-native data engineering and AI orchestration (Databricks, AWS)
Deliverable
production ML models
Required skills
AI agent orchestration, lakehouse architecture, data pipeline automation, event-driven architectures, AI observability, metadata management, scalable system design
Preferred skills
RAG, Graph RAG, MCP-enabled integrations, LangGraph, AgentOps, AgentBricks, SageMaker, Bedrock, Unity Catalog, AWS Glue
Technologies
Databricks, AWS, Delta Live Tables, Lakeflow, MWAA, Step Functions, SageMaker, Bedrock, Unity Catalog, AWS Glue, LangGraph, AgentOps, AgentBricks
Responsibilities
Architect reusable metadata-driven data and AI engineering frameworks; Deploy Delta Live Tables and Lakeflow jobs for automated data processing and AI pipelines; Orchestrate AI agent deployments across business workflows using Databricks Workflows; Integrate Lakeflow for real-time data stream processing; Ensure seamless orchestration between AI models and data pipelines using event-driven architectures; Implement and orchestrate AI agents using frameworks like Agentic systems, AgentOps, and Agent-bricks; Manage AI agent lifecycles, monitoring, and scaling using SageMaker, Bedrock, or AWS orchestration frameworks; Ensure robust data governance, metadata management, and AI observability; Design for scalability and modularity to ensure AI agents are reusable across business processes
Seniority
Senior, hands-on IC with leadership responsibilities
