Lead AI Architect - Data Platform
Core
Design, build, and run the centralized data and AI platform (data lake) powering Banyan's internal functional teams (Finance, M&A, BD) for analytics and safe AI experimentation.
Role type
Lead AI Architect (Player-coach)
Builds
Centralized AWS data lake, reference architecture for AI patterns (RAG, evaluation, observability), and security guardrails for data access.
Domain
Enterprise Data & AI Platform
Deliverable
production ML models | infrastructure
Required skills
AWS data services (S3, Glue, Lake Formation, Athena, Redshift, SageMaker), data lakehouse patterns (Iceberg, Delta, Hudi), orchestration (Airflow, Dagster), Python, SQL, Infrastructure as Code (Terraform, CDK), AI safety & data classification, team leadership.
Preferred skills
Private-equity/holding-company experience, Snowflake or Databricks, early platform hire experience.
Technologies
AWS (S3, Glue, Lake Formation, Athena, Redshift, SageMaker, Bedrock, EKS), Python, SQL, Terraform, CDK, Airflow, Dagster, Iceberg, Delta, Hudi, Anthropic, OpenAI.
Responsibilities
Define target-state data and AI architecture; design and build the AWS-centric data lake; establish data contracts and schema standards; define security, privacy, and AI safety guardrails; partner with business analysts to translate use cases; build and mentor the platform team; own platform reliability, observability, and cost.
Seniority
Lead, hands-on IC with team leadership
