Senior Data Engineer
Core
Own end-to-end Databricks data lake, build AI data infrastructure (embedding pipelines, vector stores, feature stores), and maintain cloud databases for an AI operating system serving insurance agencies.
Role type
Senior Data Engineer (AI Infrastructure)
Builds
AI data infrastructure, data pipelines, vector stores, retrieval knowledge bases, and analytics dashboards for insurance agencies.
Domain
Insurtech / AI Infrastructure
Deliverable
production ML models
Required skills
Python, SQL, Databricks, dbt, Cloud platforms (AWS/Azure/GCP), Data modeling (Medallion/Star schema), CDC/Streaming ingestion, Data governance
Preferred skills
Vector databases (Pinecone, AWS Bedrock), LLM observability, Multi-tenant system design
Technologies
Databricks, dbt, AWS, Azure, GCP, Postgres, DynamoDB, HubSpot, Langfuse, Apache Airflow, Dagster, Tableau, Power BI
Responsibilities
Own Databricks data lake end-to-end; Stand up CDC and streaming ingestion; Build AI data infrastructure (embedding pipelines, vector stores); Develop and maintain cloud databases; Maintain data management and security policies; Mentor engineers in data best practices.
Seniority
Senior, hands-on IC
