Sr. Data Engineer
Core
Building the Unified Data Foundation (UDF) on Databricks to power BI dashboards, in-product reports, ML models, and AI agents (Penny) for 24,000+ nonprofits.
Role type
Senior IC Data Engineer (Lakehouse & AI-Native)
Builds
Production data pipelines, curated/presentation layers, and identity resolution systems on a Databricks lakehouse.
Domain
Nonprofit fundraising technology / Data Engineering / AI Infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Databricks (Unity Catalog), PySpark, SQL, Data Vault 2.0 modeling, Entity Resolution/Master Data Management, Change Data Capture (CDC), Streaming (Kafka/MSK), CI/CD (Databricks Asset Bundles), Observability (Honeycomb/MLflow), AI coding tools (Claude/Cursor)
Preferred skills
dbt, AWS (S3/IAM), Multi-tenant SaaS experience, Nonprofit/CRM domain knowledge
Technologies
Databricks, Unity Catalog, PySpark, Kafka, MSK, Debezium, Honeycomb, MLflow, Langfuse, Claude Code, Cursor
Responsibilities
Design and ship production pipelines using medallion architecture; Build and harden unified domain models and reporting views; Resolve identity across CRM, Fundraising, and Volunteer systems; Implement near-real-time data flows via CDC; Extend observability tooling to ETL pipelines; Partner with AI engineers to ensure data readiness for Penny.
Seniority
Senior, hands-on IC