Senior Data Engineer
Core
Build and operate governed data products, pipelines, and dimensional models powering analytics, reporting, and AI/ML for 100+ universities.
Role type
Senior IC data engineer (technical lead)
Builds
Scalable data pipelines, Kimball dimensional models, and MLOps workflows on a Delta Lakehouse
Domain
Education technology / Data engineering
Deliverable
production ML models | product features
Required skills
PySpark, SQL, dbt, Unity Catalog, MLflow, MLOps, Kimball dimensional modeling, offshore vendor coordination
Preferred skills
Real-time streaming (Kafka, Structured Streaming), Salesforce data modeling, cost governance, containerization (Docker), BI tools
Technologies
Databricks, Delta Lake, dbt, Unity Catalog, MLflow, PySpark, SQL, Kafka, Azure Event Hubs, Docker, Power BI, Tableau
Responsibilities
Design and own scalable data pipelines and dimensional models; Ingest data from operational and SaaS sources; Develop and test transformations in dbt with CI discipline; Manage data assets and governance in Unity Catalog; Optimize performance and cost via Spark tuning; Operationalize ML workflows using MLflow; Coordinate and quality-check offshore vendor deliverables; Collaborate with stakeholders to ensure data accuracy and governance; Mentor engineers and set technical standards.
Seniority
Senior, hands-on IC with technical lead responsibilities
