Lead Data Engineer
Core
Lead senior data engineers to build and run a modern cloud data hub, creating scalable data pipelines and AI-ready platforms to support academic and administrative decision-making at the University of Texas at Austin.
Role type
Lead Data Engineer (Technical Leadership & Team Management)
Builds
Production-grade lakehouse data pipelines, AI-ready data platforms, and data governance systems on AWS and Databricks.
Domain
Higher Education / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, PySpark, SQL, Databricks, AWS (Glue, S3, Lambda, Redshift), Delta Lake, Terraform, CI/CD, Team Leadership, Data Modeling, Data Governance
Preferred skills
AI/ML integration, Data Observability, Agile Project Management, Technical Mentoring
Technologies
Databricks, AWS, Delta Lake, Unity Catalog, Spark, Terraform, GitHub Actions
Responsibilities
Design and architect scalable data pipelines and AI-ready platforms; Lead and mentor a team of 2–5 data engineers; Define project milestones and manage cross-functional stakeholders; Implement data quality, observability, and governance frameworks; Conduct code reviews and drive technical knowledge sharing.
Seniority
Senior, hands-on IC with management responsibilities
