Head of Data
Core
Foundational leader building a dedicated data organization to source, process, and refine high-value training data for an Australian AI stack (Matilda), focusing on web-scale crawling, licensing, and quality control.
Role type
Senior IC Head of Data (Data Engineering & Model Training)
Builds
Comprehensive, high-quality Australian training data catalog and petabyte-scale data pipelines for frontier model training.
Domain
Artificial Intelligence / Large Language Models / Data Engineering
Deliverable
production ML models
Required skills
Leading data engineering and ML teams at scale, distributed data processing frameworks, petabyte-scale storage systems, web scraping and data extraction pipelines, proprietary dataset sourcing and licensing, data governance and privacy standards, recruiting elite technical talent.
Preferred skills
Building pre-training or post-training datasets for LLMs, network within Australian technology/academic/media ecosystem for data partnerships.
Technologies
Distributed data processing frameworks, petabyte-scale storage systems, web scraping tools, text processing frameworks.
Responsibilities
Build and lead a high-performing team of data engineers and ML specialists; Design and manage architecture for web-scale data crawling, ingestion, and storage; Develop robust pipelines for data filtering, cleaning, deduplication, and formatting; Source and secure proprietary datasets tailored to the Australian context; Work with core training teams to iterate on data mixtures and evaluate quality; Establish operational standards for data governance, privacy, and security.
Seniority
Senior, hands-on IC leader
