Software Engineer, Research Data Platform
Core
Build data pipelines, APIs, and tooling for researchers to manage, query, and analyze training data for frontier AI models.
Role type
Senior IC software engineer (research data platform)
Builds
Data pipelines, APIs, libraries, web interfaces, dataset management, and data cataloging tools for internal research use.
Domain
Artificial Intelligence / Machine Learning Research / Data Engineering
Deliverable
product features
Required skills
Software engineering, data-intensive application development, API design, web interface development, user collaboration, iterative requirement gathering, data pipeline construction, storage system integration
Preferred skills
Large-scale ETL, columnar storage formats, query engines, high-volume time series data handling, data cataloging, ML experiment tracking, complex data visualization, full-stack development
Technologies
Spark, BigQuery, DuckDB, Parquet
Responsibilities
Build and operate data pipelines extracting data from research training runs into queryable storage; Design and build APIs, libraries, and web interfaces for data management and exploration; Develop dataset management, data cataloging, and provenance tooling; Embed with research teams to understand workflows and ship solutions; Collaborate with adjacent teams to leverage existing systems.
Seniority
Senior, hands-on IC
