Senior Staff Data Engineer
Core
Design and build petabyte-scale data pipelines to ingest, transform, and curate heterogeneous biological data (genomic, imaging, sequences) for training frontier AI models in disease research.
Role type
Senior Staff Data Engineer (AI Infrastructure)
Builds
Large-scale data platforms, automated dataset curation agents, and AI-ready training datasets
Domain
Biomedical research / Biological AI / Genomics
Deliverable
production ML models
Required skills
Distributed computing frameworks (Databricks, Spark, Ray), Infrastructure as Code (Terraform, CDK), Cloud infrastructure (AWS), Petabyte-scale data system design, Data pipeline reliability, Observability
Preferred skills
Computational biology, Bioinformatics, Genomics data formats (FASTQ, BAM, VCF), Imaging formats (OME-Zarr, HDF5), AI-native development practices
Technologies
Databricks, Spark, Ray, Terraform, CDK, AWS, Claude Code, LLMs
Responsibilities
Design and build data pipelines processing genomic and imaging data at petabyte scale; Solve performance and bandwidth challenges; Build agent-based systems for automated dataset curation and quality control; Create tooling for data cataloging and registration; Collaborate with AI Research teams to translate model requirements into data specifications; Improve pipeline reliability and observability
Seniority
Senior Staff, hands-on IC with significant autonomy