Staff Engineer, Data Platform
Core
Designing and operating the core data infrastructure that ingests, stores, transforms, and serves scientific data and literature to enable automated discovery.
Role type
Staff Engineer, Data Platform
Builds
Ingestion frameworks, storage architecture, orchestration systems, and data models for scientific and ML workflows.
Domain
Life sciences / Data Engineering
Deliverable
infrastructure
Required skills
Python, SQL, relational and NoSQL databases, schema design, cloud infrastructure, containerized deployment, modern table formats (Iceberg, Delta Lake, Hudi)
Preferred skills
Workflow orchestration (Flyte, Airflow, Dagster), vector databases, RAG infrastructure, AI-assisted development tools
Technologies
AWS, Kubernetes, Iceberg, Delta Lake, Hudi, Flyte, Airflow, Dagster
Responsibilities
Design and evolve core data infrastructure; build reliable data ingestion pipelines; operate and extend workflow orchestration systems; define data models and schema evolution practices; partner with researchers to translate requirements into platform capabilities; establish engineering standards and mentor engineers.
Seniority
Staff, technical leadership & mentorship