Senior Data Platform Engineer - Weights & Biases
Core
Design and operate enterprise data platforms, pipelines, and orchestration frameworks to support the full AI lifecycle including model training, inference, and agent building.
Role type
Senior IC data platform engineer
Builds
Scalable distributed data pipelines, transformation frameworks, data warehouses, telemetry systems, and data catalog/semantic layers
Domain
AI infrastructure, cloud data platforms, distributed systems
Deliverable
production ML models
Required skills
Python, Go, Java, Scala, SQL, dbt, Dagster, Airflow, distributed systems, data modeling, performance optimization, CI/CD, event instrumentation
Preferred skills
Multi-petabyte data platforms, AWS/GCP/Azure, data catalogs, metadata management, ML workflows
Technologies
dbt, Dagster, Airflow, Python, Go, Java, Scala, SQL
Responsibilities
Architect and maintain distributed batch and streaming pipelines; Build and optimize data transformation and orchestration workflows; Design data models and storage strategies for large-scale analytical workloads; Implement telemetry, logging, and instrumentation for distributed systems; Design metadata, lineage, and semantic-modeling systems; Support data interfaces for internal AI applications; Monitor production systems and participate in on-call rotation
