Senior Software Engineer - Core Services
Core
Build and maintain the shared data access library, SDKs, and event-driven data platform that powers all product teams and customer deployments at Snorkel.
Role type
Senior Software Engineer - Core Services (Data Platform)
Builds
Shared data access libraries, SDKs, event-driven data flows, and governance infrastructure for the Snorkel AI platform.
Domain
AI Infrastructure / Data Engineering / Cloud Native
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, AWS (S3, RDS, EKS, EventBridge, IAM), Kubernetes (EKS), Data Orchestration (Prefect, Airflow, Dagster), Transformation (dbt), AI-assisted development tools (Claude Code, Cursor)
Preferred skills
Building shared libraries/SDKs, Event-driven architectures (CDC, event buses), Observability (OpenTelemetry, ClickHouse), Regulated environments (SOC 2, FedRAMP, HIPAA), Ray
Technologies
Python, FastAPI, dbt, Snowflake, Postgres, RDS, S3, AWS, Terraform, Kubernetes, EKS, EventBridge, OpenTelemetry, Buildkite, GitHub Actions, Prefect, Airflow, Dagster, ClickHouse, Ray
Responsibilities
Design interfaces for data access with auth and RBAC; Implement event-driven data flows with CDC connectors and schema registry; Build lineage tracking, governance, and audit logging systems; Instrument platform with OpenTelemetry and define SLOs; Optimize infrastructure costs and workload sizing.
Seniority
Senior, hands-on IC
