Senior Software Engineer - Data Platform
Core
Design, build, and operate reliable, scalable, and secure infrastructure for ingesting, processing, cataloging, and accessing petabytes of data to power Samsara's data lake and distributed compute platform.
Role type
Senior IC software engineer (data platform infrastructure)
Builds
Core analytical platform, data lake, distributed compute platform, and systems moving data from production stores to lakehouse
Domain
IoT / Cloud Infrastructure / Big Data
Deliverable
production ML models | infrastructure
Required skills
distributed systems, Apache Spark, AWS infrastructure, Go/Python/Scala/Java, scalability, observability, security
Preferred skills
Databricks, Delta Lake, Infrastructure-as-Code (Terraform), data catalogs, orchestration systems (Airflow/Dagster), streaming data, containerization (Docker/Kubernetes)
Technologies
Spark, Databricks, Delta Lake, S3, RDS, DynamoDB, SQS, Kinesis, Lambda, Terraform, Airflow, Docker, Kubernetes
Responsibilities
Design and operate high-scale data ingestion and replication systems; build and maintain reliable data platform infrastructure; improve reliability and developer experience of Spark/Databricks platform; develop internal libraries and tooling in Go/Python; work on foundational data lake/lakehouse technologies; collaborate with cross-functional teams to deliver scalable solutions
Seniority
Senior, hands-on IC