Data Platform Engineer
Core
Build the data backbone for autonomous factories, transforming machine signals, quality events, and work orders into trusted datasets for scheduling, ML, and operations.
Role type
Senior IC data platform engineer (distributed systems)
Builds
Production data infrastructure including ingestion, CDC, streaming, lakehouse storage, orchestration, and transformation pipelines for industrial data.
Domain
Manufacturing / Industrial IoT / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, data modeling, Kafka, Snowflake, Iceberg/Delta/Hudi, Dagster, dbt, Kubernetes, industrial protocols (OPC-UA, MTConnect, MQTT)
Preferred skills
Go, Rust, Scala, ClickHouse, PeerDB, Debezium, Flink, Spark Structured Streaming, Redpanda, regulated-environment experience
Technologies
Kafka, Snowflake, Iceberg, Delta, Hudi, Dagster, dbt, Kubernetes, ClickHouse, PeerDB, Debezium, Flink, Spark, Redpanda, Bufstream, OPC-UA, MTConnect, MQTT
Responsibilities
Build ingestion, CDC, and streaming capabilities for transactional data, events, and telemetry; define versioned data contracts with upstream teams; model telemetry and operational data into datasets with explicit grain and history; own Dagster orchestration, data CI/CD, backfills, lineage, and observability; collaborate with Manufacturing Operations to acquire data from machines and PLCs.
Seniority
Senior, hands-on IC