Data Engineer (Temporal & Apache Kafka required)
Core
Design, build, and scale event-driven data platforms bridging high-throughput distributed streaming with complex, fault-tolerant workflow orchestration and strict data governance.
Role type
Senior Data Engineer (Event Streaming & Workflow Orchestration)
Builds
Resilient, distributed, stateful workflows and data pipelines for clients
Domain
Data Engineering, Distributed Systems, Real-time Streaming
Required skills
Apache Kafka, Temporal, Python, Apache Spark, SQL, Data Schema Design, Data Modeling, ETL/ELT Pipeline Development, Data Quality Automation
Preferred skills
Go, Java, Cloud Data Warehouses (Snowflake, BigQuery, Databricks, Redshift), Schema Registry management
Technologies
Apache Kafka, Temporal, Python, Apache Spark, Snowflake, BigQuery, Databricks, Redshift, Avro, Protobuf, JSON Schema, Confluent Schema Registry, AWS Glue Schema Registry, Great Expectations, Pandera, Pydantic, dbt
Responsibilities
Architect and maintain high-volume distributed data streams using Apache Kafka; Design and enforce data schema standards and automated validation; Implement durable execution workflows using Temporal; Build end-to-end batch and near-real-time pipelines; Design and optimize analytical data models in cloud data warehouses; Implement automated testing and data quality checks; Partner with engineers to define data contracts and CI/CD patterns
Seniority
Senior, hands-on IC