CareerPlan

Data Engineer (Temporal & Apache Kafka required)

McLean, VAFull-time$90k–$154k2026-11-16 → 2026-11-22

Core

Design, build, and scale event-driven data platforms bridging high-throughput distributed streaming with complex, fault-tolerant workflow orchestration and strict data governance.

Role type

Senior Data Engineer (Event Streaming & Workflow Orchestration)

Builds

Resilient, distributed, stateful workflows and data pipelines for clients

Domain

Data Engineering, Distributed Systems, Real-time Streaming

Required skills

Apache Kafka, Temporal, Python, Apache Spark, SQL, Data Schema Design, Data Modeling, ETL/ELT Pipeline Development, Data Quality Automation

Preferred skills

Go, Java, Cloud Data Warehouses (Snowflake, BigQuery, Databricks, Redshift), Schema Registry management

Technologies

Apache Kafka, Temporal, Python, Apache Spark, Snowflake, BigQuery, Databricks, Redshift, Avro, Protobuf, JSON Schema, Confluent Schema Registry, AWS Glue Schema Registry, Great Expectations, Pandera, Pydantic, dbt

Responsibilities

Architect and maintain high-volume distributed data streams using Apache Kafka; Design and enforce data schema standards and automated validation; Implement durable execution workflows using Temporal; Build end-to-end batch and near-real-time pipelines; Design and optimize analytical data models in cloud data warehouses; Implement automated testing and data quality checks; Partner with engineers to define data contracts and CI/CD patterns

Seniority

Senior, hands-on IC