Technical Lead/Architect (Temporal & Apache Kafka required)
Core
Define technical vision and architecture for enterprise-wide, next-generation event-driven data platforms bridging streaming topologies, distributed workflow orchestration, and federated data governance.
Role type
Senior IC Technical Lead / Architect (Data & Streaming Platforms)
Builds
Ultra-high-throughput streaming topologies, stateful distributed workflow orchestration, and resilient Lakehouse/warehouse architectures.
Domain
Data Engineering, Distributed Systems, Real-time Streaming
Deliverable
production ML models
Required skills
Apache Kafka architecture, Temporal workflow orchestration, Schema Registry management, Distributed transaction patterns (Saga), Lakehouse architecture (Snowflake/Databricks), Python/Go/Java, Data modeling (Data Vault/Semantic Layer), Observability platforms, Cloud cost optimization.
Preferred skills
Experience with Cadence, Kafka Streams/Flink, Great Expectations/Pandera/Pydantic, dbt, ADR authoring.
Technologies
Apache Kafka, Temporal, Apache Spark, PySpark, Snowflake, Databricks, BigQuery, Confluent, AWS Glue, Avro, Protobuf, JSON Schema, Python, Go, Java, Scala.
Responsibilities
Define multi-year technical roadmap and reference architecture for real-time streaming infrastructure; Architect and govern multi-tenant Apache Kafka ecosystems ensuring sub-second latencies and exactly-once processing; Formulate and enforce company-wide data governance and automated contract testing; Architect long-running, fault-tolerant workflow topologies using Temporal; Direct design and operational scaling of large-scale distributed computing workloads on Lakehouse platforms; Implement comprehensive observability platforms and cloud infrastructure cost optimization frameworks; Act as technical authority establishing engineering standards and mentoring senior talent.
Seniority
Senior, hands-on IC with mentorship responsibilities