Lead Data Mesh Engineer
Core
Architect and deliver an enterprise-grade, Everything-as-Code Data Mesh, transforming corporate IT into an automated software factory by owning high-throughput, asynchronous event-streaming infrastructure and hybrid data pipelines.
Role type
Lead Data Mesh Engineer (Infrastructure & Architecture)
Builds
Multi-cloud event-streaming backbone (AWS MSK, Apache NiFi on EKS) and hybrid data lakehouse integrations
Domain
Cloud Infrastructure, Data Engineering, Event Streaming
Deliverable
production ML models | infrastructure
Required skills
Apache Kafka (AWS MSK), Apache NiFi, Kubernetes (EKS), Terraform, GitOps (ArgoCD/Flux), Apache Avro, AsyncAPI, Schema Registry, OpenTelemetry, Distributed Tracing
Preferred skills
Policy-as-Code (Open Policy Agent/Rego)
Responsibilities
Architect and provision multi-AZ AWS MSK clusters and Apache NiFi runtimes on EKS using Terraform and GitOps; Integrate vendor-neutral Schema Registries to enforce Apache Avro and AsyncAPI data contracts; Implement high-performance partition strategies, dynamic storage auto-scaling, and payload compression for FinOps optimization; Build fault-tolerant Dead Letter Queue automated replay loops and ensure out-of-band tracing context propagation across service hops
Seniority
Mid-Senior, hands-on IC