Staff Infrastructure Engineer - Data Streaming
Core
Design and operate distributed data services (Kafka, Redis) at massive scale to support an autonomous cybersecurity platform.
Role type
Staff Infrastructure Engineer (Data Streaming)
Builds
Self-hosted Kafka and Redis clusters across multi-cloud and on-prem environments
Domain
Cybersecurity / Data Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Kubernetes internals, self-hosted Kafka, self-hosted Redis, Infrastructure as Code (Terraform), GitOps (ArgoCD), multi-cloud architecture, Python/Go scripting, CI/CD pipelines
Preferred skills
DBaaS/PaaS experience, stateful workload management, FinOps collaboration
Technologies
Kafka, Redis, Kubernetes, AWS, GCP, Azure, Terraform, ArgoCD, Jenkins, GitHub Actions
Responsibilities
Lead design of distributed data services, unlock cloud portability across AWS/GCP/on-prem, manage PB/day data ingestion, consolidate multi-tenant Kafka clusters, drive lifecycle automation, define observability/HA/DR standards, optimize cost/performance
Seniority
Staff, hands-on IC