Senior Data Platform Engineer / Engenheiro de Plataforma de Dados Senior
Core
Design, deploy, and maintain secure, highly available Kafka clusters in AWS to support .NET microservices and Databricks streaming jobs.
Role type
Senior Data Platform Engineer (Kafka/SRE)
Builds
Production-grade event streaming infrastructure and operational tooling
Domain
Geo-data industry, Cloud Infrastructure, Event Streaming
Deliverable
production ML models | infrastructure
Required skills
Kafka internals, AWS services, Terraform, Bash/Python scripting, Grafana, CloudWatch, Disaster recovery planning, Security compliance (ISO27001)
Preferred skills
AWS MSK advanced features, Schema Registry (Protobuf), Databricks Structured Streaming, Confluent/AWS certifications, Geo-data experience
Technologies
Kafka, AWS (MSK, VPC, EC2, IAM, Secrets Manager), Terraform, GitOps, Grafana, CloudWatch, Databricks, .NET
Responsibilities
Design and maintain secure Kafka clusters; Perform capacity planning and performance tuning; Automate infrastructure using Terraform; Implement observability and alerting; Develop runbooks for incident response and disaster recovery; Ensure compliance with security and audit requirements; Collaborate with development teams on Kafka best practices; Conduct resilience testing and maintain RPO/RTO strategies; Drive cost optimization and operational maturity.
Seniority
Senior, hands-on IC with mentorship responsibilities