Senior Data Platform Engineer / Engenheiro de Plataforma de Dados Senior
Core
Design, deploy, and maintain secure, highly available Kafka clusters in AWS, ensuring operational readiness and compliance for .NET microservices and Databricks streaming jobs.
Role type
Senior Data Platform Engineer (Kafka Infrastructure)
Builds
Production-grade Kafka clusters and streaming pipelines for geo-data analytics
Domain
Cloud Infrastructure (AWS) + Data Streaming (Kafka)
Deliverable
production ML models | infrastructure
Required skills
Kafka internals, AWS services, Terraform, Bash/Python scripting, Grafana/CloudWatch monitoring, TLS/mTLS, disaster recovery planning
Preferred skills
AWS MSK advanced features, Schema Registry (Protobuf), Databricks Structured Streaming, Confluent/AWS certifications
Technologies
Kafka, AWS (MSK, VPC, EC2, IAM, Secrets Manager), Terraform, Grafana, CloudWatch, Databricks, .NET
Responsibilities
Design and maintain secure Kafka clusters; perform capacity planning and performance tuning; automate infrastructure with Terraform; implement observability and alerting; develop runbooks for incident response and disaster recovery; ensure compliance with security and audit requirements; collaborate with development teams on best practices; conduct resilience testing.
Seniority
Senior, hands-on IC with mentorship responsibilities
