Software Engineer - Data Infrastructure - Kafka
Core
Building fault-tolerant, mission-critical distributed data platform automation solutions for multi-cloud and on-premise enterprise environments.
Role type
Senior IC software engineer (data infrastructure)
Builds
Automated infrastructure features for managed data platforms (Kafka, Spark, SQL/NoSQL)
Domain
Big Data, distributed systems, cloud infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Python development, distributed systems (Kafka, Spark), Linux systems administration, cloud infrastructure (public/private), Kubernetes operations
Preferred skills
SQL/NoSQL database management (DBA level), OpenStack, package management
Technologies
Python, Kafka, Spark, Kubernetes, Linux, OpenStack, MySQL, PostgreSQL, Oracle, MongoDB, Redis, ElasticSearch
Responsibilities
Write high-quality Python code to create new automation features, debug issues and interact with upstream communities, collaborate with distributed teams, provide domain-specific expertise on data systems to other teams
Seniority
Senior, hands-on IC
