Senior Backend Developer / DevOps Kubernetes (H/F) - Freelance
Core
Building and operating a large-scale web scraping platform in production, focusing on performance, resilience, and automation.
Role type
Senior Backend Developer / DevOps Engineer (Kubernetes)
Builds
Scalable web scraping infrastructure and containerized workloads
Domain
Industrial web scraping, distributed systems, cloud infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, Kubernetes production experience, container orchestration, distributed systems, asynchronous processing, data pipeline design, DevOps culture (CI/CD, IaC, observability), cloud infrastructure, event-driven architectures, caching, message queues, security best practices
Preferred skills
Azure experience, large-scale web scraping architecture, proxy management, anti-bot strategies
Technologies
Kubernetes, Python, Cloud platforms, CI/CD tools, Container runtimes
Responsibilities
Finalize implementation of large-scale internal web scraping platform, design and deploy production scraping infrastructure on Kubernetes, improve scalability and resilience, build and optimize containerized workloads and scheduling pipelines, implement monitoring and incident management, optimize resource usage and autoscaling strategies, secure infrastructure and deployment workflows, collaborate on architecture standards, improve CI/CD automation
Seniority
Senior, hands-on IC