Python Developer (Data Engineer)
Core
Refactor and maintain existing Python data engineering code, optimize data processing pipelines, and manage containerized application deployments.
Role type
Senior Python Developer (Data Engineer)
Builds
Data processing pipelines, containerized applications, and optimized data structures on Hadoop/Cloudera.
Domain
Big Data, Data Engineering, Cloud Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Python 3, Object-Oriented Design (SOLID), Code Refactoring, Unit/Integration/Performance Testing, Distributed Computing (Spark), Docker, CI/CD Automation, Hadoop Data Modeling
Preferred skills
Cloudera Platform, Jenkins, SonarQube, GitLab CI/CD, Jira API, Nexus Repository, Virtuozzo Containers
Technologies
Python, Spark, Docker, Jenkins, SonarQube, Cloudera, Hadoop, GitLab, Jira, Nexus, Virtuozzo
Responsibilities
Analyze and refactor existing data engineering code, write and execute comprehensive tests (unit, integration, performance, regression), implement CI/CD pipelines using Jenkins and GitLab, manage containerized applications with Docker, optimize data processing and computation, collaborate on data pipeline improvements.
Seniority
Senior, hands-on IC