Data Engineer
Core
Design, develop, test, and maintain data pipelines, integrations, and transformation processes to ensure data is complete, accurate, and delivered on time.
Role type
Data Engineer
Builds
Data pipelines, integrations, and transformation processes
Domain
Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, data pipeline design, batch processing, near-real-time processing, data orchestration, data quality checks, troubleshooting, monitoring configuration, deployment support, version control
Technologies
Python, SQL
Responsibilities
Translate business and technical requirements into solution designs, Design, develop, test and maintain data pipelines, integrations and transformation processes, Prepare data flows, interface specifications, data models, and technical documentation, Build reusable, maintainable and production-ready data components, Implement batch and, where required, near-real-time data processing, Perform data-quality checks, reconciliation and troubleshooting, Configure and support monitoring, alerting, logging and operational controls, Support deployments and investigate data or pipeline issues, Contributes to practices for code quality, testing, documentation, version control, security and maintainability
Seniority
Mid-level (3+ years experience)
