Data Engineer
Core
Design, build, and maintain scalable data pipelines and storage layers to support large datasets and the Machine Learning team.
Role type
Data Engineer
Builds
Scalable data pipelines, data lakes, and ETL/ELT workflows
Domain
Data Engineering / Machine Learning
Deliverable
production ML models
Required skills
Python, pandas, polars, ETL/ELT, orchestration, CI/CD, data quality management, SQL, distributed computing concepts
Preferred skills
Ray, ICPC/IMC/IOI/Kaggle experience, advanced probability and statistics
Technologies
Python, pandas, polars, Ray, orchestration tools, CI/CD tools
Responsibilities
Design and maintain scalable data pipelines for large datasets; Own data quality end-to-end; Develop and optimize data storage and retrieval layers across data lakes; Implement robust ETL/ELT workflows and CI/CD; Partner with teams to define data requirements and improve usability; Evaluate and adopt modern data tools and architectures
