Data Engineer
Core
Designing, developing, and maintaining advanced data pipelines and cloud-based platforms to integrate data from diverse batch and streaming sources.
Role type
Data Engineer
Builds
Scalable data processing solutions and cloud-based platforms
Domain
Data Engineering / Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, Dagster, DBT, data pipeline design, cloud platform management, data integration, process automation, monitoring
Preferred skills
Agile methodologies, stakeholder collaboration, complex data environment navigation
Technologies
Dagster, DBT, Python, cloud platforms
Responsibilities
Designing and developing advanced data pipelines, integrating data from diverse batch and streaming sources, optimizing and implementing existing model code, automating data processing processes, monitoring data reliability and scalability
Seniority
Mid-level, hands-on IC
