Data Engineer
Core
Design, develop, and maintain data solutions for data generation, collection, and processing, including creating data pipelines and implementing ETL processes.
Role type
Data Engineer
Builds
Data pipelines and ETL processes for data migration and deployment across systems
Domain
Cloud data platforms and distributed computing
Deliverable
production ML models | product features
Required skills
Microsoft Azure Databricks, cloud-based data platforms, distributed computing environments, data pipeline architecture, ETL process design, data storage solutions, data integration techniques, data governance, data quality best practices
Preferred skills
Troubleshooting data processing issues
Technologies
Microsoft Azure Databricks
Responsibilities
Design and develop comprehensive data solutions, create efficient data pipelines, ensure data quality, implement ETL processes, monitor and optimize data pipelines, document data processes and workflows, collaborate with cross-functional teams
Seniority
Mid-level, independent contributor