Data Engineer - Advanced
Core
Designing, implementing, and maintaining complex data pipelines and architectures for large-scale data platforms.
Role type
Senior Data Engineer
Builds
Large-scale batch and real-time data pipelines, data models, and data flow diagrams.
Domain
Energy and Chemicals
Deliverable
production ML models
Required skills
Data modeling, data dictionary creation, data flow diagramming, business requirement gathering, data pipeline optimization, automation, cloud/on-prem data processing, DevOps, source code management, real-time streaming, mentoring
Preferred skills
Machine learning integration, deep learning integration, enterprise architecture standards
Technologies
Cloud platforms, data processing frameworks, DevOps tools
Responsibilities
Design and implement solutions for real-time data processing and streaming; Build large-scale batch and/or real-time data pipelines; Manage and secure the flow of structured and unstructured data; Lead and mentor Data Engineers - Associate; Optimize data delivery and automate manual processes; Assist data scientists in integrating diverse datasets for ML and deep learning models.