Data Engineer
Core
Build and optimize a data integration framework and graph data model for the digital twin of large industrial supply chains.
Role type
Senior Data Engineer (Supply Chain)
Builds
Data integration framework, graph data models, and Axon software platform features
Domain
Supply chain management, Industrial IoT, Big Data
Deliverable
production ML models
Required skills
ETL processes, Scala, PySpark, Azure Synapse, Databricks, Cloud platforms (Azure/AWS/GCP), CI/CD pipelines, System design
Preferred skills
Supply chain domain knowledge, Modern system design practices
Technologies
Azure Synapse, Databricks, Scala, PySpark, Azure, AWS, GCP
Responsibilities
Develop and enhance the Data Integration Framework, Manage and optimize large-scale datasets, Lead development of new features for the data integration framework, Optimize pipeline performance for scalability, Collaborate with cross-functional teams including data scientists and software engineers
Seniority
Mid-Senior, hands-on IC