Data Eng Assoc Prin Engineer
Core
Lead data engineering team to build, scale, and operate complex data pipelines and applications on Azure cloud, migrating from legacy systems to support business units in revenue management, supply chain, manufacturing, and logistics.
Role type
Senior IC data engineering lead (cloud/data platform)
Builds
Data pipelines, data lake infrastructure, and cloud-based data applications
Domain
Consumer goods / Cloud data engineering
Deliverable
production ML models
Required skills
Data pipeline architecture, Azure cloud services, SQL optimization, Python, PySpark, Scala, Data warehousing, ETL/ELT, Kubernetes, Test-driven development, Data modeling
Preferred skills
Azure Certification
Technologies
Azure, Azure Databricks, Azure SQL, Teradata, Python, PySpark, Scala, Kubernetes
Responsibilities
Manage and scale data pipelines from internal and external data sources; Create reusable accelerators and solutions to migrate data from legacy data warehouse platforms; Build and own the automation and monitoring frameworks for data pipeline quality; Collaborate with internal clients and external partners to drive solutioning; Define and manage SLA's for data products and processes running in production.
Seniority
Senior, hands-on IC with leadership responsibilities