Intermediate Data Engineer
Core
Design, implement, and maintain scalable data pipelines and ETL/ELT solutions to ingest, store, and process large volumes of data for AB InBev's global business units.
Role type
Intermediate Data Engineer
Builds
Data pipelines, data integration solutions, and APIs for data exchange
Domain
Consumer Goods / Brewing / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, PySpark, Scala, SQL, Apache Airflow, Databricks Workflows, AWS, Azure, Google Cloud, Terraform, GitHub Actions, Azure DevOps, data modeling, software design principles, query optimization
Preferred skills
API development, automation frameworks
Technologies
PySpark, Scala, SQL, Apache Airflow, Luigi, Mage, Databricks Workflows, AWS, Azure, Google Cloud, Terraform, GitHub Actions, Azure DevOps
Responsibilities
Implement ETL/ELT solutions and data integration between multiple systems; Design and maintain data pipelines for large volume data processing; Optimize PySpark and SQL query performance; Develop and maintain APIs for data exchange; Apply data modeling techniques to design efficient data models
Seniority
Intermediate, hands-on IC