Data Engineer
Core
Build and maintain the Data, Integration and Analytics (DIA) Platform to support operational and corporate data reporting, analytics, and AI-driven insights for a diversified resources company.
Role type
Senior Data Engineer (Cloud & Data Platform)
Builds
Databricks data platform, modern data pipelines, real-time analytics infrastructure, and integration pipelines for API/event-driven and batch data ingestion.
Domain
Mining and Resources (Lithium, Iron Ore, Energy)
Deliverable
production ML models | product features | infrastructure
Required skills
Python, AWS, Databricks, Terraform, Apache Kafka, Fivetran, Databricks Lakeflow, CI/CD workflows, Infrastructure as Code, data pipeline automation, MLOps practices
Preferred skills
Azure cloud experience, data engineering certifications (Databricks, AWS, Azure), stakeholder collaboration
Technologies
Databricks, AWS, Microsoft DevOps, Apache Kafka, Fivetran, Terraform
Responsibilities
Develop and optimize Databricks data platform with automated pipelines; Establish CI/CD workflows for pipeline deployment; Implement Infrastructure as Code; Create integration pipelines for various data ingestion methods; Collaborate with stakeholders to optimize the data platform.
Seniority
Mid-to-Senior, hands-on IC