Data Operations Engineer
Core
Supporting and modernizing data infrastructure to ensure data platforms are performant, resilient, and secure for global commodities markets.
Role type
Data Operations Engineer (DataOps/Platform Engineering)
Builds
Data platforms and AI workloads for price reporting, events, and intelligence services
Domain
Commodities markets (agriculture, metals, mining, energy) + Cloud Data Platforms
Deliverable
infrastructure
Required skills
Data pipeline operations, cloud platform operations (Azure/AWS/GCP), scripting for automation (Bash/Python/PowerShell), monitoring and observability, process improvement, cross-functional collaboration
Preferred skills
Big data platform operations (Spark/Kafka/Databricks), cloud data warehouse management (Snowflake), data orchestration (Dagster/Airflow), containerization and orchestration (Docker/Kubernetes), Infrastructure-as-Code (Terraform/Bicep), CI/CD pipelines, identity management (RBAC/AD), data backup and integrity management
Technologies
Snowflake, Dagster, Qlik, Azure, AWS, GCP, Spark, Kafka, Databricks, Hadoop, Docker, Kubernetes, Terraform, Bicep, Git, GitHub, Azure DevOps, GitHub Actions, Bash, Python, PowerShell
Responsibilities
Align operational goals with Data, Engineering, and Cyber teams; challenge existing processes; drive operational excellence across data platforms; support modernization of data infrastructure
Seniority
Mid-level, hands-on IC
