Data Operations Engineer
Core
Build and maintain resilient, performant, and secure data infrastructure and AI platforms using DataOps practices.
Role type
Data Operations Engineer (IC)
Builds
Data platforms, AI workloads, and operational pipelines for global commodities markets
Domain
Commodities markets (agriculture, metals, energy) + Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Cloud platform operations (Azure/AWS/GCP), Data pipeline management (ingestion/transformation/storage), Scripting (Bash/Python/PowerShell), Monitoring and observability, Problem-solving, Cross-functional collaboration
Preferred skills
Big data platforms (Spark/Kafka/Databricks), Cloud data warehouses (Snowflake), Data orchestration (Dagster/Airflow), Containerization (Docker/Kubernetes), Infrastructure-as-code (Terraform/Bicep), CI/CD pipelines, RBAC and identity management
Technologies
Snowflake, Dagster, Qlik, Azure, AWS, GCP, Spark, Kafka, Databricks, Docker, Kubernetes, Terraform, Bicep, Git, GitHub Actions, Azure DevOps
Responsibilities
Support and modernize data infrastructure, Align operational goals with Data/Engineering/Cyber teams, Challenge existing processes to drive operational excellence, Monitor and maintain data platform health, Automate operational tasks via scripting
Seniority
Mid-level, hands-on IC
