Big Data Engineer, Web3
Core
Design, build, and evolve core data platform services and AI agent infrastructure for a leading crypto exchange.
Role type
Senior Big Data Platform Engineer (AI/LLM integration)
Builds
Large-scale distributed data systems, AI-native platform layer, and developer tooling for OKX's data infrastructure.
Domain
Fintech / Crypto / Big Data / AI
Deliverable
production ML models | infrastructure
Required skills
Distributed data systems (Hadoop/Spark/Flink), Large-scale storage (MaxCompute/Hologres/ClickHouse), Java/Scala/Python, Task scheduling (Airflow/DolphinScheduler), Multi-cloud architecture, LLM integration (RAG/Tool calling), API-first design
Preferred skills
MCP (Model Context Protocol) frameworks, AI agent development, Cost governance automation
Technologies
MaxCompute, ODPS, Hologres, Spark, ClickHouse, Hive, Airflow, DolphinScheduler, Java, Scala, Python, MCP
Responsibilities
Design and operate large-scale distributed data systems; Develop MCP tool interfaces for AI agents; Build scheduling and cost-optimization agents; Establish SLA benchmarks and automated incident response pipelines.
Seniority
Senior, hands-on IC