Data Engineer, Product Data Development
Core
Building and optimizing offline and real-time data pipelines to ensure data timeliness and accuracy for a crypto exchange and wallet platform.
Role type
Senior IC data engineer (real-time & batch)
Builds
Online (customer-facing) product data pipelines, data warehouse, and data services for OKX and OKX Wallet
Domain
Cryptocurrency exchange and decentralized applications (dApps)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Hadoop, Hive, Flink, YARN, Elasticsearch, Kafka, real-time big data processing, Flink SQL, data warehouse modeling, performance optimization, end-to-end business requirement management
Technologies
Hadoop, Hive, Flink, YARN, Elasticsearch, Kafka
Responsibilities
Build and optimize offline and real-time data pipelines; Independently manage end-to-end business requirements for online product data pipelines; Design and refactor large-scale data warehouses
Seniority
Mid-Senior, hands-on IC