Staff/Senior Staff Web3 Big Data Engineer
Core
Design and optimize big data platforms and AI infrastructure to process on-chain data, trading behavior, and user profiles for a leading crypto exchange.
Role type
Staff/Senior Staff Web3 Big Data Engineer
Builds
Real-time/batch data pipelines, data warehouses/lakes, and AI-driven applications (fraud detection, risk models, Text2SQL) for crypto trading and dApps.
Domain
Web3 / Cryptocurrency / Big Data Engineering / AI Infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Big data development (Hadoop, Spark, Flink), SQL tuning, Java/Scala/Python, data governance, on-chain data parsing, LLM fundamentals, vector databases, blockchain fundamentals (UTXO, consensus, gas mechanics)
Preferred skills
Data quality monitoring, AI Agents/MCP, automated ETL generation, DeFi/NFT business models, exchange/wallet data engineering experience
Technologies
Hadoop, Spark, Flink, Kafka, HBase, ClickHouse, Doris, Hive, Milvus, Pinecone, Weaviate, pgvector, The Graph, Etherscan API
Responsibilities
Own architecture of big data platform; design real-time/batch pipelines for on-chain data; build and maintain data warehouse/lake; combine big data with LLMs for intelligent applications; build AI infrastructure (vector DBs, feature platforms); partner with AI/Product/Risk teams; optimize performance and reliability of big data jobs; track industry developments in big data and AI.
Seniority
Staff/Senior Staff, hands-on IC with technical direction