Senior Data Engineer
Core
Designing and maintaining real-time and batch data processing pipelines and streaming systems for a crypto exchange and wallet platform.
Role type
Senior Data Engineer (Real-time Streaming & Feature Stores)
Builds
High-performance data pipelines, feature stores for machine learning, and streaming architectures for crypto trading and dApps.
Domain
Blockchain / Web3 / Fintech
Deliverable
production ML models | infrastructure
Required skills
Apache Flink, real-time data streaming, architecture design, feature engineering, feature store development, SQL, distributed systems
Preferred skills
Alibaba Cloud Hologres, Doris, Clickhouse, Spark, blockchain technology
Technologies
Flink, Hologres, Doris, Clickhouse, Spark
Responsibilities
Design and develop real-time and batch data processing pipelines; architect Flink streaming systems; collaborate with data scientists to build feature stores; troubleshoot performance bottlenecks in stream processing; improve system performance and data integrity.
Seniority
Senior, hands-on IC