大数据平台Notebook后台架构师
Core
Design architecture and develop core backend for a big data development platform's Notebook module, serving massive-scale interactive data development scenarios with millions of CPU scheduling tasks and PB-level storage.
Role type
Senior IC backend architect (big data platform)
Builds
High-concurrency, high-throughput interactive data development environment
Domain
Big Data / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Java, Python or Go, Spring Boot, Redis, Message Queues, JVM tuning, Distributed systems, High concurrency, Hadoop, Spark, Flink
Preferred skills
Jupyter Notebook secondary development, Dataworks/Databricks/Zeppelin experience, Open source contributions, Vibe Coding
Responsibilities
Architect Notebook module backend, handle full SDLC from design to testing, optimize architecture (Kernel management, Session lifecycle, Multi-tenancy), collaborate with product and ops teams.
Seniority
Senior, hands-on IC
