资深数据开发工程师(自动驾驶数据平台) _XC
Core
Design and evolve an end-to-end autonomous driving data platform (fleet → capture → annotation → dataset → model evaluation) handling PB-scale data.
Role type
Senior IC data platform architect
Builds
PB-scale data query, storage, processing, and mining systems for autonomous driving model evaluation
Domain
Autonomous driving / Mobility solutions
Deliverable
production ML models
Required skills
Distributed query engine optimization, Columnar storage & lakehouse architecture, Asynchronous task scheduling, Vector retrieval (KNN), System design & abstraction, Security compliance implementation
Preferred skills
Autonomous driving data processing, Vector retrieval (ANN indexes), Data platform 0→1 construction, SDK/OpenAPI code generation
Technologies
Trino, Lance, LevelDB, Rosbag, MongoDB, MySQL, COS, Celery, Redis, Docker, Kubernetes, ClickHouse, Doris, Spark SQL, Python, Django, DRF
Responsibilities
Lead architecture design and technology selection for the data platform; Build full-link pipelines for vehicle data collection, cleaning, and warehousing; Design asynchronous scheduling platforms for large-scale tasks; Optimize query performance and governance; Construct vector retrieval capabilities for similar scenario recall; Establish data security and compliance standards; Mentor team members and drive cross-team collaboration