大数据研发(J93780)
Core
Designing and developing data models for batch and real-time processing on Hadoop/Spark/Flink platforms to support business analytics and data mining.
Role type
Senior Big Data Engineer (Batch & Real-time)
Builds
Large-scale data processing pipelines, data models, and analytics platforms
Domain
Big Data, Distributed Systems, Data Engineering
Deliverable
production ML models
Required skills
Spark, Hadoop, Flink, Python, Java, Scala, SQL, Linux/Unix, Distributed Systems
Preferred skills
Storm, Hive, HBase, Kafka, Cloud Data Platforms, Visualization Platforms, Software Engineering Best Practices
Responsibilities
Develop batch and real-time data processing logic, design and build data models, construct data storage and query systems, perform data quality monitoring, and build analytics platforms.
Seniority
Mid-Senior, hands-on IC
Sourced via baidu · Listed on CareerPlan, which tracks 844,000+ jobs from 20+ sources.