Big Data Engineer - Data analytics Expert
Core
Designing, developing, and maintaining large-scale data pipelines and analytics systems for search and recommendation features.
Role type
Senior Big Data Engineer (Data Analytics)
Builds
Data pipelines, ETL jobs, and visualization dashboards for search and recommendation systems.
Domain
ICT infrastructure and smart devices
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, Java, Scala, SQL, Hive, Hadoop, Apache Spark, Linux, data modeling, complex query optimization, ETL pattern design, data visualization (Tableau/PowerBI/FineBI), Kafka, Flink
Preferred skills
Large-scale data pipeline development for recommendation and search, advanced algorithmic concepts for code optimization
Technologies
Hadoop, Spark, Hive, Kafka, Flink, Tableau, PowerBI, FineBI
Responsibilities
Develop and maintain systems for Self-Analytics and visualization; Design and develop data and features for search and recommendation systems; Maintain and manage daily ETL job execution and fix pipeline issues; Optimize data pipelines for cost, compute, and storage; Ensure data quality, privacy, and security compliance.
Seniority
Senior, hands-on IC
