Senior Data Engineer (Kỹ sư Dữ liệu Cấp cao)
Core
Design and build scalable data integration and processing systems to ingest, transform, and deliver structured and unstructured data from various sources into a single data architecture platform for data science exploration and analytics.
Role type
Senior Data Engineer (Big Data & Cloud)
Builds
Scalable data pipelines, data lakes, and data warehouse solutions
Domain
Life Insurance / Big Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Big Data processing (Spark, Flink), Cloud data engineering (Azure DP200/DP201/DP203), Data modeling, Data mining, SQL, Python, Java, DAX, MDX, PowerBI/Tableau/Qlik
Preferred skills
Machine learning technology applications, Data ontology alignment, Elastic search approaches
Technologies
Apache Spark, Apache Flink, Databricks, Azure (Storage Account, DataBricks), Hadoop, MapReduce, SQL, Python, Java, DAX, MDX
Responsibilities
Ingest, transform, and blend structured and unstructured data from disparate sources; Design and manage big data infrastructure to optimize system performance; Prepare data for data scientist exploration and discovery; Evaluate and improve data lifecycle design and design patterns innovation.
Seniority
Senior, hands-on IC