Data Engineer (Data Platform) - Singapore
Core
Designing and maintaining the data infrastructure to support AI work companion products, ensuring data governance, security, and efficient data pipelines for product and algorithm teams.
Role type
Senior Data Engineer (Data Platform)
Builds
Data warehouse, ETL/ELT pipelines, and data governance tools for AI productivity applications
Domain
AI productivity tools, data infrastructure, cloud data platforms
Deliverable
production ML models | infrastructure
Required skills
Data warehouse development, data modeling, ETL/ELT design, data governance, Hadoop ecosystem (HDFS, MapReduce, Yarn, Hive), Spark, Flink, performance tuning, data platform tools (scheduling, metadata, lineage, DQC, SLA)
Preferred skills
Cloud platforms (AWS, Azure, GCP), data services (S3, EMR, Redshift, Snowflake), AI capabilities in work tasks
Technologies
Hadoop, Spark, Flink, Hive, AWS, Azure, GCP, S3, EMR, Redshift, Snowflake
Responsibilities
Collaborate with product and algorithm teams to define data requirements; Implement data governance, metadata management, and security; Develop and optimize data pipelines and platform tools
Seniority
Mid-Senior, hands-on IC
