Data Engineer - A27006
Core
Design, develop, and deploy data tables, views, and marts in data warehouses, operational data stores, and data lakes; build and maintain large-scale batch and real-time data pipelines.
Role type
Data Engineer
Builds
Scalable data pipelines, data warehouses, and data-driven products for Singapore Government Agencies
Domain
Government sector, Cloud Data Engineering
Required skills
SQL, Python, AWS (S3, Athena, DMS, Lambda, Glue, ECS, Eventbridge), PostgreSQL, MongoDB, MySQL, Spark, Kafka, RabbitMQ, Web Scraping (Selenium, BeautifulSoup), Data Modeling, ETL/ELT
Preferred skills
System design, Data structure and algorithms, Data governance, REST APIs, Big data frameworks (Hadoop)
Responsibilities
Design and build efficient data pipelines; Integrate and collate data silos; Develop backend APIs and databases; Perform data extraction, cleaning, and transformation; Collaborate with Data Architects and Business Analysts
Seniority
Mid-level, hands-on IC
