Senior Data Engineer-1
Core
Design, build, maintain, and support data pipelines and core data capabilities on Prudential Singapore's Unified Data Platform (UDP) to deliver reliable data products for business operations, analytics, AI, and commissions calculations.
Role type
Senior Data Engineer
Builds
Batch and near-real-time data pipelines, data ingestion/transformation/enrichment processes, and reusable data models on the UDP platform.
Domain
Financial Services / Insurance
Deliverable
production ML models
Required skills
Python, SQL, Databricks, Spark, ETL/ELT design, workflow orchestration, complex calculation logic, data quality/observability, Delta Lake, Unity Catalog, CI/CD, Git
Preferred skills
Insurance or financial services experience, APIs, file-based integration, event processing
Technologies
Python, SQL, Databricks, Spark, Delta Lake, Unity Catalog, Git
Responsibilities
Design and deploy data pipelines; develop data ingestion and transformation processes; implement calculation logic for commissions; ensure data accuracy and lineage; implement automated data quality checks; optimize pipeline performance; monitor production pipelines and resolve failures.
Seniority
Senior, hands-on IC