PLUK Data Engineer
Core
Design, build, and maintain data infrastructure supporting analytics and machine learning initiatives, including pipelines, warehouses, and lakes.
Role type
Data Engineer
Builds
Data pipelines, data warehouses, data lakes, and analytics tools
Domain
Insurance / Big Data
Deliverable
production ML models
Required skills
SQL, Python, Java, Scala, Hadoop, Spark, Kafka, Postgres, Cassandra, Qlik Replicate, Azure Data Factory, Azure cloud services
Responsibilities
Create and maintain optimal data pipeline architecture; Assemble large, complex data sets; Identify and implement internal process improvements; Build infrastructure for ETL from various data sources; Build analytics tools for business performance metrics; Ensure compliance with company policies and Pru Life UK Compliance Standards
