Assoc, Application Developer, Middle Office Technology - Risk Platform, Group Technology
Core
Develop robust data processing pipelines, risk engines, and analytical platforms using big data and distributed processing technologies to support enterprise risk management and regulatory compliance.
Role type
Application Developer (Middle Office Technology)
Builds
Data processing pipelines, risk engines, analytical platforms
Domain
Financial Services / Risk Management / Big Data
Deliverable
production ML models
Required skills
Scala, Spark, PySpark, Hadoop, Hive, Kafka, Java, CI/CD, Git, Jenkins, Data Warehousing, Distributed Processing
Preferred skills
Oracle, Spark Streaming, Machine Learning
Technologies
Cloudera Distribution, Impala, Parquet
Responsibilities
Create Scala/Spark/Pyspark jobs for data transformation and aggregation, Produce unit tests for Spark transformations, Use Spark and Spark-SQL to read parquet data and create tables in Hive, Develop applications using Hadoop tech stack, Work with Business Analysts to review test results, Prepare design/operations documentation, Perform peer reviews and code quality checks, Ensure smooth production deployments.
