Senior Assoc, Application Developer (Data Engineering), Middle Office Technology - Finance Platform, Group Technology
Core
Design, develop, and maintain scalable data pipelines and applications within the Hadoop ecosystem for the bank's Middle Office Technology platform.
Role type
Senior IC data engineering application developer
Builds
Scalable data pipelines, ETL processing, and batch automation workflows
Domain
Finance / Big Data Engineering
Required skills
Hadoop ecosystem (HDFS, Hive, Impala), Spark (Scala/Java), SQL, Shell scripting, Python, Scala, Linux/Unix, AWS S3, Parquet, batch automation, REST APIs
Preferred skills
Performance tuning of SQL and Spark ETL, cloud technologies
Technologies
Hadoop, HDFS, Hive, Impala, Spark, AWS S3, Parquet, Shell, Python, Scala, Linux/Unix
Responsibilities
Design and develop scalable data pipelines; Perform performance tuning of SQL and Spark ETL; Implement batch automation using Shell scripts and REST APIs; Manage data storage and ingestion using HDFS and Parquet; Develop robust scripts for operational workflows; Troubleshoot complex technical issues in Linux/Unix environments
Seniority
Senior, hands-on IC
