Senior Data Engineering - PSM-Libra
Core
Design, build, and maintain scalable data engineering solutions and core services that power Machine Learning and analytics systems for financial services clients.
Role type
Senior Data Engineer (Financial Services)
Builds
Scalable data pipelines, data lakes, and core services integrating structured, message, and semi/unstructured data.
Domain
Financial Services (Banking, Insurance, Payments) + Big Data
Deliverable
production ML models | infrastructure
Required skills
Distributed computing principles, Big Data ecosystem (Hortonworks/Cloudera), Hive, Spark (PySpark), Scala, Python (Anaconda), CI/CD (Jenkins/Hudson/Ansible), Agile/SCRUM, Elastic Search Stack (ELK), Google Cloud Platform (Data Proc / Dataflow), GIT/GITLAB, SQL/Querying tools.
Preferred skills
Python web frameworks (Flask, Tornado, twisted), front-end technologies (JavaScript, HTML5, CSS3), global markets/macrostructure knowledge.
Responsibilities
Collect, store, process, and analyze large datasets; choose and maintain optimal data solutions; integrate solutions with company-wide architecture; build core services for ML/analytics; lead cross-functional teams including virtual teams.
Seniority
Senior, hands-on IC