Data Engineer, Market Intelligence
Core
Design and build end-to-end data pipelines and tools to extract insights from large, complex structured and unstructured data sets for investment professionals.
Role type
Data Engineer (Big Data)
Builds
Cloud-based infrastructure, big data processing pipelines, and visualization capabilities for proprietary research products.
Domain
Alternative Investment / Financial Data
Deliverable
production ML models | infrastructure
Required skills
Python, Apache Spark, Scala, Big Data technologies, Graph databases
Preferred skills
Novel solution design, Proof of concepts
Technologies
Python, Spark, Scala, Graph databases
Responsibilities
Develop and support big data processing pipelines (ingestion, transformation, delivery); Build cloud-based infrastructure using distributed techniques; Evaluate new technologies for big data handling; Build and support visualization capabilities for big data sets.
Seniority
Mid-level, hands-on IC
