Lead Python Engineer - Compute Platform
Core
Building scalable compute infrastructure and core research platforms for a global alternative investment management firm to support investment research and software development.
Role type
Senior Python Platform Engineer
Builds
Core research platform, open-source cluster-compute technologies, and APIs for investment workflows
Domain
Finance (Alternative Investments) + Distributed Systems
Deliverable
infrastructure
Required skills
Advanced Python, Kubernetes, Spark, Hadoop Yarn, Ray, Airflow, Linux system administration, Platform architecture
Preferred skills
GPU/CPU optimization (NUMA, profiling), C/C++, Systematic investing domain knowledge, Applied mathematics
Technologies
Kubernetes, Spark, Hadoop Yarn, Ray, Airflow
Responsibilities
Lead design and build of core Python compute platform; Partner with research and trading teams to design cluster-compute technologies; Monitor and implement novel open-source compute solutions; Engage stakeholders to promote adoption of compute capabilities
Seniority
Senior, hands-on IC with leadership responsibilities