Software Developer - Data Pipelines (Python)
Core
Design, implement, test, optimize, and troubleshoot resilient data ingestion pipelines and transformation jobs to serve vast quantities of data for alpha generation and efficient query construction.
Role type
Senior IC Python data pipeline engineer
Builds
Ingestion pipelines, data transformation jobs, and data models for alpha generation
Domain
Financial data infrastructure / Data engineering
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, RDBMS (Postgres), data transfer protocols (FTP, SFTP, HTTP APIs), AWS S3
Preferred skills
Big data frameworks, distributed systems, Cloud development, C++, kdb+/q, Rust
Responsibilities
Design and implement data pipelines and services, optimize query construction, onboard new datasets, lead production support operations
Seniority
Senior, hands-on IC
Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.