Staff Software Engineer, Batch and Realtime Streaming
Core
Architecting, developing, and maintaining a Batch and Realtime Streaming platform that serves as the data backbone for machine learning research and production trading systems.
Role type
Staff Software Engineer (Batch and Realtime Streaming)
Builds
High-performance data ingestion pipelines, storage systems, serving layers, and API interfaces for feature productization and trading systems.
Domain
Quantitative finance + distributed data infrastructure
Deliverable
production ML models | infrastructure
Required skills
distributed computing, data infrastructure, Python, Go, database technologies, API design, data quality governance, pipeline optimization, technical mentorship
Preferred skills
large-scale data pipelines, modern Python data science tooling, monitoring and observability, feature stores
Technologies
Python, Go, Postgres, MySQL, Cassandra, DuckDB, REST, gRPC, Airflow, Spark, Ray, Iceberg, pandas, polars, dask, Prometheus, Grafana, ELK Stack, Feast, Hopsworks
Responsibilities
Architect and implement core components for batch and realtime streaming platforms; collaborate with cross-functional teams to ship new features for trading systems; design intuitive interfaces for feature discovery and access; ensure data quality, consistency, and lineage; optimize pipelines for performance and scalability; drive adoption of the feature store; mentor junior engineers.
Seniority
Staff, hands-on IC with mentorship