Senior Data Engineer
Core
Architect, operate, and refine high-throughput data platforms for research, systematic trading, AI, and risk analytics at a hedge fund.
Role type
Senior IC data engineer (financial markets)
Builds
Ultra-low-latency market-data streams, end-of-day workflows, Lakehouse tables, and curated datasets via APIs
Domain
Financial services / Quantitative trading / Big data
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, big-data architecture (partitioning, sharding, columnar formats), AWS, Terraform/CloudFormation, API design, performance tuning
Preferred skills
Market-data domain expertise (tick, options, macro), Iceberg/Delta Lake/Hudi, real-time analytics engines, performance profiling tools
Technologies
SingleStore/MemSQL, Spark, Flink, EMR, Kafka, Kinesis, Postgres, KDB, Git, OpenAPI/Swagger
Responsibilities
Architect and operate 24x7 reliable data platforms with IaC-driven deployments; Build and evolve batch and streaming pipelines ingesting billions of market-data events; Architect high-performance, cost-efficient Lakehouse tables; Expose curated datasets via robust, versioned APIs; Optimize workflows to meet aggressive SLAs with observability and automated data quality checks; Champion Infrastructure-as-Code with Git-driven CI/CD; Mentor junior engineers and enforce best-in-class coding standards
Seniority
Senior, hands-on IC with mentorship