Software Engineer, Data Orchestration
Core
Design, build, and maintain next-generation data platform products and orchestration infrastructure for batch data processing pipelines.
Role type
Senior IC software engineer (data orchestration & infrastructure)
Builds
High-availability data orchestration platform, APIs, and abstractions for internal engineering teams and data scientists.
Domain
Financial technology / Big Data Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Distributed systems design, Data pipeline operations, API design, Open source tooling, High-availability systems, Infrastructure-as-a-product, Creative problem-solving
Preferred skills
Scala, Spark, Flink, Airflow, Performance optimization, Scaling distributed systems, OSS contribution
Technologies
Airflow, Spark, SQL, Kafka, Flink, Hive MetaStore, Trino, Pinot, Python, Java, Scala, S3, Iceberg
Responsibilities
Design and build innovative data platform products; Design ergonomic APIs for internal users; Ensure operational excellence for batch workloads; Collaborate with high-visibility teams; Plan infrastructure growth and unblock partners; Contribute to Open Source Software communities
Seniority
Senior, hands-on IC
