Senior/Staff Software Engineer, Data Infrastructure Group
Core
Designing, building, and scaling large-scale data infrastructure and tooling to support research and production workflows for an AI/ML investment management firm.
Role type
Senior/Staff Software Engineer (Data Infrastructure)
Builds
Scalable data infrastructure, data cataloging, versioning, lineage tools, and developer experience platforms.
Domain
Finance / Data Infrastructure / AI/ML Support
Deliverable
infrastructure
Required skills
Software design and implementation, large codebase management, modular software architecture, modern programming languages (Python, Go, Java, C++), Linux/UNIX development, scalable services and APIs, data storage and management technologies
Preferred skills
Cluster management and containerization (Kubernetes, Docker), cloud storage and processing (Iceberg, BigQuery, Snowflake, DynamoDB, Trino/Athena), data platform developer experience design, job scheduling and orchestration (Airflow, Slurm)
Technologies
Python, Go, Java, C++, PostgreSQL, Artifactory, Ceph, Redis, Kubernetes, Docker, Iceberg, BigQuery, Snowflake, DynamoDB, Trino, Athena, Airflow, Slurm
Responsibilities
Guide complex initiatives from requirements gathering to deployment, build scalable data infrastructure and shape developer experience, provide technical guidance to engineering and research staff, define team technical roadmap, mentor and develop other engineers
Seniority
Senior/Staff, hands-on IC with mentorship responsibilities