Senior Software Engineer - Data Platform
Core
Designing and developing services to streamline data ingestion, transformation, and analytics delivery for Arrowstreet Capital's data infrastructure.
Role type
Senior Software Engineer - Data Platform
Builds
Data ingestion pipelines, data discovery and lineage tools, governance frameworks, and scalable cloud architecture.
Domain
Financial services / Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Data lake and data warehousing design, Spark/Hadoop/Presto processing, Python or C# programming, AWS cloud architecture, Infrastructure as Code (Terraform/Pulumi/CDK), API development (OpenAPI/FastAPI), Real-time streaming (Kafka/Kinesis/Flink), Automated testing, Cloud security compliance.
Preferred skills
Mentoring junior engineers, Investigating new data technologies, Designing flexible abstractions.
Technologies
Spark, Hadoop, Presto, AWS, Terraform, Pulumi, CloudFormation, CDK, OpenAPI, FastAPI, Kafka, Kinesis, Apache Flink.
Responsibilities
Define and execute the technical roadmap for batch and real-time data sets; Oversee building features for data discovery, lineage, governance, and cost management; Achieve high quality metrics through automated testing and robust operational tooling; Provide production support to avoid disruption to investment processes; Collaborate with stakeholders to translate business objectives into scalable data engineering solutions; Partner with IT operations and security teams to ensure platform reliability; Develop and mentor junior Data Engineers.
Seniority
Senior, hands-on IC with mentorship responsibilities
