Software Engineering & Development, Officer
Core
Design, develop, test, and maintain scalable data pipelines and containerized applications for research data management, analytics, and investment processes.
Role type
Senior IC data engineering and software development officer
Builds
Data pipelines, Databricks workflows, containerized applications, and CI/CD infrastructure
Domain
Financial services / Data engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, PySpark, SQL, Shell scripting, Databricks, Docker, CI/CD (Jenkins, Artifactory, Bitbucket/GitHub), relational database design, data modeling, ETL frameworks, distributed data processing
Preferred skills
Snowflake, AWS Iceberg / Apache Iceberg, AWS cloud services (S3, EMR, Lambda, ECS/EKS, Glue, IAM)
Responsibilities
Design and build data ingestion solutions on Databricks; develop and maintain containerized applications and batch jobs; write automation scripts for operational tasks; troubleshoot production issues and analyze logs; design and maintain CI/CD pipelines; collaborate with cross-functional teams to define requirements and deliver scalable engineering solutions.
Seniority
Senior, hands-on IC
