Data Engineer
Core
Building and optimizing large-scale cloud data systems for portfolio management technology.
Role type
Hands-on Data Engineer
Builds
Large-scale cloud data systems
Domain
Capital markets / Cloud data engineering
Deliverable
production ML models | infrastructure
Required skills
Python, PySpark, Apache Spark, Databricks, large-scale data systems, client-facing delivery, independent problem-solving
Preferred skills
AWS Glue, Lake Formation, Airflow, distributed data architectures
Technologies
Spark, PySpark, Parquet, Iceberg, Databricks, AWS Glue, Lake Formation, Airflow
Responsibilities
Develop and optimize Spark workloads in cloud environments, Work with large datasets using Parquet and Iceberg, Translate requirements into robust engineering solutions, Ensure performance, reliability, and maintainability, Contribute to monitoring, documentation, and deployment
