Associate
Core
Architect and execute end-to-end platform migration strategies from legacy Hadoop/Hive systems to modern cloud-native architectures, building high-performance ETL/ELT pipelines and data products for the investment product sales lifecycle.
Role type
Senior Data Engineer (Cloud & Big Data)
Builds
Cloud-native data platforms, automated data pipelines, and data product capabilities using Databricks, Snowflake, and Azure/AWS.
Domain
Financial Services / Big Data Engineering / Cloud Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Python, PySpark, Scala, SQL, Apache Airflow, DBT, Snowflake, Databricks, Kafka, Docker, Kubernetes, OpenAPI/Swagger, Transact SQL, No-SQL, GraphQL, JSON, XML, ORC, PARQUET, AVRO
Preferred skills
Experience with generative AI outcomes, Snowflake Cortex/Snowpark, Delta Live Tables, Great Expectations, vectorized storage, machine-learning features
Technologies
Databricks Lakehouse Platform, Apache Airflow, Snowflake, Azure, AWS, Kafka, Kubernetes, Docker, Git
Responsibilities
Design and implement RESTful API endpoints for diverse file format ingestion; Engineer and optimize scalable Snowflake ecosystems with advanced data modeling and security controls; Build and manage high-performance ETL/ELT pipelines using Delta Live Tables; Partner with data scientists and stakeholders to translate business requirements into technical capabilities; Provide production support for data pipeline failures and perform root cause analysis.
Seniority
Mid-Senior, hands-on IC
