Data Engineer - Assistant Manager
Core
Design, develop, and support scalable data pipelines and data products for the investment management business using cloud-based data platforms.
Role type
Senior Associate, Data Engineer (IC)
Builds
Batch and streaming data pipelines, data ingestion solutions, and data transformation workflows
Domain
Financial services / Data Engineering
Deliverable
production ML models | product features
Required skills
PySpark, SQL, Databricks, Apache Spark, Python, Cloud data platforms, Data orchestration, CI/CD, Data governance
Preferred skills
Financial services domain, Apache Iceberg, Delta Lake, Kafka, Streaming technologies, Observability
Technologies
Databricks, PySpark, Spark SQL, Azure, AWS, Airflow, Azure Data Factory, Kafka, Event Hubs, Kinesis
Responsibilities
Develop and maintain batch and streaming data pipelines; Build and support data processing solutions following Bronze/Silver/Gold architecture; Implement data ingestion pipelines from multiple sources; Write high-quality, scalable code; Participate in code reviews, testing, and deployment; Monitor pipeline performance and troubleshoot issues; Support data quality and governance requirements
Seniority
Senior, hands-on IC
