Data Engineer - Mid
Core
Design and implement data engineering solutions, manage data ingestion from top-tier vendors, and build scalable data storage systems and ETL processes for an investment management firm.
Role type
Mid-level Data Engineer
Builds
Data pipelines, ETL processes, and data storage systems
Domain
Financial Services / Investment Management
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, Data Governance, Data Ingestion, ETL Design, Cloud Architecture, Test Planning
Preferred skills
Azure Services, Azure Blob Storage, Snowflake, Databricks
Technologies
Azure, Snowflake, Databricks, Python, SQL
Responsibilities
Design and implement cutting-edge solutions across Cloud, DevOps, and Data Engineering; Take ownership of all data managed in-house sourced from vendors like BlackRock, Clearwater, Bloomberg, ICE, BONY; Partner with business units and IT to onboard new data sources and enhance ingestion processes; Continuously develop and refine data ingestion processes emphasizing robust data governance; Play a pivotal role in designing data storage systems and ETL processes; Work closely with partners to oversee and improve manual or ad hoc data ingestion tasks; Maintain detailed documentation of all data engineering processes; Develop and execute rigorous test plans to guarantee reliability and accuracy of data pipelines.
Seniority
Mid-level, hands-on IC
