Manager, Data Engineer
Core
Design, implement, and optimize scalable data models, architectures, and ETL/ELT processes on cloud platforms to support analytics and business intelligence.
Role type
Manager, Data Engineer
Builds
Cloud data platforms (Snowflake, Databricks), data pipelines, automated reporting workflows, and data governance controls.
Domain
Financial services / Investment management
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data modeling, ETL/ELT, SQL, Python, Cloud data platforms (Snowflake, Databricks), Data orchestration, RESTful APIs, Source code management, CI/CD practices, Risk assessment, Database schema optimization.
Preferred skills
Data Centric Development Frameworks, Medalion Architecture, Streamlit, Databricks Apps, Databricks Genie, Investment management domain knowledge, Snowflake/Databricks certifications.
Technologies
Snowflake, Databricks, Workato, Azure DevOps, Streamlit, RESTful APIs, SQL, Python.
Responsibilities
Design and implement scalable data models and architectures within cloud data platforms; Design and implement ETL/ELT processes between various sources into Snowflake and/or Databricks platforms; Implement data validation and cleansing processes to ensure data accuracy and integrity; Migrate existing data infrastructure to Snowflake; Assess risks associated with data pipelines and identify potential issues proactively; Identify opportunities using data-driven approach and lead data engineering projects that deliver value to the business; Identify areas for optimization within existing data workflows and processes; Work closely with business stakeholders to understand requirements and formulate data-driven solutions; Work with end users or data scientists to develop automated workflows for key reporting processes; Provide technical guidance and support to junior data engineers and business power users.
Seniority
Manager, hands-on IC with team leadership