Data Engineer III
Core
Design, develop, and evolve scalable data pipelines and products in a Databricks environment, ensuring quality, governance, and performance for the institution's data assets.
Role type
Senior Data Engineer (Data Modeling & Architecture)
Builds
Scalable data pipelines, Lakehouse solutions, and data products
Domain
Financial Services / Big Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Advanced Python, Advanced SQL, Databricks, Apache Spark, Delta Lake, Unity Catalog, Lakehouse architecture, Medallion architecture, ETL/ELT (batch & streaming), Data orchestration (Airflow/Databricks Workflows), Git, Cloud platforms (Azure/AWS/GCP)
Preferred skills
Cloud cost optimization, Data platform migration/modernization, Banking/Fintech domain experience
Technologies
Databricks, Apache Spark, Delta Lake, Unity Catalog, Lakeflow, Azure, AWS, GCP, Airflow, Bitbucket, Azure DevOps
Responsibilities
Design and develop scalable data pipelines and products in Databricks; Implement distributed processing solutions in Lakehouse architecture; Ensure data quality, governance, observability, and performance; Act as a technical reference for the team on Data Engineering topics; Support architectural definitions and technical strategy; Develop and sustain complex ETL/ELT pipelines for batch and streaming; Disseminate best practices in DataOps and data quality
Seniority
Senior, hands-on IC
