Data Engineer – Databricks & AWS
Core
Designing, developing, and optimizing data pipelines and lakehouse solutions to migrate and consolidate enterprise data warehouses into a unified Databricks on AWS cloud platform.
Role type
Senior IC data engineer (cloud migration & modernization)
Builds
Automated data migration processes and modern cloud data platforms
Domain
Banking / Cloud Data Engineering
Required skills
Databricks, SQL, Python, PySpark, Spark SQL, Data Pipeline Design, Data Orchestration, Data Governance, CI/CD, AWS
Preferred skills
Delta Lake, Unity Catalog, Apache Airflow, Enterprise DWH migration (Teradata, Oracle, Informatica), Banking domain experience
Technologies
Databricks, AWS, Delta Lake, Unity Catalog, Apache Airflow, Git, SQL, Python, PySpark
Responsibilities
Design and implement Bronze/Silver/Gold lakehouse architecture; Migrate data and transformation logic from legacy on-prem DWHs to cloud; Configure data orchestration, quality monitoring, and automated testing; Establish technical standards and data governance; Collaborate with data architects and analysts.