Data Engineer
Core
Designing and maintaining enterprise data warehouse solutions, data marts, and data integration frameworks for a global bank.
Role type
Senior Data Engineer (ETL & Data Warehouse)
Builds
Teradata-based EDW, Hadoop-based data marts, and Spark-based ingestion frameworks
Domain
Financial Services / Big Data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data Lake architecture, EDW design, Data marts, Data Integration, UNIX scripting, Cloudera CDH/CDP, Teradata, Informatica Power Centre, BDM, GCFR, BTEQ, Hadoop ecosystem (Spark, Python, R, Pig, Hive, Hbase, Impala), SQL development, Java, Scala, Pyspark
Preferred skills
Financial services data models, Data governance processes
Technologies
Cloudera CDH, Teradata, Informatica Power Centre, Spark, Python, R, Pig, Hive, Hbase, Impala, Java, Scala, Pyspark, BTEQ, GCFR
Responsibilities
Support Development & SIT investigations, Support UAT testing and resolve techno-functional queries, Develop Spark-based ingestion frameworks, Implement ETL solutions using Informatica and BDM, Develop SQL scripts for data extraction and transformation
Seniority
Mid-Senior, hands-on IC
