Senior Data Engineer
Core
Designing, building, and delivering enterprise-wide data ingestion, integration, and pipeline solutions for Big Data and Data Warehouse platforms.
Role type
Senior Data Engineer (Big Data & Data Warehouse)
Builds
Next-generation data platforms, data pipelines, and data assets for a bank.
Domain
Banking / Big Data & Data Warehousing
Deliverable
production ML models | product features | infrastructure
Required skills
Big Data and Data Warehouse architecture, ETL framework design, distributed data storage and processing, data pipeline optimization, data security and management, technical leadership and mentoring, complex SQL scripting, Unix/Linux shell scripting, software development in Scala, Java, or Python.
Preferred skills
Cloudera CDP/Hadoop/Spark/Teradata/AWS certifications, Ab Initio experience, AWS technology experience (EMR, Redshift, S3).
Technologies
Cloudera Hadoop, Spark, MapReduce, Hive, Sqoop, Kafka, Teradata, RDBMS, Scala, Java, Python, AWS (EMR, Redshift, S3), Ab Initio.
Responsibilities
Create technology blueprints and engineering roadmaps for multi-year data transformation, build effective Big Data and Data Warehouse frameworks, design and deliver optimized data ingestion and integration solutions, lead and mentor other data engineers, ensure data quality assurance and security controls.
Seniority
Senior, hands-on IC with leadership responsibilities.
