BigData-Hadoop/Scala Engineer, AVP
Core
Designing and developing high-performance, fault-tolerant data pipelines and ETL solutions on Google Cloud Platform to support business goals.
Role type
Senior IC Big Data Engineer (Hadoop/Scala/Spark)
Builds
Data pipelines, ETL solutions, and data processing jobs on GCP
Domain
Financial services / Big Data
Deliverable
production ML models
Required skills
Java, Scala, Apache Spark, Google Cloud Platform (GCP), Airflow, Dataproc, BigQuery, Data Warehousing, ETL/ELT, Data Modeling, Git
Preferred skills
Python, Oracle, Unix/Linux scripting, CI/CD, Data Governance, Financial Services domain, Angular/React
Technologies
Apache Spark, Google Cloud Platform, Airflow, Dataproc, BigQuery, Oracle, Angular, React
Responsibilities
Design and maintain high-performance data pipelines; Implement ETL solutions for data extraction and loading; Optimize data processing jobs for performance and cost; Ensure data quality, integrity, and security; Mentor junior team members; Collaborate with data scientists and analysts.
Seniority
Senior, hands-on IC with mentorship responsibilities
