BigData-Hadoop/Scala Engineer, AVP
Core
Design, develop, and maintain high-performance, fault-tolerant data pipelines and ETL solutions using big data technologies.
Role type
Senior IC Big Data Engineer (Hadoop/Scala)
Builds
Data pipelines and ETL solutions for data platforms
Domain
Big Data / Financial Services
Deliverable
production ML models
Required skills
Java, Scala, Apache Spark, Google Cloud Platform (Airflow, Dataproc, BigQuery), Data Warehousing, ETL/ELT, Data Modeling, Git
Preferred skills
Python, Oracle, Unix/Linux scripting, AWS, Azure, CI/CD, DevOps, Data Governance, Angular, React
Technologies
Hadoop, Apache Spark, Google Cloud Platform, Airflow, Dataproc, BigQuery, Oracle, Git, Angular, React, AWS, Azure
Responsibilities
Design and develop high-performance data pipelines; Implement ETL data processing solutions; Optimize data processing jobs for performance and cost efficiency; Ensure data quality, integrity, and security; Participate in code reviews and technical discussions; Mentor junior team members
Seniority
Senior, hands-on IC
