Big Data Engineer- Scala
Core
Design, develop, and optimize scalable data-processing solutions and large-scale ETL/data pipelines for banking, financial, and energy sectors.
Role type
Senior Big Data Engineer (Scala/Spark)
Builds
Scalable Big Data applications, data pipelines, and reusable data-processing frameworks
Domain
Financial services, Energy, Big Data
Required skills
Scala, Apache Spark, Spark SQL, Hadoop, HDFS, Hive, Kafka, ETL, SQL, Data Engineering
Preferred skills
AWS, Azure, GCP, Databricks, Airflow, Delta Lake, Docker, Kubernetes
Technologies
Scala, Apache Spark, Spark SQL, Hadoop, HDFS, Hive, Kafka, Parquet, Avro, JSON, Git, CI/CD
Responsibilities
Design and maintain scalable Big Data applications; Develop high-performance data-processing solutions; Build and optimize ETL/ELT pipelines; Perform Spark job performance tuning; Troubleshoot production issues; Implement data-quality checks and monitoring; Develop reusable frameworks; Collaborate with data architects and business teams.
Seniority
Senior, hands-on IC