Spark Scala Developer
Core
Design, develop, and optimize large-scale data processing applications and systems using Spark and Scala.
Role type
Intermediate Spark Scala Developer
Builds
Data processing pipelines, ETL jobs, and analytics systems for Citigroup
Domain
Financial services / Big Data
Deliverable
production ML models | product features
Required skills
Scala, Apache Spark, SQL, HDFS, Cloudera, Hive, HBase, Kafka, JSON, AVRO, CSV, XML, ETL batch scheduling
Preferred skills
Neo4j, Gemfire, DeltaTable, Apache Iceberg, Cloudera CDP
Technologies
Apache Spark, Kafka, Hive, HBase, Cloudera, Sqoop
Responsibilities
Identify and define system enhancements using script tools and code analysis; consult with users and technology groups to recommend programming solutions; analyze applications for vulnerabilities and security issues; conduct testing and debugging; act as an advisor or coach to new or lower-level analysts; resolve issues by selecting solutions based on technical experience and precedents.
Seniority
Intermediate, hands-on IC
