Hadoop/Bigdata Developer
Core
Design and development of new models and frameworks for data delivery within the GIW Big Data Pivot program, supporting business use cases and data strategy.
Role type
Senior Hadoop/Big Data Developer
Builds
Data delivery frameworks, real-time and batch processing architectures, and utility services for the TTS Big Data platform.
Domain
Financial Services / Big Data
Deliverable
production ML models | product features
Required skills
Hadoop ecosystem (HDFS, YARN, ZooKeeper, Oozie), Spark, Scala, Java, SQL (Oracle/Teradata/MySQL), NoSQL (HBase, Couchbase), Kafka, Unix/Shell scripting, JSON/XML/Hypermedia data formats
Preferred skills
Python, AWS, Snowflake, Agile development processes
Technologies
Hadoop, Spark, Scala, Java, Kafka, Couchbase, HBase, Cloudera CDH 7.x, Oracle, Teradata, MySQL, S3, Hive, Impala
Responsibilities
Design and develop new data models and frameworks, manage and troubleshoot Spark jobs, develop shell and Unix scripting utilities, implement real-time and batch processing architectures, build frameworks and utility services including logging/monitoring
Seniority
Mid-Senior, hands-on IC
