Senior Hadoop Developer/Analyst---------------Need GC and USC-------------Need Locals
Core
Designing, developing, testing, tuning, and building large-scale data processing systems for data ingestion and data products to improve data quality, velocity, and monetization.
Role type
Senior Hadoop Developer/Analyst
Builds
Operational data stores (ODSs), downstream Data Marts, and files for operational and analytical applications.
Domain
Data Engineering / Big Data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Hadoop ecosystem (HDFS, Hive, Pig, Flume, HBase, Spark, Impala), ETL development (Informatica), Core Java, SQL, Unix/Linux shell scripting, relational databases (DB2, MSSQL, Teradata, Oracle), data migration and conversion, performance tuning, complex Hive HQL, Spark data manipulation.
Preferred skills
Agile/DevOps environment, web architecture (Javascript, SOAP/XML, Weblogic, Tomcat), ORM frameworks, SOA Architecture, Microservices, Middleware components (ESB, API Gateway), Microsoft Access/Excel/Visio.
Technologies
Hadoop, HDFS, Hive, Pig, Flume, HBase, Spark, Impala, Informatica, Kafka, JSON, Avro, SQL, Java, Unix/Linux, DB2, MSSQL, Teradata, Oracle, Weblogic, Tomcat, SOAP/XML.
Responsibilities
Design and develop data integration solutions; troubleshoot and optimize Hadoop technologies; implement quality logical and physical ETL designs; manage technical metadata across ETL jobs; build solutions involving large data sets using SQL methodologies; collaborate with business analysts and architects to define requirements.
Seniority
Senior, hands-on IC