Big Data Engineer
Core
Designing and building large-scale data processing applications using Hadoop ecosystem components to handle structured and unstructured data.
Role type
Senior Big Data Engineer
Builds
High-performance data processing applications and RESTful web services
Domain
Big Data, Distributed Systems, Java Development
Deliverable
production ML models | product features | infrastructure
Required skills
Java application development, Hadoop ecosystem (HDFS, HBase, Hive, Sqoop, Kafka, Storm), MapReduce, Python, HiveQL, RESTful web services, large-scale application architecture
Preferred skills
Vendor management, staff augmentation, outcome-based project delivery, statement of work planning, demand forecasting
Technologies
Hadoop, HDFS, HBase, Hive, Sqoop, Kafka, Storm, MapReduce, Python, Java, RESTful APIs
Responsibilities
Develop and code applications leveraging Hadoop components, build RESTful web services, manage large-scale complex applications with high performance needs, lead and manage on-site and off-site staff
Seniority
Senior, hands-on IC with management responsibilities