Senior Consultant (Hadoop / Bigdata) - System Architect
Core
Design and deploy large-scale Hadoop and Big Data solutions for enterprise customers, optimizing performance and translating business requirements into technical architectures.
Role type
Senior System Architect (Big Data / Hadoop)
Builds
Production Hadoop clusters, data transformation pipelines, and distributed data processing solutions
Domain
Big Data, Open Source Data Platforms, Enterprise Infrastructure
Required skills
Hadoop ecosystem (HDFS, MapReduce, Hive, Pig), distributed systems architecture, systems administration, DevOps practices, network configuration, security (LDAP, Kerberos), configuration management (Ansible, Puppet, Chef), scripting (Python, Bash, Perl), Java ecosystem debugging and profiling
Preferred skills
NiFi, REST/JSON or XML/SOAP APIs, 3-tier architecture design
Technologies
Apache Hadoop, Apache Spark, Apache NiFi, Apache Hive, Apache Pig, Ansible, Puppet, Chef, JMX, log4j
Responsibilities
Analyze complex distributed production deployments and recommend performance optimizations; Deploy, augment, upgrade, and operate large Hadoop clusters; Document and present complex architectures to customer technical teams; Work with Hortonworks teams to ensure project consulting engagement success; Write technical documentation and knowledge-base articles
Seniority
Senior, hands-on IC
