Hadoop Developer /SME
Core
Designing, developing, and maintaining batch and real-time ETL pipelines and data processing systems using the Hadoop ecosystem to create insights and analytics.
Role type
Senior Hadoop Developer / SME
Builds
Production ETL pipelines, data processing systems, and analytics solutions
Domain
Big Data, Data Warehousing, Enterprise IT
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Hadoop ecosystem (Hive, Kafka, Flink, Druid), ETL development, Java/Scala/C++/Python, SQL, Oracle, SQL Server, MySQL, MicroStrategy, Business Objects, SAS, Informatica, IDQ, Linux/Mac OS administration, Git, Jira, DevOps practices
Preferred skills
PMP certification, database design, cloud services, microservices architecture
Technologies
Hadoop, Hive, Kafka, Flink, Druid, MongoDB, Oracle, SQL Server, MySQL, Informatica, IDQ, MicroStrategy, Business Objects, SAS, Jira, Git, MKS
Responsibilities
Design, develop, program, install, implement, and maintain internal data processing computer systems; analyze customer needs and determine equipment/software requirements; develop customized solutions to user problems; establish system parameters and ensure hardware/software compatibility; lead multi-disciplinary projects involving business process reengineering and BI best practices; assess existing technical frameworks to accommodate new situations; present strategic recommendations based on complex analysis.
Seniority
Senior, hands-on IC with strategic leadership capabilities