Big Data Engineer
Core
Design, develop, and implement large-scale data infrastructure and database instances for structured and unstructured data collection and analytics.
Role type
Senior Big Data Engineer
Builds
Cloud-based Big Data infrastructure (Hadoop ecosystem, RDBMS) and data pipelines for analytics
Domain
Data Management / Big Data / Cloud Infrastructure (via careerplan.io/jobs/91745536-big-data-engineer-at-usm)
Deliverable
production ML models | infrastructure
Required skills
RDBMS (MySQL, PostgreSQL), Big Data platforms (Hadoop, Hive, HBase, Spark), ETL, Data Modeling, Cloud Storage (AWS, GCP), Server Management, Performance Tuning, Capacity Planning
Preferred skills
Hadoop ecosystem tools (Impala, Pig, Flume, Oozie, Mahout), Tableau, R, Python, MongoDB
Technologies
Hadoop, Hive, HBase, Impala, Pig, Flume, Oozie, Sqoop, Zookeeper, AWS, Google Cloud Platform, MySQL, PostgreSQL, Tableau, R, Python, Spark, MongoDB
Responsibilities
Design and implement database instances for development and production environments; Manage servers in large-scale, geographically diverse environments; Plan architectures and infrastructures for data management processes; Conduct performance tuning, backup/recovery, and scalability/capacity planning; Deploy cost-effective Big Data infrastructure installations (cloud, appliance, software).
Seniority
Senior, hands-on IC
