MANAGER, DATA ENGINEERING
Core
Lead data engineering initiatives to transform structured and unstructured data into physical data models for business intelligence, advanced analytics, and machine learning systems.
Role type
Manager, Data Engineering
Builds
ETL/ELT processes, data pipelines, APIs, and optimized big data/ML systems
Domain
Semiconductor manufacturing, Big Data, Cloud Data Engineering
Deliverable
production ML models
Required skills
Big Data Engineering, ETL/ELT development, Data warehouse modeling, Cloud data engineering, API development, Data cleaning and imputation, Performance optimization
Preferred skills
Hadoop stack (Hadoop, Hive, HDFS, Spark, HBase), Apache Ni-Fi, SQL, Python or Scala, UI and AI development
Technologies
Hadoop, Hive, HDFS, Spark, HBase, Apache Ni-Fi, Python, Scala, SQL
Responsibilities
Determine transformation requirements and develop processes to bring data from source to a new physical Data Model; Implement strategies for cleaning and preparing data for analysis; Optimize performance of big data and machine learning systems; Develop ETL/ELT processes using frameworks like Apache Ni-Fi; Build APIs for application integration.
Seniority
Manager, hands-on leadership
