MANAGER, DATA ENGINEERING
Core
Design and implement data engineering pipelines to transform structured and unstructured data into optimized physical data models for analysis and machine learning systems.
Role type
Manager, Data Engineering
Builds
ETL/ELT processes, data warehouse models, and APIs for application integration
Domain
Semiconductor manufacturing / Big Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Big Data Engineering (Hadoop, Hive, Spark, HBase), ETL/ELT development (Apache Ni-Fi), SQL and database modeling, Python or Scala programming, data analysis and validation, data imputation algorithm development
Preferred skills
Cloud-based data engineering, API development for application integration, UI and AI development
Technologies
Hadoop, Hive, HDFS, Spark, HBase, Apache Ni-Fi, Python, Scala
Responsibilities
Determine transformation requirements and develop processes to bring data from source to new physical Data Model; Implement strategies for cleaning, preparing, and optimizing big data and machine learning systems; Develop ETL/ELT processing pipelines; Build APIs for application integration
Seniority
Manager, hands-on IC with team leadership
