Lead Data Engineer
Core
Own the architecture, scalability, and technical direction of ACDP (Amtech Cloud Data Platform) to power analytics, personalization, and AI agent initiatives.
Role type
Lead Data Engineer (Technical Lead & Architect)
Builds
Data warehouses, tenant data stores, feature stores, event pipelines, and the data layer for hybrid AI/LLM reasoning.
Domain
Enterprise software for packaging/printing/manufacturing + Generative AI / Hybrid AI
Deliverable
production ML models | infrastructure
Required skills
Data warehousing (Snowflake, Redshift, BigQuery), Python/Java/Scala, Orchestration (Airflow, dbt, AWS Glue), Cloud platforms (AWS/Azure/GCP), Big data frameworks (Spark, Flink), Streaming (Kafka, Kinesis), SQL/NoSQL, Data governance & observability, Multi-tenant architecture design, Team mentoring.
Preferred skills
ERP/MES/Manufacturing data environments, IoT/OT data pipelines, GenAI tools (LangChain, vector DBs, RAG), Agent orchestration platforms, Hybrid AI architecture design.
Responsibilities
Design and build tenant registry and data warehouse layers; Govern Data Agent layer for hybrid AI; Define data classification and routing rules; Set engineering standards for ETL/ELT; Lead design/code reviews and mentor engineers; Drive pipeline automation and reliability; Own data security and governance; Partner with data scientists for ML-ready data; Build pipelines connecting ERP to Agent Hub; Guide GenAI/LLM data enablement; Optimize pipelines for low-latency access.
Seniority
Senior, hands-on IC with technical leadership
