VN Technology Data Engineer - Analysis Platform
Core
Build and operate data pipelines and warehouses to support an ML-centric analysis platform for a manufacturing digital transformation product.
Role type
Senior Data Engineer (Analysis Platform)
Builds
Batch and streaming data pipelines, governed data warehouses, and analytics datasets for ML teams and product management.
Domain
Manufacturing / Data Engineering / Machine Learning Infrastructure
Deliverable
production ML models | dashboards & analysis | infrastructure
Required skills
SQL, Python, ETL/ELT pipeline orchestration, cloud data warehouse management, data quality governance, cloud platform development
Preferred skills
dbt, streaming data processing, data lake/lakehouse architecture, data observability, infrastructure as code, ML pipeline development
Technologies
BigQuery, Airflow, dbt, Spark, Google Cloud, Argo Workflows, Vertex AI, Kafka, Terraform
Responsibilities
Design and maintain data pipelines ingesting data from databases and event streams; model data warehouses for business reuse; implement data quality checks and contracts; define core metrics and event taxonomies; collaborate with ML engineers and PMs to enable data-driven validation.
Seniority
Senior, hands-on IC