Data Engineer, Data Products
Core
Own complex consumer-data domains end-to-end, transforming messy raw signals into trusted attributes and production data products for AI agents and applications.
Role type
Senior IC data engineer (consumer data products)
Builds
Production data products, ingestion/transformation pipelines, domain models, and derived attributes for Minerva's consumer graph
Domain
Consumer data, identity resolution, marketing analytics, AI/ML data infrastructure
Deliverable
production ML models | product features
Required skills
Python, SQL, data modeling, data cleaning, ingestion pipeline design, productionization, first-principles reasoning, data problem solving
Preferred skills
Orchestration (Dagster, Airflow, Prefect), transformation (dbt, SQLMesh), analytical databases (Snowflake, Redshift, BigQuery), lakehouse systems (Spark, Iceberg, Trino, AWS Glue), AWS, ML ops/feature engineering, AI coding tools
Technologies
Dagster, dbt-core, Snowflake, Spark, Iceberg, Trino, AWS Glue, Postgres, Elasticsearch, OpenAI, Anthropic
Responsibilities
Investigate and evaluate large, unfamiliar datasets; design durable domain models and entity relationships; build and operate ingestion/transformation pipelines with validation and observability; define quality checks and provenance for data outputs; partner with data scientists and product teams to solve ambiguous business questions; identify new data sources to improve the consumer graph
Seniority
Mid-Senior, hands-on IC