Senior Data Engineer
Core
Design and build a multi-source data platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows to provide trusted data for downstream products.
Role type
Senior Data Engineer
Builds
Production data platform
Domain
Cloud data infrastructure
Deliverable
production ML models
Required skills
Python (async/concurrent), SQL, PostgreSQL, dbt, workflow orchestration (Airflow/Dagster/Prefect), event-driven systems, data quality monitoring
Preferred skills
Web scraping, entity resolution, LLM-based extraction, startup experience
Technologies
Google Cloud Platform, Airflow, Dagster, Prefect, Temporal, PostgreSQL, dbt, asyncio, aiohttp, HTTPX
Responsibilities
Design and build multi-source data platform; Ingest data from APIs, webhooks, files, and web scraping; Orchestrate scheduled workflows and historical backfills; Build messaging and task queue workflows; Store payloads and transform data with dbt; Implement idempotent upserts and data validation; Optimize PostgreSQL schemas and integrate LLM-based extraction
Seniority
Senior, hands-on IC
