Senior Data Engineer
Core
Design and build a multi-source data platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows to enable trusted data for downstream products.
Role type
Senior IC data engineer (platform)
Builds
Production data platforms and pipelines
Domain
Data infrastructure and analytics
Deliverable
production ML models
Required skills
Python (async/concurrent), SQL, PostgreSQL, workflow orchestration (Airflow/Dagster/Prefect), dbt, Google Cloud Platform, event-driven systems, data contracts, pipeline testing, monitoring
Preferred skills
Web scraping, entity resolution, LLM-based extraction, BigQuery, Dataform
Technologies
Airflow, Dagster, Prefect, dbt, Google Cloud Storage, PostgreSQL, BigQuery, Dataform, asyncio, aiohttp, HTTPX
Responsibilities
Design and build multi-source data platforms; Ingest data from APIs, webhooks, files, and scraping; Orchestrate scheduled workflows and backfills; Build event-driven systems with messaging/queues; Transform data with dbt; Implement idempotent upserts and data validation; Optimize PostgreSQL schemas and loading patterns
Seniority
Senior, hands-on IC