Senior Data Engineer
Core
Design and build a multi-source data platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows to power downstream products with trusted data.
Role type
Senior IC data engineer (platform)
Builds
End-to-end data ingestion, processing, and storage pipelines
Domain
Data engineering, cloud infrastructure, event-driven systems
Required skills
Python (async/concurrent), SQL, PostgreSQL, workflow orchestration, dbt, Google Cloud Platform, event-driven systems, data modeling, pipeline testing, monitoring
Preferred skills
Web scraping, entity resolution, data enrichment, BigQuery, Dataform, LLM-based extraction, building platforms from scratch
Technologies
Airflow, Dagster, Prefect, Temporal, Google Cloud Storage, PostgreSQL, BigQuery, dbt, asyncio, aiohttp, HTTPX
Responsibilities
Design and build multi-source data platforms; ingest data from APIs, webhooks, files, and scraping; orchestrate scheduled workflows and backfills; build event-driven systems with messaging/queues; store payloads and transform data with dbt; implement idempotent upserts, data contracts, validation, and monitoring; optimize PostgreSQL schemas and loading patterns.
Seniority
Senior, hands-on IC
