Senior Data Engineer
Core
Design and build a multi-source data ingestion and processing platform that transforms information from multiple sources into reliable company intelligence.
Role type
Senior IC data engineer (platform ownership)
Builds
End-to-end data platform for downstream products
Domain
Data infrastructure, cloud platforms, event-driven systems
Required skills
Python (async/concurrent), SQL, PostgreSQL, workflow orchestration (Airflow/Dagster/Prefect), dbt, Google Cloud Platform, data modeling, event-driven architecture, data validation/testing
Preferred skills
LLM-based extraction, web scraping, entity resolution, BigQuery, Dataform
Technologies
Google Cloud Storage, PostgreSQL, Airflow, Dagster, Prefect, dbt, asyncio, aiohttp, HTTPX
Responsibilities
Design and build multi-source ingestion platform; Develop resilient intake from APIs, webhooks, files, and scraping; Orchestrate scheduled workflows and backfills; Build event-driven processing with messaging/queues; Store payloads and transform data with dbt; Implement idempotent upserts and data contracts; Optimize PostgreSQL schemas; Integrate LLM-based extraction.
Seniority
Senior, hands-on IC
