Senior Data Engineer
Core
Design and operate a multi-source data platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows to provide reliable company intelligence.
Role type
Senior Data Engineer (Data Infrastructure)
Builds
Data ingestion pipelines, event-driven processing systems, and curated data layers
Domain
Data Engineering, Cloud Infrastructure
Required skills
Workflow orchestration (Airflow/Dagster/Prefect), dbt, Google Cloud Platform, Python (async/concurrent), SQL/PostgreSQL, Event-driven systems, Data contracts, Pipeline monitoring
Preferred skills
Web scraping, Entity resolution, BigQuery, Dataform, LLM-based extraction
Technologies
Airflow, Dagster, Prefect, dbt, Google Cloud Platform, PostgreSQL, BigQuery, Python, asyncio, aiohttp, HTTPX
Responsibilities
Design multi-source data platforms, build ingestion from APIs/webhooks/files/scraping, orchestrate scheduled workflows and backfills, develop event-driven processing with retries, transform data with dbt, implement idempotent upserts, define data contracts and validation, optimize PostgreSQL schemas
Seniority
Senior, hands-on IC
