Senior Data Engineer
Core
Design and build a multi-source data platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows to power downstream products with trusted data.
Role type
Senior IC data engineer (platform)
Builds
Data ingestion pipelines, event-driven systems, and orchestrated batch workflows
Domain
Data infrastructure and analytics
Required skills
Airflow, dbt, Google Cloud Platform, Python, SQL, PostgreSQL, web scraping, data orchestration, data quality checks
Preferred skills
Entity resolution, BigQuery, Dataform, LLM-based structured extraction
Technologies
Airflow, Dagster, Prefect, Google Cloud Storage, dbt, PostgreSQL, BigQuery, Scrapy, Playwright, Selenium, asyncio, aiohttp, HTTPX
Responsibilities
Design and build multi-source data platforms; ingest data from APIs, webhooks, files, and web scraping; orchestrate scheduled workflows and historical backfills; build messaging and task queue workflows; transform data into raw, standardized, and curated layers; develop idempotent upserts and automated quality checks; optimize PostgreSQL schemas; integrate data enrichment and LLM-based extraction.
Seniority
Senior, hands-on IC
