Senior Data Engineer
Core
Design, build, and operate a scalable data platform transforming information from multiple sources into reliable company intelligence.
Role type
Senior Data Engineer
Builds
Scalable data platform, ingestion pipelines, orchestrated workflows, and data layers
Domain
Cloud data engineering, event-driven systems, data infrastructure
Deliverable
production ML models
Required skills
Python (async/concurrent), SQL/PostgreSQL, Cloud GCP, Workflow orchestration (Airflow/Dagster/Prefect), Data modeling, Data quality monitoring, Event-driven architecture, Web scraping, LLM-based extraction
Preferred skills
Startup/small team experience, Entity resolution, Data enrichment
Technologies
Google Cloud Platform, dbt, Airflow, Dagster, Prefect, Temporal, PostgreSQL, Python, asyncio, aiohttp, HTTPX
Responsibilities
Design and build multi-source data platform supporting concurrent ingestion and event-driven processing; Develop ingestion pipelines for APIs, webhooks, files, and web scraping; Orchestrate scheduled workflows and historical data backfills; Build messaging and task queue workflows with retries and dead-letter queues; Store original data payloads and transform information with dbt; Implement idempotent upserts, data contracts, and automated validation; Design and optimize PostgreSQL schemas; Integrate data enrichment and LLM-based structured extraction; Take ownership of platform architecture, deployment, and production operations; Identify bottlenecks and strengthen pipeline reliability.
Seniority
Senior, hands-on IC