Senior Data Engineer (m/f/d)
Core
Build and run production data pipelines for company data ingestion, scraping, enrichment, entity resolution, and LLM extraction to power search, AI agents, and partner APIs.
Role type
Senior Data Engineer (production pipelines & data platform)
Builds
Ingestion pipelines, data models, entity resolution systems, LLM classification pipelines, and signal detection pipelines.
Domain
B2B data, corporate intelligence, market data
Deliverable
production ML models
Required skills
Python, SQL, Postgres, LLMs for extraction/classification, entity resolution, data pipeline orchestration, data quality testing
Preferred skills
dbt, Docker, AWS/GCP, GraphQL/Hasura, event pipelines, vector search
Technologies
Postgres, Hasura, Python, PostHog, LLM APIs, Airflow/Dagster/Prefect
Responsibilities
Build and monitor vendor feeds, APIs, and scraping jobs; design and migrate Postgres schemas; implement entity resolution and deduplication; develop LLM pipelines for unstructured data; create signal pipelines for funding/acquisitions; ensure data quality and observability.
Seniority
Senior, hands-on IC