Data Engineer
Core
Build and scale data pipelines and LLM-powered toolchains for a research intelligence platform processing 100M+ documents to create researcher and organization profiles.
Role type
Senior Data Engineer (LLM & Data Platform)
Builds
Scalable data pipelines, information extraction workflows, and customer insight tools for a research intelligence platform.
Domain
Research intelligence, scientific innovation, large-scale data processing
Deliverable
production ML models | infrastructure
Required skills
Python, data engineering, document and relational databases (MongoDB, PostgreSQL), cloud platforms (AWS), Elasticsearch, distributed processing (Spark/Hadoop), LLM-powered data processing
Preferred skills
Data warehousing, business intelligence solutions, web data scraping, quality assurance tooling
Technologies
Python, MongoDB, PostgreSQL, AWS (ECR, ECS, EC2, RDS, S3, CloudWatch), Elasticsearch, Spark, Hadoop
Responsibilities
Develop and scale data pipelines; integrate and update data from diverse sources; build LLM-powered toolchains for information extraction; develop scalable web data processing solutions; create QA and monitoring tools; build tools for generating customer insights.
Seniority
Senior, hands-on IC
