Data Engineer
Core
Designing and implementing automated scientific data extraction and standardization pipelines for the NIST CHIPS METIS initiative.
Role type
Senior Data Engineer (Scientific Data Pipelines)
Builds
Automated OCR and document layout analysis pipelines, data normalization tools, and microservices for scientific research data.
Domain
Federal Government / Scientific Research / Data Engineering
Deliverable
production ML models
Required skills
Python (Pandas), OCR pipelines, table extraction, data normalization, schema validation, microservices integration, REST APIs, GitHub, JSON Schema, XML/XSD
Preferred skills
Tesseract, PaddleOCR, pdfplumber, Camelot, LayoutParser
Responsibilities
Design and implement automated OCR and document layout analysis pipelines; Develop algorithms to extract figure captions, axis labels, and scientific metadata; Implement table extraction capabilities preserving row/column structures; Integrate extracted metadata with controlled vocabularies and ontologies; Develop and enhance user interfaces for content validation; Develop Python-based parser libraries for proprietary instrument outputs; Implement automated data normalization and quality assurance procedures; Integrate extraction tools as microservices within web application architecture; Prepare design documentation, API specifications, and deployment procedures; Monitor and report technical performance metrics; Collaborate with government scientists and technical stakeholders.
Seniority
Senior, hands-on IC