Data Engineering - Research Assistant
Core
Build and run Python-based data pipelines, prepare and validate data in databases, and implement search/retrieval components for national security research.
Role type
Junior IC data engineering research assistant
Builds
Data pipelines, database schemas, and search/retrieval components for intelligence analysis and cybersecurity projects
Domain
National security, intelligence analysis, cybersecurity, AI/ML
Deliverable
production ML models | infrastructure
Required skills
Python programming, data pipeline/ETL design, database management (SQL/NoSQL), Linux command-line, Git workflow, unit testing (Pytest), containerization (Docker)
Preferred skills
Vector similarity search/embeddings, information retrieval/NLP, REST API development (FastAPI/Flask), DevOps/CI-CD concepts, data classification/access control
Technologies
Python, MongoDB, PostgreSQL, JSON Schema, Qdrant, pgvector, FAISS, sentence-transformers, FastAPI, Flask, Docker, Pytest
Responsibilities
Build and run Python-based data pipelines, prepare and load data into databases, validate loaded data, implement search and retrieval components, write and execute tests, troubleshoot system errors
Seniority
Junior, hands-on IC
