Data Mining & OSINT Automation Specialist (m/f/d)
Core
Build autonomous agents and web scrapers to extract hidden knowledge from unstructured texts, web registries, and documents for an intelligence engine.
Role type
Senior IC data mining and OSINT automation engineer
Builds
Autonomous data extraction agents and pipelines feeding a central PostGIS Data Lake
Domain
Open-source intelligence (OSINT), spatial data analysis, infrastructure mapping
Deliverable
production ML models
Required skills
Python, web scraping (Playwright, Scrapy, Selenium, BeautifulSoup), OCR, regex, NLP, JSON/XML/HTML/PDF parsing, PostGIS
Preferred skills
German language skills, Master's degree
Technologies
Python, Playwright, Scrapy, Selenium, BeautifulSoup, PostGIS, OCR, NLP
Responsibilities
Develop scalable web scrapers and autonomous agents; Parse unstructured web and document data into relational structures; Apply OCR, regex, and NLP to extract structured entities; Automate monitoring scripts to feed fresh data into the Data Lake