Senior Engineer (Python)
Core
Building large-scale data ingestion, classification, and search systems for auto repair shops using web scraping and distributed processing.
Role type
Senior Python Engineer (Data Infrastructure & Search)
Builds
Scalable data pipelines, crawling bots, and search indexes for OEM repair procedures.
Domain
Automotive / Data Engineering / Search
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, web scraping, data processing, search technologies, distributed systems, API integration, PDF processing, cloud infrastructure
Preferred skills
NLP, Machine Learning, LLMs, automated document classification, high-scale data environments
Technologies
Scrapy, Airflow, Kubernetes, AWS, Spark, ElasticSearch, OpenSearch, OCR, Tesseract, PyMuPDF
Responsibilities
Design and build distributed crawling bots operating in adversarial environments; develop data pipelines to extract and normalize data from web pages, PDFs, and APIs; preprocess data for downstream ML/NLP and search indexing; build APIs to expose structured data; collaborate with ML teams to integrate classification models; automate workflows and deploy solutions on AWS.
Seniority
Senior, hands-on IC
