Senior Software Engineer - Python (Contract)
Core
Building large-scale data ingestion, classification, and search systems for auto repair shops.
Role type
Senior Software Engineer (Data Engineering)
Builds
Distributed crawling bots, data pipelines, and search infrastructure for auto repair industry data.
Domain
Auto repair industry / Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, web scraping, data processing, search technologies, API integration, PDF processing, cloud infrastructure, automation
Preferred skills
NLP, Machine Learning, LLMs, Kubernetes, high-scale data environments
Technologies
Scrapy, Airflow, Kubernetes, AWS, Spark, ElasticSearch, OpenSearch, React, OCR, Tesseract, PyMuPDF
Responsibilities
Design and build distributed crawling bots operating in adversarial environments; develop and maintain data pipelines for web pages, documents, and APIs; unify heterogeneous documents into a coherent data schema; preprocess and normalize raw data for classification and search; build APIs to expose structured data; automate workflows and deploy solutions on AWS; optimize and scale data pipelines using Spark.
Seniority
Senior, hands-on IC
