Senior Data Engineer with Python (IR-491)
Core
Design and build scalable data pipelines and models for an AI-powered analytics platform serving diverse industries.
Role type
Senior Data Engineer (Python/Spark)
Builds
Production data pipelines, data models, and POCs for AI/ML features
Domain
Fintech, Healthcare, EdTech, Construction, Hospitality
Deliverable
production ML models | product features
Required skills
Python, SQL, Apache Spark, Apache Airflow, Cloud platforms (AWS/Azure/GCP), Git, CI/CD, FastAPI
Preferred skills
LLMs, Vector Databases, Semantic Search, Knowledge Graphs, RAG architectures
Responsibilities
Design and build scalable data pipelines using PySpark, collaborate with data science teams on model features, create standardized data models, troubleshoot ETL pipelines, conduct technology POCs, document technical updates
Seniority
Senior, hands-on IC
Sourced via workable · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.