Software Engineer - Ingestion & Integrations
Core
Enhance Python-based ingestion frameworks and build connectors for major systems to ingest usage statistics, lineage, and operational metadata into a cloud-native environment.
Role type
Senior Software Engineer (Ingestion & Integrations)
Builds
Ingestion framework and connectors for modern data and ML stacks
Domain
Data infrastructure & AI observability
Deliverable
production ML models
Required skills
Python, distributed systems, cloud-native architecture, data pipeline design, fault tolerance, scalability
Preferred skills
Modern data stack tools, ML ecosystem familiarity
Technologies
Python, Snowflake, Redshift, Kafka
Responsibilities
Enhance ingestion framework to support usage statistics, lineage, and operational metadata; Build connectors for major systems in the modern data and ML stacks; Enable the ingestion framework to run in a cloud native environment
Seniority
Senior, hands-on IC
