Senior Data Engineer — Knowledge Ingestion
Core
Build four source connectors and an ingestion pipeline to turn raw knowledge content into a governed, permission-tagged corpus in S3 and Amazon Bedrock Knowledge Bases.
Role type
Senior Data Engineer (Knowledge Ingestion)
Builds
Ingestion pipelines for Oracle B2C Service, SharePoint, OneDrive, Teams, and Sitecore content into S3 and Bedrock Knowledge Bases.
Domain
Enterprise AI, Knowledge Management, Cloud Data Engineering
Deliverable
production ML models
Required skills
Python, AWS (S3, Bedrock Knowledge Bases), Microsoft Graph API, Terraform or AWS CDK, API integration, document parsing, idempotent pipeline design
Preferred skills
AWS Certified Data Engineer Associate, Oracle B2C Service integration, Sitecore XM/XP integration, AWS Glue/Step Functions/EventBridge
Technologies
Python, AWS, S3, Amazon Bedrock, Microsoft Graph, Oracle B2C Service, Sitecore, Terraform, AWS CDK, CloudWatch
Responsibilities
Build connectors for Oracle B2C Service, SharePoint, OneDrive, Teams, and Sitecore; implement ingestion pipeline with deduplication and metadata enrichment; handle API throttling, backoff, and failure isolation; instrument pipelines with CloudWatch metrics; implement retirement handling; pair with client IT for transition.
Seniority
Senior, hands-on IC
