Data Engineering Lead
Core
Lead the transformation of legacy SAS-based file systems into scalable AWS Cloud Native data architectures, ensuring data integrity and visibility across a system-of-systems modernization.
Role type
Senior Data Engineering Lead (Cloud Migration & Architecture)
Builds
Cloud-native data pipelines, ingestion workflows, and governed data models on AWS.
Domain
Cloud Data Engineering / Legacy Modernization
Deliverable
production ML models | infrastructure
Required skills
Python (expert), AWS data services (Glue, Lambda, S3, Aurora/Postgres, EventBridge), ETL/ELT design, data modeling, automated validation frameworks, CI/CD integration, Terraform/CloudFormation.
Preferred skills
SAS environment modernization, system-of-systems integration, data lineage management, regulated/federal environment experience.
Technologies
AWS (S3, Glue, Lambda, EventBridge, SNS/SQS, Aurora, Postgres, Athena, Batch), Python, Terraform, CloudFormation, QuickSight.
Responsibilities
Design target-state data models aligned with AWS Cloud Native architecture; Develop advanced Python-based data transformation and validation pipelines; Architect scalable serverless and containerized data processing architectures; Implement automated data validation frameworks for functional equivalence and consistency; Coordinate data model alignment with application modernization workstreams; Integrate data pipelines into CI/CD frameworks and support infrastructure-as-code alignment.
Seniority
Senior, hands-on IC with leadership responsibilities