AI Led Data Engineer(AWS+Textract+Comprehend+Pyspark) - Associate 2
Core
Design and build data pipelines, integration, and transformation solutions using AWS services to support client work in Data and Analytics Engineering.
Role type
Associate Data Engineer (AI-led)
Builds
Cloud-based data pipelines and integration workflows
Domain
Data Engineering / Cloud / AI
Deliverable
production ML models
Required skills
PySpark, AWS Textract, AWS Comprehend, Apache Airflow, Data Modeling, Schema Design, Data Validation, Data Lake/Warehouse Management, Pipeline Orchestration
Preferred skills
Data Modernization, Cloud Platforms, Data Integration, Data Quality, Adaptability to Client Needs
Technologies
AWS, Textract, Comprehend, PySpark, Apache Airflow
Responsibilities
Designing and building data pipelines and integration workflows across cloud-based platforms; Developing data transformation logic using PySpark; Implementing AWS services (Textract, Comprehend) for content extraction and classification; Creating data validation checks and quality controls; Supporting data lake and data warehouse structures; Collaborating on data modeling, schema design, and pipeline troubleshooting; Applying automation and orchestration tools like Apache Airflow; Working across client engagements to gather requirements and support delivery.
Seniority
Associate, hands-on IC