Data Engineer (AWS) @ Capgemini
Core
Designing and maintaining scalable cloud-native data architectures and pipelines to process large unstructured datasets and power analytics and machine learning solutions.
Role type
Data Engineer (AWS Cloud)
Builds
Scalable data pipelines and cloud-native architectures for analytics and ML
Domain
Cloud computing, Big Data, Data Engineering
Deliverable
production ML models | infrastructure
Required skills
AWS cloud services (Storage, Compute, Serverless, Networking, DevOps), Big Data processing, Data visualization, Python, Scala, Java, Bash, SQL
Preferred skills
Orchestration tools (Airflow, Prefect), CI/CD pipelines, Streaming technologies (Kafka, Spark Streaming), Snowflake, Databricks
Technologies
AWS Glue, Redshift, Lambda, Athena, S3, Snowflake, Docker, Terraform, CloudFormation, Kafka, Airflow, Spark
Responsibilities
Process and visualize large unstructured datasets across SDLC phases, Implement and manage AWS cloud infrastructure, Develop data pipelines using modern frameworks and DevOps principles
Seniority
Mid-level to Senior, hands-on IC