Data Engineer with Python and SQL Expertise
Core
Designing and building intricate data processing pipelines, streaming solutions, and cloud-native analytics platforms on AWS.
Role type
Senior Data Engineer (AWS Cloud & Big Data)
Builds
High-performance data pipelines, streaming solutions, and analytics infrastructure for business objectives.
Domain
Cloud Computing (AWS) / Big Data / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, AWS services (Redshift, Glue, Lambda, EMR, SageMaker), Hadoop, Spark, Terraform, Ansible, EKS, ECR, UNIX/Linux, API development, Infrastructure as Code (IaC), DevOps practices.
Preferred skills
AWS certifications, experience with data visualization tools (QuickSight), security management.
Technologies
AWS Lambda, Redshift, Ansible, Hadoop, Cloud, DevOps, EC2, Hadoop, Linux, Python, SQL, Spark, Terraform, Unix, AI, API
Responsibilities
Develop and resolve complex data engineering and integration functionalities using AWS services; provide technical guidance and collaborate with developers, architects, and data scientists; participate in peer code reviews and manage database defects; utilize DevOps skills to implement IaC and cloud-native capabilities; align technology solutions with business objectives.
Seniority
Senior, hands-on IC
