Data Engineer
Core
Designing and maintaining cloud-native data architectures and pipelines to support a decentralized Data Mesh organization, enabling analytics and AI-ready data products for internal and external consumption.
Role type
Senior IC Data Engineer (AWS Cloud & Data Mesh)
Builds
Scalable data pipelines, data products, and processing environments on AWS PaaS.
Domain
Cloud Data Engineering, Data Mesh, AWS Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
AWS services (Glue, EMR, S3, MWAA, Redshift, Sagemaker), Python, PySpark, SQL, Medallion architecture, Data Mesh concepts, Relational databases (Postgres, Oracle, SQL Server), IaC (CloudFormation), CI/CD (GitLab), Git versioning, Data modeling, Legacy-to-modern migration
Preferred skills
Terraform, Spatial Data Processing, Machine Learning/AI workflows, Jira
Technologies
AWS (Glue, EMR, S3, MWAA, Step Functions, Redshift, Sagemaker Unified Studio, Aurora, Snowflake), Python, PySpark, SQL, CloudFormation, GitLab, Terraform
Responsibilities
Design and implement data processing environments and integrations using AWS PaaS; Build data processing and analytics pipelines as code; Design and apply security and access control architectures; Collaborate across departments to develop and maintain data products; Enable business units by delivering complete and manageable solutions.
Seniority
Mid-Senior, hands-on IC