Senior Data Engineer
Core
Deploying and operating a custom AWS data platform for a Japanese customer, evolving from MVP to production.
Role type
Senior Data Engineer (Cloud Infrastructure)
Builds
AWS data pipelines, backend services, and operational infrastructure for a single customer engagement.
Domain
Cloud Infrastructure / Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, AWS (SQS, SNS, EventBridge, Step Functions, Lambda), Terraform, Terragrunt, CI/CD, Observability, Incident Response, Capacity Planning, Cost Optimization
Preferred skills
Time-series data, High-throughput systems, Industrial/IoT context, MLOps, Spark, Databricks
Technologies
AWS, Python, Terraform, Terragrunt, Spark, Databricks
Responsibilities
Implement data pipelines and backend services in Python; Design and manage AWS infrastructure using Terraform/Terragrunt; Deploy platform end-to-end and validate against real data; Build CI/CD, observability, and runbooks; Own post-launch operations (incidents, performance, cost); Lead platform design evolution from MVP to production.
Seniority
Senior, hands-on IC