CareerPlan

Staff Data Platform Engineer (AWS, Databricks, Azure, IaC, Solution Architect, Java/Python, 6 - 10 Years)

IN - Bengaluru, IndiaFull-time2026-09-30 → 2026-11-16

Core

Building, implementing, and operating cloud-based data platform capabilities to support Visa's migration of analytical and AI/ML workloads from Hadoop to AWS, Azure, and Databricks.

Role type

Staff Cloud Platform Engineer (Data Platform)

Builds

Scalable, secure, and reliable cloud data platform services and reusable engineering frameworks.

Domain

Financial Services / Cloud Data Engineering

Deliverable

production ML models

Required skills

Cloud data platform services (AWS EMR, Glue, Azure Databricks, Synapse), Databricks/Delta Lake/Lakehouse, Python/Scala/Java, Infrastructure-as-Code (Terraform, CloudFormation), Spark/Hadoop ecosystem, Data governance and security, Linux/Networking, CI/CD automation.

Preferred skills

Multi-tenant enterprise platforms, Kubernetes/EKS, Observability and reliability engineering, Cloud cost optimization, AI/ML platform support, Engineering mentorship.

Technologies

AWS, Azure, Databricks, Terraform, CloudFormation, Spark, Hadoop, Kubernetes, EKS, Delta Lake, Unity Catalog, Synapse Analytics, Data Factory, ADLS, EMR, EMR on EKS, Athena, S3, IAM, Lake Formation, Azure Kubernetes Service.

Responsibilities

Design and maintain scalable cloud data platform services; Build reusable platform capabilities and self-service onboarding solutions; Implement data integration pipelines and processing frameworks; Automate infrastructure provisioning and deployment using IaC; Monitor and optimize platform performance and cost efficiency; Provide technical guidance and mentorship to engineers.

Seniority

Staff, hands-on IC with mentorship