Staff Data Engineer (8-10 years' exp - Java/Python, Scala, Spark, Hadoop)
Core
Design, implement, and improve scalable data systems and pipelines, bridging legacy SQL Server warehouses with modern Hadoop/Databricks platforms to support AI-driven insights and fintech business outcomes.
Role type
Staff Data Engineer (Legacy Modernization & AI Data Orchestration)
Builds
Hybrid data pipelines, ETL/ELT frameworks, and AI-integrated data provisioning systems for Visa's global payments platform.
Domain
Fintech / Payments / Data Engineering
Deliverable
production ML models
Required skills
Python, Java, Scala, SQL, T-SQL, Spark, Hadoop, Databricks, Kafka, Airflow, Delta Lake, AWS, Azure, Kubernetes, Docker, Terraform, Data Modeling, Data Governance, RAG pipelines, Vector databases
Preferred skills
SQL Server to Hadoop/Spark migration, LangChain, LangGraph, MCP integration, Data lineage management, Global team collaboration
Technologies
Python, Java, Scala, SQL, T-SQL, Spark, Hadoop, Databricks, Delta Lake, Snowflake, Kafka, Airflow, Glue, Azure Data Factory, LangChain, LangGraph, Docker, Kubernetes, Terraform, Jenkins, Great Expectations, Atlas
Responsibilities
Migrate SQL Server data warehouses to Hadoop/Databricks; Build scalable distributed data pipelines using Spark and Kafka; Mentor junior engineers on legacy SQL Server maintenance; Enforce data security, governance, and compliance standards; Collaborate with ML teams on AI data provisioning and RAG pipelines.
Seniority
Staff, hands-on IC with mentorship