Sr. Data Engineer
Core
Designing, building, and evolving large-scale data platforms and services that power reporting, analytics, and data products across Visa.
Role type
Senior IC data engineer (enterprise-scale platforms)
Builds
Scalable, reliable data pipelines and reusable platform capabilities across modern cloud and big data environments
Domain
Financial services / Big data engineering
Deliverable
production ML models
Required skills
Spark/PySpark, Kafka, Hadoop, Hive, data pipeline architecture, data governance, observability, CI/CD automation, distributed systems troubleshooting
Preferred skills
Apache Airflow, Generative AI, enterprise-scale platform design, real-time streaming architectures, data quality frameworks
Technologies
Spark, PySpark, Kafka, Hadoop, Hive, Airflow, Cloud platforms
Responsibilities
Design and optimize large-scale data pipelines for batch and real-time processing; Architect data models and reusable frameworks; Build shared platform capabilities and automation; Improve pipeline performance and reliability through tuning and monitoring; Automate deployment and delivery processes; Establish automated quality gates and validation practices; Troubleshoot complex distributed-system issues; Mentor engineers and lead technical initiatives
Seniority
Senior, hands-on IC with mentorship responsibilities