Senior Software Engineer
Core
Design, build, and maintain scalable, production-grade ETL/ELT pipelines and data warehouse/lake architecture for the GPN Lakehouse, integrating AI/ML for automated data classification and anomaly detection.
Role type
Senior Data Engineer (Software Engineer)
Builds
Data pipelines, data warehouse/lake architecture, and AI-powered data transformation solutions
Domain
Payments / Data Engineering
Deliverable
production ML models
Required skills
ETL/ELT pipeline design, Apache Airflow, DBT, Spark, Google Cloud Platform (GCP), BigQuery, Cloud SQL, Cloud Functions, Cloud Storage, Cloud Datastore, YAML, JSON, GitHub, Jira, Confluence, data modeling, unit testing, code quality assurance
Preferred skills
MLOps, AI-powered data transformation, AI agents for automated data processing, natural language processing, AI-enabled data pipelines
Technologies
Apache Airflow, DBT, Spark, GCP, BigQuery, Cloud SQL, Cloud Functions, Cloud Storage, Cloud Datastore, GitHub, Jira, Confluence, Rally, VSTS
Responsibilities
Design and maintain scalable ETL/ELT pipelines; Develop and deploy solutions using YAML, JSON, and Google Cloud Shell scripting; Establish and manage robust deployment pipelines; Translate complex business requirements into scalable technical solutions; Own responsibility for comprehensive unit testing and code quality assurance; Continuously enhance and optimize existing applications
Seniority
Senior, hands-on IC