Data Engineer
Core
Design, build, and maintain scalable data lakehouse solutions and real-time ingestion pipelines on AWS to support global payments and banking services.
Role type
Senior Data Engineer (Cloud & Data Platform)
Builds
Scalable data lakehouse solutions, real-time streaming pipelines, and business-ready data products for a global payments platform.
Domain
Fintech / Global Payments / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
SQL, Python, PySpark, AWS (S3, Glue, EMR, IAM), Apache Iceberg, Apache Kafka, Debezium, Apache Airflow, Terraform, Data Modeling (Medallion Architecture), CDC, Data Quality & Governance
Preferred skills
Apache Druid, ClickHouse, Snowflake, Databricks, dbt, Docker, Kubernetes, Data Visualization (Tableau, Power BI, Superset), Data Observability
Technologies
AWS (S3, Glue Catalog, Glue Jobs, EMR, IAM, EKS), Apache Iceberg, Apache Kafka, Debezium, Apache Airflow, Airbyte, PySpark, Terraform, Terragrunt, MySQL, MariaDB, PostgreSQL
Responsibilities
Design and maintain scalable data lakehouse solutions on AWS; Build and support real-time and near-real-time ingestion pipelines; Design and implement silver and gold layer datasets; Develop and maintain batch and distributed processing jobs; Build and maintain data workflows using Apache Airflow; Implement data quality checks, validation processes, and reconciliation logic; Collaborate on AWS infrastructure and deployment practices using Infrastructure-as-Code.
Seniority
Senior, hands-on IC