Data Engineer
Core
Building and extending platforms for managing data at scale, including ingestion, processing, storage, and egress for a payments and banking infrastructure.
Role type
Senior Data Engineer
Builds
Data pipelines, streaming solutions, data lakes, warehouses, and operational data stores for The Stack Group (payments, banking, consumer finance).
Domain
Fintech / Payments / Banking
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Kafka, Debezium, Apache Airflow, Terraform, Kubernetes, Helm, MySQL, PostgreSQL, MongoDB, Redshift, BigQuery, SingleStore, CI/CD, Unit/Integration Testing
Preferred skills
JavaScript, Scala, AWS, Databricks, Dagster, Airbyte, Tableau, Looker, DOMO, Basic Machine Learning concepts
Technologies
Kafka, Debezium, Kafka Connect, Apache Airflow, Terraform, Kubernetes, Helm, MySQL, PostgreSQL, MongoDB, Redshift, BigQuery, SingleStore, AWS
Responsibilities
Design and maintain ETL/ELT data pipelines; Implement real-time data streaming solutions; Build and maintain workflow orchestration; Manage relational, NoSQL, and big data systems; Provision infrastructure via IaC; Develop CI/CD pipelines; Conduct testing for code quality and data integrity; Monitor production systems and resolve faults.
Seniority
Senior, hands-on IC
