Data Engineer
Core
Design scalable data architectures and retrieval solutions for CMSPI's payments intelligence platform, building reliable analytics workflows and supporting client onboarding.
Role type
Data Engineer
Builds
Secure data retrieval/ingestion capabilities, analytics workflows, and client onboarding solutions for a payments intelligence platform.
Domain
Fintech / Payments / Data Engineering
Deliverable
production ML models | product features
Required skills
ETL/ELT workflow design, Microsoft Azure (Data Factory, Data Lake, Functions, Key Vault), Databricks (Workflows, Delta Lake, Unity Catalog), Python (functional/OO, requests, Selenium, Playwright), API design, web scraping, SFTP integration, CI/CD pipelines, automated testing, cloud deployment.
Preferred skills
Terraform/Bicep, Docker/Kubernetes, Scala, PowerShell, YAML, Agile squad experience, payments domain knowledge.
Technologies
Azure, Databricks, Python, Spark, Hadoop, Delta Lake, Unity Catalog, Selenium, Playwright, Terraform, Bicep, Docker, Kubernetes
Responsibilities
Design scalable data architectures across APIs, web scrapers, and SFTP; deliver efficient client data onboarding; collaborate with engineers and stakeholders in an Agile squad; maintain software quality via code reviews and automated testing; troubleshoot production issues; adopt best practices for reusable Python libraries and maintainable code.
Seniority
Mid-level, hands-on IC
