Data Integration Engineer (Databricks / Python / SQL)
Core
Build and maintain production-grade data integrations for an AI-assisted KYC/Customer Due Diligence platform serving international insurance clients.
Role type
Senior Data Integration Engineer
Builds
Production data pipelines, connectors, and data models for KYC and financial crime prevention
Domain
Financial Services / AI / Data Engineering
Deliverable
production ML models
Required skills
Databricks, Python/PySpark, SQL, Data Modeling, Data Contracts, API Integration, Legacy System Integration, Data Quality, Batch Processing, SFTP
Preferred skills
Delta Lake, Unity Catalog, REST APIs, DB Links
Technologies
Databricks, SQL Server, PySpark, REST APIs, SFTP
Responsibilities
Inventory and map internal and external data sources; Define data contracts and canonical data structures; Build connectors to external screening providers and public registers; Connect Databricks with SQL Server and legacy databases; Support API, database-link, batch, file, and SFTP-based integrations; Design and maintain data models for evidence and audit trails; Implement data quality checks and retention rules; Validate incoming and outgoing data flows; Support integration troubleshooting and production-readiness activities.