Data Engineer - Migration SAS vers Python - (X/F/H) (CDI)
Core
Building and operating production pipelines to validate equivalence between migrated Python code and legacy SAS programs for a major banking client.
Role type
Senior Data Engineer (Migration & Validation)
Builds
Automated data validation pipelines, test DAGs, and regression monitoring dashboards.
Domain
Banking / Financial Services
Deliverable
production ML models | product features | dashboards & analysis
Required skills
DuckDB (EXCEPT, FULL OUTER JOIN, Parquet optimization), Apache Airflow (DAGs, SLA, retry), Python (pytest, assertions), Apache Parquet/PyArrow, LakeFS, SQL
Preferred skills
Apache Superset, AWS CloudWatch, JIRA
Technologies
DuckDB, Apache Airflow, Python, pytest, Apache Parquet, PyArrow, LakeFS, Apache Superset, AWS CloudWatch, JIRA
Responsibilities
Build and operate double-run pipelines on production data to compare SAS and Python results; Implement DuckDB-based comparison logic; Manage LakeFS branches for test data; Develop Airflow DAGs for test orchestration; Build dashboards to track non-regression KPIs.
Seniority
Senior, hands-on IC
