CareerPlan

[Job-32448] Master Data Developer (Databricks), Colombia

ColombiaFull-time2026-10-28 → 2026-11-19

Core

Design, develop, and maintain scalable data infrastructure and pipelines, specifically migrating data architectures from Databricks to AWS (Glue, S3, EMR) using Databricks tools.

Role type

Senior Data Developer (Data Engineering & Migration)

Builds

Scalable data pipelines, ETL/ELT processes, and integrated data lakes/warehouses

Domain

Cloud Data Engineering, Data Migration, Big Data

Deliverable

production ML models | infrastructure

Required skills

Databricks (migrate tool, Unity Catalog, DLT, Auto Loader), AWS (S3, Glue, Secrets Manager, IAM, Athena, LakeFormation, EMR), Spark SQL, PySpark, Java, Python, Scala, Delta Lake, Apache Iceberg

Preferred skills

Databricks Certified Consultant, DBR to EMR migration experience

Technologies

Databricks, AWS, Spark, Delta Lake, Apache Iceberg, EMR, Glue, S3, Athena, LakeFormation

Responsibilities

Build and optimize scalable data pipelines and ETL/ELT processes; Implement data architectures including data lakes and warehouses; Execute data migration from Databricks to AWS (Unity Catalog to Glue, Delta to Iceberg); Develop integrations between data sources and analytics platforms; Monitor and optimize data pipeline performance and storage costs; Create technical documentation for data architectures and processes.

Seniority

Senior, hands-on IC