CareerPlanSign in

Senior Data Engineer

Kensington, East Johannesburg💼 Full-time🗓 2026-05-24 → 2026-08-09

Core

Design, build, and maintain scalable data pipelines and lakehouse structures to support analytics, BI, machine learning, and Generative AI applications.

Role type

Senior Data Engineer (Generative AI focus)

Builds

Production-ready data solutions, curated knowledge datasets, and data pipelines for GenAI use cases (RAG, AI services, agent workflows)

Domain

Enterprise data lake/lakehouse, Generative AI, Big Data

Deliverable

production ML models | product features

Required skills

Python, SQL, Apache Spark, Databricks (Delta Lake, Unity Catalog, Jobs & Workflows), data governance, CI/CD, incident resolution

Preferred skills

Experience supporting AI/ML/GenAI workloads, experience in regulated environments

Technologies

Databricks, Delta Lake, Unity Catalog, Python, PySpark, SQL, Apache Spark

Responsibilities

Design and maintain scalable data pipelines and lakehouse structures; Enable data consumption for GenAI use cases such as RAG and agent workflows; Build data pipelines for Generative AI applications including metadata and lineage management; Implement automated testing and CI/CD practices for data engineering workloads; Support operational stability, incident resolution, and root cause analysis; Collaborate with AI Engineers and Product Owners to align engineering deliverables to AI and GenAI use cases

Seniority

Senior, hands-on IC

Sourced via adzuna · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.