Data Engineer
Core
Architect and builder of Dis-Chem Life's data foundation, creating high-performance, future-proof systems that turn raw information into a strategic asset for the South African insurance industry.
Role type
Senior IC Data Engineer
Builds
Scalable data pipelines, warehouse systems, and cloud architecture for an insurance company
Domain
Insurance / Data Engineering
Deliverable
production ML models
Required skills
ETL/ELT pipeline design, cloud architecture optimization, data modeling, SQL, Python, workflow orchestration, data governance
Preferred skills
Big Data frameworks, real-time data streaming, container orchestration, feature store integration
Technologies
dbt, Airflow, Fivetran, AWS, Azure, GCP, Databricks, Snowflake, BigQuery, Redshift, PostgreSQL, MySQL, MongoDB, Cassandra, InfluxDB, TimescaleDB, Neo4J, PySpark, Kafka, Spark, Flink, Docker, Kubernetes, Git
Responsibilities
Develop and optimize scalable ETL/ELT pipelines and warehouse systems; Implement rigorous data quality validation and governance; Prepare AI-ready datasets and collaborate on feature pipelines; Scale data architecture to handle increasing volumes; Solve complex engineering challenges for data ingestion and transformation; Mentor colleagues and document data flows
Seniority
Mid-Senior, hands-on IC