Senior Data Engineer (Azure & Databricks)
Core
Design and build scalable enterprise data systems, pipelines, and Master Data Management (MDM) platforms to power SOCOTEC's digital platforms, enterprise analytics, and AI applications.
Role type
Senior Data Engineer (Enterprise Data Platform & MDM)
Builds
Enterprise data pipelines, MDM platforms, data models, and datasets for analytics/AI
Domain
Enterprise data architecture, cloud data platforms, built environment consulting
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Databricks, Apache Spark, Delta Lake, Python, SQL, ETL/ELT pipeline development, data modeling, data architecture, distributed systems
Preferred skills
Master Data Management (MDM) systems, modern cloud data stacks (AWS/Azure/GCP), ERP integration (Deltek/SAP/Oracle), data governance, lakehouse architectures
Technologies
Databricks, Apache Spark, Delta Lake, Python, SQL, AWS, Azure, GCP
Responsibilities
Design and implement scalable data pipelines for enterprise systems; Architect and implement custom MDM platforms; Build reliable ingestion pipelines for large-scale structured and semi-structured data; Partner with AI teams to deliver high-quality datasets; Define standards for data modeling, pipeline design, and data quality
Seniority
Senior, hands-on IC
