Senior Data Engineer
Core
Design and maintain end-to-end data pipelines (ingestion, transformation, modeling, exposure) and enhance the SOCOTEC Lakehouse governance and quality.
Role type
Senior Data Engineer
Builds
Data pipelines, visualizations in Power BI or Databricks SQL, and generative AI solutions for data.
Domain
Construction and infrastructure sector data platform
Deliverable
production ML models | product features
Required skills
SQL, NoSQL databases, Big Data architecture, distributed processing tools (Spark, Hadoop, Airflow, Kafka, Delta Lake), Databricks, ETL/ELT principles, DataOps (CI/CD, monitoring, data quality), AWS cloud services, Git, Jupyter Notebooks, VS Code
Preferred skills
Generative AI integration, emerging technologies
Technologies
Power BI, Databricks SQL, Spark, Hadoop, Airflow, Kafka, Delta Lake, AWS
Responsibilities
Develop end-to-end data pipelines; Contribute to implementation of visualizations; Continuously improve the SOCOTEC Lakehouse governance and quality; Experiment with generative AI solutions applied to data.
Seniority
Senior, hands-on IC
