Senior Data Engineer
Core
Design, develop, and maintain scalable data pipelines and models to support the BIM Platform's API and backend services.
Role type
Senior Data Engineer
Builds
Data pipelines, data models, and SQL procedures for the BIM Platform
Domain
Construction industry / Cloud data infrastructure
Deliverable
production ML models | product features
Required skills
Python, SQL, PostgreSQL, Dagster, Airflow, data modelling, Git, performance optimization, unit testing, integration testing
Preferred skills
CI/CD pipelines, REST/GraphQL, Linux, Docker, Kubernetes, TDD
Technologies
Dagster, Airflow, PostgreSQL, Python, Git, GitHub Actions, Liquibase, Docker, Kubernetes
Responsibilities
Design and implement efficient data models; Develop SQL queries and procedures; Debug and improve existing codebase; Conduct performance profiling and stress testing; Maintain documentation for pipelines and codebases; Execute unit and integration tests.
Seniority
Senior, hands-on IC