PCA Data Engineer
Core
Design, develop, and maintain robust data pipelines and ETL processes to integrate, process, and manage data from various sources for a construction company.
Role type
Data Engineer
Builds
Data pipelines and ETL processes integrating data into a centralized data platform
Domain
Construction industry + Cloud Data Engineering
Required skills
Azure Data Factory, Python, SQL, Data Modeling, pipeline orchestration, performance optimization, cloud storage (Azure/AWS S3), API/webhook/REST integration
Preferred skills
Airflow, Git-based workflows, CI/CD pipelines, Power BI
Technologies
Azure, Azure Data Lake, Azure Data Factory, Python, SQL, Snowflake, Microsoft Fabric, AWS, Power BI
Responsibilities
Design, develop, and maintain robust data pipelines and ETL processes; Translate business requirements into technical requirements; Create and maintain technical documentation related to data architecture; Monitor and troubleshoot pipeline performance and reliability; Collaborate with engineers and stakeholders to ensure data solutions meet business needs; Manage data quality, error handling, monitoring, and alerting; Perform debugging, root cause analysis, and preventive maintenance; Participate in code review, performance tuning, and continuous improvements; Work with the extended data team to define and maintain shared data models.
Seniority
Mid-level, hands-on IC