Data Engineer Senior
Core
Designing and developing data pipelines, managing ingestion processes, and ensuring data quality for strategic Data & AI projects.
Role type
Senior Data Engineer
Builds
Data pipelines, Data Lake architectures, and medallion structures
Domain
Cloud data engineering (Azure ecosystem)
Deliverable
production ML models | infrastructure
Required skills
Python, PySpark, SQL, Azure Data Factory, Databricks, Delta Lake, Git, Azure DevOps, Power BI
Preferred skills
Azure certifications, Databricks certifications, Unity Catalog, Delta Live Tables, Data Lineage, Observability
Technologies
Azure, Databricks, Python, PySpark, SQL, Delta Lake, Git, Azure DevOps, Power BI, Logic Apps, Azure AI Services
Responsibilities
Design and develop data pipelines; Administer ingestion processes from APIs, SFTP, and files; Implement data validation and quality controls; Optimize transformation and storage processes; Document processes and ensure traceability; Participate in strategic Data & AI projects; Provide support and continuous improvement to the data platform.
