Senior Data Engineer (Data Analyst IV)
Required skills
Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2, Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL), Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing), Experience with Data Analysis tools, Good Hands-on in PowerApps, Power Automate, Power BI, Knowledge of REST-API, OAuth, Strong problem-solving skills and atte
Preferred skills
Good to have knowledge of any programming language like C#, Java, JavaScript, Python etc.
Technologies
Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric), Azure data storage accounts (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage), SQL Server, PostgreSQL, PowerApps, Power Automate, Power BI, REST-API, OAuth
Responsibilities
Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services, Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs, Collect, clean, and validate data from multiple sources to ensure accuracy and reliability, Ensure data quality and integrity through data validation techniques and frameworks, Monitor and troubleshoot data pipeline issues to ensure timely resolution, Optimize data pipelines in the Azure environment for performance, scalability, and reliability, Collaborate with data architects and other stakeholders to understand data requirements and deliver high-quality data solutions, Manage the CI/CD process for deploying and maintaining data solutions, Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge
Seniority
Data Analyst IV, Senior Data Engineer
Domain
Data Engineering, Data Architecture
