Consultant / Sr. Consultant - Data Engineer (INDM)
Core
Design and build scalable, data-driven solutions including robust data pipelines, cloud-based architectures, and enabling advanced analytics and machine learning initiatives.
Role type
Senior Data Engineer (Consulting)
Builds
Scalable data pipelines, cloud-based data architectures, and data integration strategies for analytics and ML.
Domain
Data Engineering / Cloud Infrastructure
Deliverable
production ML models | product features
Required skills
Python, PySpark, SQL, Azure Databricks, Azure Data Factory, CI/CD pipeline development, relational database management (SQL Server, Oracle, MySQL), data integration strategies, data architecture design.
Preferred skills
Understanding of ML libraries, API/web service integration, data security practices, emerging tools in data engineering.
Technologies
Azure Databricks, Azure Data Factory, Azure DevOps, Python, PySpark, SQL, SQL Server, Oracle, MySQL.
Responsibilities
Design, build, and optimize data pipelines and workflows across various data sources; Architect and implement new data solutions using Azure technologies; Collaborate with stakeholders to translate business requirements into scalable technical data models; Develop data integration strategies to support analytics, reporting, and ML initiatives; Contribute to data architecture design including ingestion, transformation, and delivery layers; Participate in CI/CD pipeline development and deployment.
Seniority
Senior, hands-on IC