Senior Technical Consultant - RDAF/MFG (Data Engineer)
Core
Designing and implementing data ingestion and transformation pipelines to integrate siloed planning capabilities and capture value leakage for enterprise clients.
Role type
Senior IC data engineer (ETL & cloud platforms)
Builds
Data ingestion and egress pipelines for enterprise planning systems
Domain
Enterprise planning / Supply chain management / Data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, PySpark, SQL, Airflow, SSIS, Parquet, JSON, RESTful APIs, HDFS, Delta Lake, Hive, Presto, GitHub, Azure DevOps
Preferred skills
Delta Lake, Supply Chain Planning applications, AWS, Azure, Google Cloud
Responsibilities
Manage and execute complex project tasks related to data ingestion, transformation, validation, and publishing; Build and maintain data ingestion and egress pipelines capable of handling large volumes of data; Develop data transformation functions using Python, PySpark, SQL, and SSIS; Integrate data from various sources including Teradata, SAP ERP, SQL Server, Oracle, Sybase, ODBC connectors, and flat files using API or batch integrations; Support production deployment activities and assist in issue triaging, testing, and root cause analysis; Provide technical guidance to junior consultants and review their code to ensure alignment with best practices and quality standards.
