Senior Associate
Core
Design, develop, and optimize data pipelines and ETL processes to help organizations uncover enterprise insights and drive business results using smarter data analytics.
Role type
Senior Associate Data Engineer
Builds
Data pipelines, ETL processes, and business intelligence solutions for clients
Domain
Advisory, Data and Analytics, SAP
Deliverable
production ML models
Required skills
PySpark, Azure, Scala, Python, ETL, data modeling, CI/CD, SQL
Preferred skills
Hadoop, Hive, HBase, dimensional modeling
Technologies
Azure Databricks, Azure Data Lake Storage, Azure Synapse Analytics, Azure SQL Database, Apache Spark, SQL Server, PostgreSQL, MySQL
Responsibilities
Design and optimize data pipelines using PySpark/Scala; implement ingestion and storage on Azure; develop data models and schemas; monitor pipeline performance and troubleshoot; implement data security and compliance measures
Seniority
Senior, hands-on IC
