IN-Manager_Databricks Engineer _GCC_ Advisory_Bangalore
Core
Design and build data infrastructure and systems to enable efficient data processing, analysis, and transformation for clients. (via careerplan.io/jobs/713119WD-in-manager-databricks-engineer-gcc-advisory-bangalore-at-pwc)
Role type
Manager, Data Engineering (Databricks)
Builds
Data pipelines, data integration, and data transformation solutions
Domain
Data, Analytics & AI
Deliverable
production ML models
Required skills
Python, PySpark, SQL, ETL/ELT pipeline development, Delta Lake, Unity Catalog, Delta Live Tables (DLT), Auto Loader, Databricks Workflows/Lakeflow, Structured Streaming, Lakehouse architecture, AWS/Azure, Spark performance tuning
Preferred skills
Photon, Databricks SQL, MLflow/Databricks ML, CI/CD, Git, Airflow/ADF/orchestration tools, healthcare domain experience
Technologies
Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Delta Live Tables, AWS, Azure, Airflow, MLflow, Git
Responsibilities
Design and develop robust data solutions; build data infrastructure and systems; develop and implement data pipelines and integration solutions; optimize Spark performance
Seniority
Manager, hands-on IC with leadership responsibilities