Data Engineer Specialist
Core
Design, develop, and operate scalable data pipelines in Databricks to support Analytics, Machine Learning, and AI initiatives within a Lakehouse architecture.
Role type
Senior Data Engineer Specialist
Builds
Scalable data pipelines and Lakehouse data models for enterprise analytics and AI
Domain
Financial Services / Big Data Engineering
Deliverable
production ML models | product features
Required skills
Databricks, Apache Spark, Lakehouse architecture, end-to-end data pipeline development, cloud platforms (AWS/Azure/GCP), performance optimization, data governance
Preferred skills
Machine Learning and AI project experience, corporate data architecture modernization, data governance initiatives
Technologies
Databricks, Apache Spark, AWS, Azure, GCP
Responsibilities
Design and operate scalable data pipelines in Databricks; Develop data ingestion, transformation, and delivery solutions; Implement distributed processing solutions using Spark; Optimize data environment performance and scalability; Act as a technical reference for strategic data projects; Collaborate with Data Scientists and business units
Seniority
Senior, hands-on IC
