[Job-31906] Senior Data Developer
Core
Design, build, and optimize scalable data pipelines and solutions to transform large volumes of data into reliable and efficient outputs.
Role type
Senior Data Engineer (Cloud & Big Data)
Builds
Scalable data pipelines and data solutions
Domain
Cloud data engineering (Azure, Databricks)
Deliverable
production ML models
Required skills
Databricks, Apache Spark, SQL, Python, Scala, Microsoft Azure, data pipeline design, data quality checks, data governance, troubleshooting, technical documentation
Preferred skills
Experience with Agentic SDLC, Application modernization
Technologies
Databricks, Apache Spark, SQL, Python, Scala, Microsoft Azure
Responsibilities
Design, develop, and maintain robust and scalable data pipelines using Databricks, Apache Spark, SQL, and Python or Scala. Build solutions to process and transform large datasets efficiently. Monitor and optimize existing data pipelines and workflows, improving performance, scalability, throughput, and reliability. Collaborate with data scientists, analysts, engineers, and business stakeholders to understand data needs and translate them into effective technical solutions. Implement data quality checks and governance practices to ensure data accuracy, consistency, and compliance. Troubleshoot complex data and pipeline issues, identifying root causes and proposing sustainable solutions. Maintain clear technical documentation and contribute to engineering standards and best practices across the team.