Big Data Developer
Core
Design, develop, and maintain large-scale data processing solutions, ETL processes, and Spark-based pipelines to ensure high performance and data quality.
Role type
Mid-Level Big Data Developer
Builds
Scalable data processing solutions and ETL pipelines
Domain
Financial IT / Big Data Engineering
Deliverable
production ML models | product features
Required skills
SQL, Apache Spark, Scala, Python, Java, Azure Databricks, Amazon EMR, Cloudera, Apache Hive, Qlik Sense, Git, GitHub, SonarQube, Nexus
Preferred skills
AI-assisted development tools, AI-driven data engineering approaches, process optimization via AI
Responsibilities
Design and maintain ETL and data transformation processes; Build and optimize Spark-based data pipelines; Integrate data from multiple sources; Analyze and troubleshoot data-related issues; Optimize data performance; Follow DevOps and CI/CD best practices
Seniority
Mid-Level, hands-on IC
