Software development Engineer - Java | Hadoop | Apache Spark | AWS | 3y to 5y
Core
Design, develop, and optimize scalable data platforms and distributed processing systems for critical business insights.
Role type
Senior Big Data Software Engineer
Builds
High-performance batch and streaming data pipelines, distributed systems, and modern data platforms
Domain
Cloud-native Big Data Engineering and Data Analytics
Deliverable
production ML models | product features
Required skills
Java, Scala, Apache Spark, Hadoop, AWS, Apache Kafka, Kubernetes, CI/CD, Microservices design, TDD
Preferred skills
Experience with Amazon EMR, Amazon EKS, Apache HBase, Apache Oozie, Hue, HLD/LLD
Technologies
Java, Scala, Apache Spark, Hadoop, AWS, Amazon EMR, Amazon EKS, Kubernetes, Apache Kafka, Apache Oozie, GitHub, SVN
Responsibilities
Design and maintain scalable data processing applications; Build and optimize large-scale data pipelines; Develop high-performance solutions for data-intensive workloads; Participate in system design discussions; Implement software engineering best practices; Troubleshoot production issues; Collaborate with cross-functional teams to deliver data-driven solutions
Seniority
Mid-level (3-5 years), hands-on IC