Associate Developer, SQL and UNIX operating system
Core
Design, develop, and implement scalable data pipelines and applications for processing and analyzing large datasets in a cloud environment.
Role type
Associate Data Engineer (Big Data)
Builds
Data pipelines and applications for processing and analyzing large datasets
Domain
Big Data, Cloud Computing (GCP)
Deliverable
production ML models
Required skills
Spark, Scala, Python, SQL, GCP, Unix/Linux
Preferred skills
Data warehousing, data visualization tools, agile methodologies, GCP certifications
Technologies
Spark, Scala, Python, SQL, GCP
Responsibilities
Develop, test, and deploy robust and scalable data pipelines using technologies such as Spark, Scala, and Python; Design and implement data models and SQL queries for efficient data access and analysis; Work within a cloud-based environment GCP to build and deploy data solutions; Contribute to the development and maintenance of data infrastructure; Participate in code reviews to ensure code quality and adherence to best practices; Troubleshoot and resolve issues related to data pipelines and applications.
Seniority
Junior to Mid-level, hands-on IC
