Data Engineer
Core
Design and develop custom data solutions, ETLs, and scalable pipelines for clients using cloud platforms.
Role type
Data Engineer
Builds
Custom data solutions, ETLs, and scalable data pipelines
Domain
Cloud data engineering (Azure/AWS)
Deliverable
production ML models | product features
Required skills
Python, Scala, Spark, Cloud platforms (Azure/AWS), CI/CD pipelines, SQL, NoSQL databases, Unit testing, Integration testing
Preferred skills
Databricks, Snowflake, Fabric, Infrastructure as Code (IaC)
Technologies
Spark, Python, Scala, Azure, AWS, Databricks, Snowflake, Fabric
Responsibilities
Design and develop Data solutions for challenging projects; Develop projects from scratch with minimal supervision; Foster best practices for clean and reusable code; Develop ETLs using Spark; Work on cloud-based projects; Build scalable pipelines using a variety of technologies
Seniority
Mid-Senior (4+ years experience)