Intermediate Data Engineer
Core
Design, implement, and maintain scalable data pipelines and ETL/ELT solutions to ingest, store, and process large volumes of data for B2B e-commerce and SaaS platforms.
Role type
Intermediate Data Engineer
Builds
Data pipelines, data models, and APIs for data exchange
Domain
B2B e-commerce, SaaS, Cloud Computing
Deliverable
production ML models | product features | infrastructure
Required skills
Python, PySpark, Scala, SQL, Apache Airflow, Luigi, Mage, Databricks Workflows, AWS, Azure, Google Cloud, Terraform, GitHub Actions, Azure DevOps, data modeling, software design principles, API development
Preferred skills
None stated
Technologies
PySpark, Scala, SQL, Apache Airflow, Luigi, Mage, Databricks Workflows, AWS, Azure, Google Cloud, Terraform, GitHub Actions, Azure DevOps
Responsibilities
Implement ETL/ELT solutions and data integration between multiple systems; Design, implement, and maintain data pipelines to ingest, store, and process large volumes of data; Develop and maintain APIs for data exchange between applications; Optimize PySpark and SQL query performance; Use automation frameworks and tools for CI/CD and infrastructure as code
Seniority
Intermediate, hands-on IC
