Data Engineers
Core
Designing and building ETL/ELT processes for large-scale data movement, transformation, and visualization in cloud environments.
Role type
Senior Data Engineer
Builds
Optimized data pipelines and query-ready datasets for cloud computing engines
Domain
Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
ETL/ELT development, distributed computing (Spark), cloud infrastructure services, data lake/lakehouse architecture, SQL, security clearance management
Preferred skills
Azure Data Factory, Databricks
Technologies
Spark, Azure SQL, Graph Databases, Azure Data Factory, Databricks, Data Lake, Lakehouses
Responsibilities
Develop ETL/ELT processes for complex data movement and transformation, prepare data optimized for query performance in distributed engines, work with cloud storage and analytics services
Seniority
Senior, hands-on IC (via careerplan.io/jobs/44c1f76e-df23-4573-9695-4c9f7f5b221c-data-engineers-at-softtest-pays-pty)
