Senior Data Engineer @ Ework Group
Core
Building and optimizing large-scale batch and real-time data pipelines, ensuring data quality, and delivering actionable insights via cloud data tools.
Role type
Senior Data Engineer
Builds
Data pipelines, data structures, and ingestion frameworks for analysis
Domain
Cloud data engineering and big data processing
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, Java, Scala, SQL, PySpark, Spark SQL, Azure Data Factory, Azure Databricks, SSIS, SSRS, Power BI, ETL processes, relational databases, big data technologies
Preferred skills
Master's degree in Computer Science or Engineering, Certified Azure Data Engineer, Databricks Certified Data Engineer
Technologies
Azure SQL Server, Azure Data Factory, Azure Databricks, PySpark, Spark SQL, ADLS, PowerBI, SSIS, SSRS
Responsibilities
Build and optimize data pipelines; Extract, combine, transform, and load data from various sources; Design and develop Databricks notebooks for data extraction; Configure ingestion framework tables; Develop and deploy performance-efficient algorithms; Monitor and optimize SQL query performance; Prepare detailed design documents with prototypes
Seniority
Senior, hands-on IC
