EG Data Engineer
Core
Designing, developing, and maintaining scalable data pipelines on Databricks and cloud platforms to support analytics, reporting, and machine learning workloads.
Role type
Data Engineer
Builds
Centralized data storage systems, ETL pipelines, and cloud-based data platforms
Domain
Cloud data engineering, Azure, Databricks
Deliverable
production ML models | product features | dashboards & analysis
Required skills
ETL pipeline development, data integration, data transformation, data governance, cloud platform management, pipeline monitoring, data profiling, performance optimization, requirement analysis, UAT support
Preferred skills
Experience with Delta Lake, streaming platforms, automated error-handling mechanisms, dashboard development
Technologies
Databricks, Azure, Delta Lake
Responsibilities
Develop and maintain ETL pipelines for ingestion, transformation, validation, and loading; Integrate data from databases, APIs, log files, streaming platforms, and external providers; Develop data transformation routines to clean, normalize, and aggregate data; Implement data governance in alignment with company standards; Monitor data pipelines to detect and resolve issues promptly; Develop monitoring tools, alerts, and automated error-handling mechanisms; Develop dashboards, reports, scorecards, and data visualizations; Perform SIT, data validation, data profiling, and confirm data accuracy; Validate completeness and consistency of ETL Loads; Support UAT and production implementation
Seniority
Individual Contributor
