L1 Data Engineer - Remote
Core
Design, build, and maintain scalable data pipelines and infrastructure on Azure/Databricks to support business intelligence and analytics.
Role type
L1 Data Engineer (Cloud Data Platform)
Builds
Scalable ETL/ELT workflows, data ingestion processes, and data models for analytics.
Domain
Cloud Data Engineering (Microsoft Azure, Databricks)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, PySpark, SQL, Azure Data Factory, Databricks, Data Lake Architecture, Delta Lake, Data Governance
Preferred skills
Terraform, CI/CD, SQL Server migration, Delta Sharing, Lakehouse Federation
Technologies
Azure, Databricks, PySpark, Python, SQL, Azure Data Factory, Azure Synapse Analytics, Delta Lake
Responsibilities
Design and develop scalable data pipelines and ETL/ELT workflows; Build and optimize data ingestion processes; Transform and process large datasets; Write and optimize complex SQL queries; Collaborate on data model implementation; Monitor and troubleshoot pipeline failures; Contribute to data pipeline documentation.
Seniority
Mid-level, hands-on IC