Data Engineer
Core
Design, build, and operate scalable, production-grade data pipelines and data products on Azure Databricks to ensure data availability, reliability, and quality across the organization.
Role type
Senior IC data engineer (Azure Databricks)
Builds
Production-grade data pipelines, data products, and foundational data models
Domain
HVAC industry + cloud data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Azure Databricks, PySpark, Spark performance tuning, Medallion Architecture, CI/CD pipelines, distributed systems troubleshooting, data governance, observability frameworks
Preferred skills
Databricks Genie, AI-assisted data engineering tools, Infrastructure as Code, Azure DevOps
Technologies
Azure Databricks, PySpark, Spark, CI/CD tools
Responsibilities
Design and operate data quality, validation, and observability frameworks; Optimize data pipelines for performance, scalability, and cost efficiency; Mentor engineers and contribute to a high-performance engineering culture; Lead technical decision-making for complex data engineering initiatives; Collaborate with data visualization and analytics engineers to ensure appropriate placement of data transformations; Diagnose and resolve complex data pipeline failures
Seniority
Senior, hands-on IC
