Technical Data Engineer -Databricks
Core
Design, develop, and maintain scalable ETL/ELT pipelines and data solutions on the Databricks Lakehouse Platform for Fortune 500 clients.
Role type
Senior Data Engineer (Databricks)
Builds
Scalable data pipelines, Delta Lake tables, and production-ready data solutions
Domain
Data Engineering / Cloud Data Platforms
Required skills
Python, PySpark, SQL, Databricks, AWS, REST API integrations, ETL/ELT development, Delta Lake, Unity Catalog, Medallion Architecture, Spark performance tuning
Preferred skills
Data Governance, Auto Loader, Spark Declarative pipelines, Kafka, Airflow, dbt, Databricks certification
Technologies
Databricks, PySpark, SQL, AWS, S3, Delta Lake, Unity Catalog, Git, CI/CD
Responsibilities
Design and manage Delta Lake tables using Medallion Architecture; Create, schedule, monitor, and optimize Databricks Jobs and Workflows; Integrate data from multiple sources including databases, Amazon S3, files, and REST APIs; Ensure data quality through validations, error handling, logging, and monitoring; Optimize Spark workloads for performance, scalability, and reliability; Implement business logic, data transformations, and dimensional data models.
Seniority
Senior, hands-on IC