Data Engineer -Databricks
Core
Design, develop, and maintain scalable ETL/ELT pipelines and data solutions on the Databricks Lakehouse Platform.
Role type
Data Engineer (Databricks)
Builds
Scalable data pipelines, Delta Lake tables, and production-ready data solutions for Fortune 500 clients.
Domain
Data Engineering, Cloud Data Platforms
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, PySpark, SQL, Databricks Lakehouse Platform, Unity Catalog, Delta Lake, REST API integrations, ETL/ELT development, Data Modeling (Star/Snowflake Schema), Git, CI/CD
Preferred skills
Auto Loader, Spark Declarative pipelines, Kafka, Airflow, dbt, Databricks certification
Technologies
Databricks, AWS, S3, Delta Lake, Unity Catalog, PySpark, SQL, Git
Responsibilities
Design and manage Delta Lake tables using Medallion Architecture; Optimize Spark workloads for performance and scalability; Integrate data from multiple sources including databases, S3, files, and REST APIs; Create, schedule, monitor, and optimize Databricks Jobs and Workflows; Ensure data quality through validations, error handling, and logging.
Seniority
Mid-Senior, hands-on IC
