Senior Analyst - Data Engineer
Core
Design, develop, and maintain efficient data pipelines and data lakes to enable accurate insights for data scientists and business stakeholders.
Role type
Senior Data Engineer (Cloud & Data Lake)
Builds
Scalable data pipelines, data lakes/warehouses, and data governance catalogs on Databricks.
Domain
Cloud data engineering, Data Lakehouse
Deliverable
production ML models | infrastructure
Required skills
Databricks, Delta Lake, Delta Live Tables (DLT), Apache Spark, SQL, ETL/ELT, CI/CD, DevOps, data ingestion (streaming/batch/API), cost optimization
Preferred skills
Scala, Python, Databricks CLI, REST API
Technologies
Databricks, Delta Lake, Apache Spark, CI/CD tools
Responsibilities
Develop data lakes/warehouses for optimized storage and real-time updates; Implement data ingestion strategies from various sources; Ensure data integrity, security, quality, and governance; Collaborate with stakeholders to translate business requirements into Databricks-native solutions; Build and maintain ETL/ELT processes; Monitor and optimize cost-efficiency of data operations.
Seniority
Senior, hands-on IC
