Ingeniero de datos Ingles
Core
Design, build, and optimize scalable data pipelines to ensure data quality, availability, and efficiency.
Role type
Data Engineer
Builds
Scalable data pipelines and data processing solutions
Domain
Data Engineering
Deliverable
production ML models
Required skills
Databricks, PySpark, Apache Spark, Python, SQL, Git, batch processing, streaming processing
Preferred skills
Unity Catalog, Workflows, Jobs, Jira, Confluence
Technologies
Databricks, PySpark, Apache Spark, Python, SQL, Git, Jira, Confluence
Responsibilities
Design, build, and maintain efficient and scalable data pipelines; Orchestrate processes within Databricks; Ensure data quality, integrity, and availability; Optimize performance of processes and queries in distributed environments; Implement batch and streaming processing solutions; Collaborate with business and technology teams to define requirements; Document pipelines and processes in Jira and Confluence
Seniority
Mid-level, hands-on IC