Data Integration Engineer Principiante Avanzado
Core
Designing and implementing cloud-based data ingestion, transformation, and processing pipelines using distributed technologies.
Role type
Data Integration Engineer
Builds
Data pipelines (ETL/ELT), scalable cloud solutions, and optimized data processing frameworks.
Domain
Cloud computing, Big Data, Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Cloud solution implementation, Distributed data processing (Spark/PySpark), Batch and Realtime processing, Cost optimization, CI/CD deployment, Data pipeline architecture
Preferred skills
Azure certifications, Databricks certifications, Agile methodology
Technologies
Azure, Spark, PySpark, Databricks, DevSecOps tools
Responsibilities
Analyze and develop data ingestion and transformation flows in Lake House, Optimize existing processes for cost and performance reduction, Schedule processes based on user criteria, Deploy solutions to production using CI/CD, Develop cross-functional solutions to improve development frameworks
Seniority
Mid-level (3+ years experience)