Data Engineer - MSIL
On-site · IndiaNo visa sponsorship
Core
Design, build, and manage scalable data pipelines and platforms for data extraction, transformation, and loading (ETL) in cloud environments.
Role type
Senior Data Engineer
Builds
Data pipelines and platforms for data access and aggregation
Domain
Cloud computing and Big Data
Deliverable
production ML models
Required skills
Py-Spark, SQL, Python, Databricks, AWS S3, Medallion Architecture, Delta Lake, Iceberg, ETL/ELT tools
Preferred skills
IoT time series data, automotive data
Technologies
Py-Spark, SQL, Python, Databricks, AWS S3, Delta, Iceberg
Responsibilities
Design and implement data pipelines; Integrate data from various sources; Optimize data systems for reliability and efficiency; Monitor and troubleshoot data pipelines; Collaborate with data scientists and analysts; Maintain documentation of data processes.
Seniority
Senior, hands-on IC