Data Engineer Associate
Core
Junior Data Engineer supporting business processes, Analytics, AI, and Machine Learning initiatives by developing and managing data pipelines.
Role type
Junior IC Data Engineer
Builds
Data ingestion, transformation, and distribution pipelines (ETL/ELT) for business and analytics use cases.
Domain
FinTech / Credit Rating / ESG Analytics
Deliverable
production ML models
Required skills
Python (pandas, PySpark), SQL, Apache Spark, Git, Cloud platforms (AWS)
Preferred skills
Apache Airflow, Databricks, Docker, DevOps practices, Machine Learning/AI concepts
Technologies
Python, Apache Spark, AWS (S3, Glue, Redshift), Apache Airflow, Databricks, Git, Docker
Responsibilities
Develop and maintain data ingestion, transformation, and distribution pipelines; Collaborate on optimizing Apache Spark jobs on Databricks; Integrate diverse data sources (databases, APIs, file systems) using cloud services; Write Python/Java code following best practices; Manage data workflows and pipelines using orchestration tools; Support data transformation and modeling for quality and traceability; Collaborate with Data Science, BI, and Data Architecture teams; Contribute to data preparation for ML and AI models.
Seniority
Junior, hands-on IC
