Senior Data Engineer @ Idego Group Sp. z o.o.
Core
Building and maintaining resilient data pipelines in production, integrating data from multiple sources into Snowflake for a client in the automotive industry.
Role type
Senior Data Engineer
Builds
Data pipelines and transformations in Snowflake
Domain
Cloud Data & AI, Automotive
Deliverable
production ML models
Required skills
Snowflake, SQL, Python, CI/CD, Git, NoSQL, Data Warehousing, Data Quality, AI-assisted development
Preferred skills
Estuary, dbt
Technologies
Snowflake, MySQL, SQL Server, PostgreSQL, MongoDB, Redshift, GitLab, Estuary
Responsibilities
Connect client databases and load data into Snowflake using Estuary; Build data transformations in Snowflake; Create reliable, fault-tolerant pipelines handling deletes and reloads; Ensure data quality through automated testing and monitoring; Work in a fully automated GitLab CI/CD setup.