Data Ingestion Engineer (ADF+Dbt+Snowflake)
Core
Build and maintain scalable, reliable, and secure data pipelines to power analytics, reporting, and decision-making across the organization.
Role type
Data Ingestion Engineer
Builds
Data pipelines ingesting batch and near-real-time data into Snowflake
Domain
Cloud data platforms (Snowflake, Azure)
Deliverable
production ML models
Required skills
Snowflake, Azure Data Factory (ADF), Python, SQL, dbt, PostgreSQL, Git
Preferred skills
API integration, cloud data platforms (AWS, GCP), data governance tools
Technologies
Snowpipe, Snowpipe Streaming, Snow Tasks, Snow Streams, Azure Blob Storage, Azure Data Lake
Responsibilities
Design Snowflake-native ingestion pipelines; Build automated ingestion processes; Implement ELT workflows; Integrate ADF with Snowflake; Develop Python scripts for automation; Ingest data from APIs, databases, and files; Monitor and optimize pipeline performance; Implement data quality checks and governance; Maintain technical documentation.