Data Engineer - Data Engineering 4A
Core
Design and implement data ingestion, storage, and ETL processes to build and maintain data pipelines for data scientists and analysts.
Role type
Data Engineer
Builds
Data pipelines, data lakes/warehouses, and optimized data storage/retrieval solutions
Domain
Data Engineering
Deliverable
production ML models
Required skills
Data Engineering, Cloud Computing, Snowflake (Platform), Agile Methodology, Data Literacy
Preferred skills
Databricks Certified Associate Developer for Apache Spark, Microsoft Certified: Azure Data Engineer Associate, Oracle Database 12c Certified Implementation Specialist
Technologies
Snowflake, Databricks, Apache Spark, Azure, Oracle Database
Responsibilities
Develop and implement data ingestion processes; Design and optimize data storage and retrieval solutions; Build and maintain ETL processes to transform and load data into data lake/warehouse; Collaborate with data scientists and analysts to understand data requirements and deliver relevant datasets; Troubleshoot and resolve data-related issues; Ensure data quality and integrity in the data pipelines; Research and evaluate new data technologies and tools for continuous improvement.
Seniority
Individual Contributor
