Cloud Data Engineer
Core
Designing and implementing robust data pipelines and ETL processes to move and transform data into cloud-based data warehouses, enhancing data warehousing capabilities and maintaining legacy systems.
Role type
Senior Cloud Data Engineer (Data Warehousing & ETL)
Builds
Cloud-based data warehouses, ETL pipelines, and data processing infrastructure
Domain
Cruise industry, Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data pipeline design, ETL development, SQL, Python scripting, AWS cloud platforms, Data modeling (OLAP, Dimensional), Data partitioning/indexing/compression, Infrastructure management, Security implementation, Team mentorship
Preferred skills
Legacy system maintenance, PowerShell scripting, Agile methodologies, Cross-functional collaboration
Technologies
AWS, Snowflake, Fivetran, Matillion, SSIS, SSAS, SSRS, SQL Server, Oracle, MySQL, HANA, Jira, Confluence, Lucid Chart
Responsibilities
Design and implement data pipelines to move and transform data from various sources into cloud-based data warehouses; Develop and maintain ETL processes using tools such as Fivetran, Matillion, SSIS, SSAS, SSRS and Snowflake Dataflow on AWS; Optimize data storage and retrieval by designing and implementing data partitioning, indexing, and compression strategies; Build and maintain data processing infrastructure on cloud platforms such as AWS; Monitor and troubleshoot data pipelines and infrastructure to ensure high availability and performance; Mentor and train junior data engineers and provide technical guidance to cross-functional teams
Seniority
Senior, hands-on IC with mentorship responsibilities
