Data Engineer
Core
Design, develop, and maintain scalable data pipelines and ETL/ELT processes for data generation, collection, and processing across various systems.
Role type
Data Engineer (via careerplan.io/jobs/ATCP-1443903-S425759-data-engineer-at-accenture)
Builds
Scalable batch and streaming data workflows, curated datasets, and data pipelines
Domain
Cloud data platforms and distributed computing
Required skills
Databricks Unified Data Analytics Platform, data pipeline architecture, data integration and transformation, cloud-based data platforms, distributed computing, query optimization, data access controls
Preferred skills
Snowflake schema design, fact dimension table creation, Unity Catalog, performance monitoring, documentation
Technologies
Apache Spark, Databricks, Snowflake, Unity Catalog
Responsibilities
Design and implement scalable data pipelines using Apache Spark within Databricks; Implement ETL/ELT processes to transform raw data into curated datasets; Optimize queries for speed and efficiency; Implement data access controls and permissions using Unity Catalog; Monitor and optimize data pipelines for performance and reliability; Document data processes and workflows
Seniority
Mid-level, hands-on IC
