Data Engineer, Workforce Solutions - Talent Mobility
Core
Design, implement, and automate distributed systems for collecting and processing log events; build and maintain data warehouses and pipelines to support metrics, reports, and dashboards for business decisions.
Role type
Data Engineer
Builds
Data pipelines, data warehouses, dashboards, and analytics solutions
Domain
Technology / Workforce Solutions
Deliverable
production ML models | product features | dashboards & analysis
Required skills
data modeling, warehousing, ETL pipeline development, SQL/NoSQL database operations, distributed system design, automated data pipeline development, query performance tuning
Preferred skills
big data technologies (Hadoop, Hive, Spark, EMR)
Technologies
SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala, Python, KornShell, Hadoop, Hive, Spark, EMR
Responsibilities
Design and automate deployment of distributed systems for log event collection; operate internal data warehouses and database systems; develop automated data pipelines processing millions of data points; monitor and troubleshoot data pipeline issues; tune database and data warehouse performance; drive architectural plans for future data storage and analytic solutions
Seniority
Mid-level, hands-on IC
