Data Engineer, Workforce Solutions - Talent Mobility
Core
Design, implement, and automate distributed systems for collecting and processing log events; build and maintain data warehouses and pipelines to support business intelligence analytics and dashboards for engineers, analysts, and data scientists.
Role type
Senior Data Engineer (Business Intelligence & Analytics)
Builds
Distributed log processing systems, internal data warehouses, automated ETL/ELT pipelines, and analytical dashboards
Domain
Technology / Workforce Solutions / Business Intelligence
Deliverable
production ML models | product features | dashboards & analysis
Required skills
ETL/ELT processes, OLAP technologies, data modeling, SQL, large-scale data structure development, database tuning, distributed system design
Preferred skills
AWS Redshift, AWS S3, AWS Glue, AWS EMR, AWS Kinesis, AWS FireHose, AWS Lambda, AWS IAM, non-relational databases (object storage, document, key-value, graph, column-family)
Technologies
AWS Redshift, AWS S3, AWS Glue, AWS EMR, AWS Kinesis, AWS FireHose, AWS Lambda, AWS IAM, SQL, NoSQL
Responsibilities
Design and automate deployment of distributed systems for log event collection and processing; Design data schemas and operate internal data warehouses; Develop automated data pipelines to process millions of data points; Monitor and troubleshoot operational or data issues in data pipelines; Tune inefficient database and data warehouse queries; Drive architectural plans for future data storage and analytic solutions
Seniority
Mid-Senior, hands-on IC