Data Engineer
Core
Orchestrate complex operational data flows including storage, transport, management, security, compliance, and knowledge store management; perform exploratory data analysis to clean, enrich, transform, and convert raw data into required formats.
Role type
Data Engineer
Builds
Mission-critical data pipelines and knowledge stores
Domain
Data Engineering / Data Security & Compliance
Deliverable
production ML models
Required skills
Linux CLI, Bash scripting, Python scripting, Java development, Apache NiFi system administration, Apache NiFi canvas, complex data flow design, Atlassian Tool Suite (JIRA, Confluence)
Preferred skills
Corporate data flow processes, Corporate data security and compliance procedures, Perl scripting
Technologies
Linux, Bash, Python, Java, Apache NiFi, JIRA, Confluence, Perl
Responsibilities
Design and implement data storage and transport solutions; Manage data security and compliance; Perform exploratory data analysis on raw data; Troubleshoot complex operational data flows
Seniority
Mid-level, hands-on IC