Data Engineer
Core
Design, develop, and maintain data pipelines and backend services for real-time decisioning, reporting, and data collection.
Role type
Data Engineer
Builds
Data pipelines, backend services, and data products
Domain
Data Engineering, Cloud Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
SQL, ETL/ELT, Data Warehousing, Cloud Data Technologies, No-SQL databases, CI/CD, Data Modeling, Data Security, Data Quality
Preferred skills
AI tools, PowerBI, Azure Storage, Data Lakes, Cosmos DB
Responsibilities
Design and implement data pipelines for real-time decisioning and reporting; Develop and maintain software to improve data governance and security; Ensure data security and quality through defined processes; Collaborate with teammates in a fast-paced environment.
Seniority
Mid-Senior, hands-on IC
Rewrite
## About the role
Data Management and Transformation Design, develop, and maintain data pipelines and backend services for real-time decisioning, reporting, data collecting, and related functions. Produce well-tested, and secure code. Develop and maintain software designed to improve data governance and security. Develop processes designed to ensure Data Security and Data Quality. Work collaboratively with teammates in a fast-paced environment. Work to help build an inclusive working environment. Design, implementation and testing skills.
## Requirements
* Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
* OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering
* OR equivalent experience
* Citizenship & Citizenship Verification: This position requires verification of U.S citizenship due to citizenship-based legal restrictions. Specifically, this position supports United States federal, state, and/or local United States government agency customers and is subject to certain citizenship-based restrictions where required or permitted by applicable law. To meet this legal requirement, citizenship will be verified via a valid passport.
* 3+ years building and maintaining end-to-end data systems and supporting services.
* 3+ years Incorporating data processing and workflow management tools into pipeline design.
* 3+ years' experience in ETL/ELT, Data warehousing, and/ or Business Intelligence Development.
* 3+ years using SQL to understand data and to investigate data issues or problems and provide solutions.
* 2+ years working with cloud data technologies.
* 2+ years' experience with:
* Experience with AI tools.
* Experience understanding data and data exploration using querying languages such as SQL.
* Experience producing high quality Data products.
* Experience work with No-SQL storage and databases such as Azure Storage/ Data Lakes/ Or Cosmos DB.
* Experience with creating, editing and administering PowerBI data Models.
* Experience developing for continuous integration and automated deployments.
## What we offer
* Design, implementation and testing skills.
Sourced via microsoft · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
