Data Quality Engineer
Core
Design and automate validation, testing, profiling, and monitoring frameworks to ensure data accuracy and reliability for the VA's multi-cloud enterprise data platform.
Role type
Data Quality Engineer
Builds
Automated data quality checks, monitoring solutions, and test frameworks for enterprise data products.
Domain
Healthcare / Cloud Data Engineering
Deliverable
production ML models
Required skills
SQL, Python, Azure Synapse, Databricks, data profiling, automated testing frameworks, data validation, ELT tools
Preferred skills
JIRA, Confluence, Dynatrace, Splunk, Log Analytics, Azure Data Engineer Certification
Technologies
Azure Synapse, Databricks, Collibra Data Quality, Profisee, SQL, Python, Scala, JIRA X-RAY, Azure Data Factory, Starburst, Azure Data Lake Service, Azure ML/AI, Pyramid Analytics, Power BI, Dynatrace, Splunk, Log Analytics
Responsibilities
Design and implement data validation and quality assurance processes for cloud-based environments; Automate data quality checks and develop monitoring solutions to detect data anomalies; Collaborate with data engineers and analysts to ensure data governance and compliance; Analyze and profile structured and unstructured datasets for accuracy and consistency; Build and maintain automated testing frameworks to proactively catch data issues; Utilize Azure data engineering and ELT tools, including Azure Synapse and Databricks.
Seniority
Mid-level, hands-on IC