Senior Data Quality Engineer
Core
Design automation strategies and testing protocols for the enterprise data lake platform, utilizing AI tools to enhance engineering productivity and ensure high-quality data products.
Role type
Senior Data Quality & Automation Engineer
Builds
End-to-end testing frameworks, data quality monitoring systems, and internal automation tools for APIs, data pipelines, and serverless applications.
Domain
Financial risk services, data infrastructure, and cloud computing
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, Node.js, SQL, CI/CD tools, microservices architecture, distributed systems, cloud platforms (AWS/Azure/GCP), data-intensive systems (data lakes/warehouses), test automation frameworks
Preferred skills
HIPAA compliance experience, Infrastructure as Code (Terraform/CloudFormation), data analytics background
Technologies
Apache Spark, Kafka, Delta Lake, Databricks, Looker, Playwright, pytest, Jest, Great Expectations, Jenkins, GitLab CI, GitHub Actions, Apache Airflow, Datadog, Prometheus, CloudWatch
Responsibilities
Architect and maintain end-to-end testing frameworks across various services; define best practices for quality metrics across data and application platforms; design frameworks to profile, monitor, and detect issues with critical data products; leverage LLMs for test case generation, document creation, code review, and synthetic data generation.
Seniority
Senior, hands-on IC