Software Development Test Engineer
Core
Designing and executing automated and manual tests for real-time and batch data pipelines, ETL jobs, and data integrations to ensure data quality, accuracy, and system reliability.
Role type
Senior Data Engineering Test Automation Engineer
Builds
Robust test suites, reusable automation frameworks, and CI/CD integrations for data platforms.
Domain
Biotechnology / Data Engineering / Cloud Infrastructure
Deliverable
production ML models | product features | dashboards & analysis | research | client delivery | infrastructure
Required skills
Data pipeline validation, ETL testing, Front-end Node.js testing, Performance testing, Python, PySpark, SQL, Databricks, AWS, Snowflake, API testing, CI/CD integration, Test planning, Defect lifecycle management
Preferred skills
Databricks certification, AWS/Azure certification, ISTQB, Data privacy/governance frameworks, UI automated testing frameworks (Selenium, JUnit, TestNG), Monitoring tools (Datadog, Prometheus, Cloud Watch), Mocha/Jest, JMeter, k6
Technologies
Databricks, Apache Spark, AWS (S3, Glue, Athena, Lake Formation), Snowflake, AWS EMR, Redshift, Node.js, Python, PySpark, SQL, Selenium, Jenkins, GitHub Actions, Postman, JUnit, TestNG, Mocha, Jest, JMeter, k6, Datadog, Prometheus, Cloud Watch
Responsibilities
Design, develop, and maintain automated test scripts for data pipelines and ETL jobs; Validate data accuracy, completeness, transformations, and integrity; Collaborate with data engineers to define test cases and establish data quality metrics; Develop reusable test automation frameworks and CI/CD integrations; Perform performance and load testing for data systems; Maintain test data management and data mocking strategies; Identify and track data quality issues; Perform root cause analysis and drive corrective actions; Contribute to QA ceremonies and drive continuous improvement in QA processes.
Seniority
Senior, hands-on IC
