Verifying Agile Black-Box Test Case Quality Measurements: Expert Review

Abstract

Tests on software are performed to ensure it has no defects. Software testing companies and organizations claimed that the testing problem increased their time and budget for testing by over 50%. As a result, the product’s release is delayed, which attracts customer complaints. Testing involves test cases, which are a vital part of the process. Therefore, quality test cases likely to identify defects and meet users’ requirements must be chosen. This paper aims to identify and verify the characteristics, sub-characteristics, and metrics that construct the proposed model for producing high-quality black-box test cases in an Agile Software Development environment. An expert review approach was used to verify the proposed model. Ten academic and six industry experts contributed to this verification. The results showed that six characteristics, 22 sub-characteristics, and 56 metrics are accepted to be included in the proposed model. Furthermore, findings revealed that the proposed model is comprehensive, consistent, relevant, and well-organized for Agile projects.

Keywords

• Expert review
• quality characteristics
• software test metrics
• test case quality
• test case quality assessment