Determining reliability in interactive question answering systems by regression

Abstract

Evaluation of interactive question answering systems plays an important role to determine the effectiveness of these questions is of great importance. In the process evaluation of an interactive question answering system, several features can be considered. One of the most effective criteria in the assessment of these systems is reliability. Few attempts have been made to measure the reliability and accurate determination of reliability criteria in interactive question answering systems by applying different models, and most tasks have been used only or qualitative evaluation. In this paper, a new method for the reliability of reliability is presented using the set of criteria affecting this feature, including qualitative and quantitative criteria. In this method, first a list of qualitative and quantitative characteristics is collected and then according to the criteria set, 8 quantitative characteristics are selected and then based on the prepared questionnaire, the coefficients of impact of each question are determined and by combining these characteristics according to the proposed relationship of reliability was measured. The evaluation of the performance of the selected criteria on four interactive question answering indicates that by applying this set of criteria, the reliability of an interactive question answering system can be used to automate the calculation of this feature in the process evaluation process.

Keywords

• reliability
• evaluation criteria
• qualitative software features
• interactive question answering systems.