Optimization Chatbot Services Based on DNN-Bert for Mental Health of University Students

Abstract

Attention to mental health is increasing in Indonesia, especially with the recent increase in the number of cases of stress and suicide among students. Therefore, this research aims to provide a solution to overcome mental health problems by introducing a chatbot system based on Deep Neural Networks (DNN) and BiDirectional Encoder Representation Transformers (BERT). The primary objective is to enhance accessibility and offer a more effective solution concerning the mental health of students. This chatbot utilizes Natural Language Processing (NLP) and Deep Learning to provide appropriate responses to mild mental health issues. The dataset, comprising objectives, tags, patterns, and responses, underwent processing using Indonesian language rules within NLP. Subsequently, the system was trained and tested using the DNN model for classification, integrated with the TokenSimilarity model to identify word similarities. Experimental results indicate that the DNN model yielded the best outcomes, with a training accuracy of 98.97%, validation accuracy of 71.74%, and testing accuracy of 71.73%. Integration with the TokenSimilarity model enhanced the responses provided by the chatbot. TokenSimilarity searches for input similarities from users within the knowledge generated from the training data. If the similarity is high, the input is then processed by the DNN model to provide the chatbot response. This integration of both models has proven to enhance the responsiveness of the chatbot in providing various responses even when the user inputs remain the same. The chatbot also demonstrates the capability to recognize various inputs more effectively with similar intentions or purposes. Additionally, the chatbot exhibits the ability to comprehend user inputs although there are many writing errors.

Keywords

• bert
• chatbot
• college student
• dnn
• nlp