Development and Validation of a Web-Based Survey on the Use of Personal Communication Devices by Hospital Registered Nurses: Pilot Study

Abstract

BackgroundThe use of personal communication devices (such as basic cell phones, enhanced cell phones or smartphones, and tablet computers) in hospital units has risen dramatically in recent years. The use of these devices for personal and professional activities can be beneficial, but also has the potential to negatively affect patient care, as clinicians may become distracted by these devices. ObjectiveNo validated questionnaire examining the impact of the use of these devices on patient care exists; thus, we aim to develop and validate an online questionnaire for surveying the views of registered nurses with experience of working in hospitals regarding the impact of the use of personal communication devices on hospital units. MethodsA 50-item, four-domain questionnaire on the views of registered nursing staff regarding the impact of personal communication devices on hospital units was developed based on a literature review and interviews with such nurses. A repeated measures pilot study was conducted to examine the psychometrics of a survey questionnaire and the feasibility of conducting a larger study. Psychometric testing of the questionnaire included examining internal consistency reliability and test-retest reliability in a sample of 50 registered nurses. ResultsThe response rate for the repeated measures was 30%. Cronbach coefficient alpha was used to examine the internal consistency and reliability, and in three of the four question groups (utilization, impact, and opinions), the correlation was observed to be very high. This suggests that the questions were measuring a single underlying theme. The Cronbach alpha value for the questions in the performance group, describing the use of personal communication devices while working, was lower than those for the other question groups. These values may be an indication that the assumptions underlying the Cronbach alpha calculation may have been violated for this group of questions. A Spearman rho correlation was used to determine the test-retest reliability. There was a strong test-retest reliability between the two tests for the majority of the questions. The average test-retest percent of agreement for the Likert scale responses was 74% (range 43-100%). Accounting for responses within the 1 SD range on the Likert scale increased the agreement to 96% (range 87-100%). Missing data were in the range of 0 to 7%. ConclusionsThe psychometrics of the questionnaire showed good to fair levels of internal consistency and test-retest reliability. The pilot study demonstrated that our questionnaire may be useful in exploring registered nurses’ perceptions of the impact of personal electronic devices on hospital units in a larger study.