The diagnostic accuracy of handheld ultrasound (HHUS) devices operated by newly certified operators for pneumonia is unknown. This multicenter diagnostic accuracy study included patients prospectively suspected of pneumonia from February 2021 to February 2022 in four emergency departments. The index test was a 14-zone focused lung ultrasound (FLUS) examination, with consolidation with air bronchograms as diagnostic criteria for pneumonia. FLUS examinations were performed by newly certified operators using HHUS. The reference standard was computed tomography (CT) and expert diagnosis using all medical records. The sensitivity and specificity of FLUS and chest X-ray (CXR) were compared using McNemar’s test. Of the 324 scanned patients, 212 (65%) had pneumonia, according to the expert diagnosis. FLUS had a sensitivity of 31% (95% CI 26–36) and a specificity of 82% (95% CI 78–86) compared with the experts’ diagnosis. Compared with CT, FLUS had a sensitivity of 32% (95% CI 27–37) and specificity of 81% (95% CI 77–85). CXR had a sensitivity of 66% (95% CI 61–72) and a specificity of 76% (95% CI 71–81) compared with the experts’ diagnosis. Compared with CT, CXR had a sensitivity of 69% (95% CI 63–74) and a specificity of 68% (95% CI 62–72). Compared with the experts’ diagnosis and CT diagnosis, FLUS performed by newly certified operators using HHUS devices had a significantly lower sensitivity for pneumonia when compared to CXR (p p = 0.02). HHUS exhibited low sensitivity for pneumonia when used by newly certified operators.
