Abstract Background Primary lateral sclerosis (PLS) is an extremely rare condition; therefore, to date no clinical studies have been conducted. The Primary Lateral Sclerosis Functional Rating Scale (PLSFRS) was developed in the United States of America. The PLSFRS is a crucial assessment scale for international collaborative research and future clinical trials for PLS. It is useful for evaluating medical conditions through face-to-face assessments and telephone interviews such as when a face-to-face assessment is not possible due to disasters or the burden of hospital visits. This study assessed the reliability and consistency of in-person and telephone interviews using the Japanese version of the PLSFRS. Methods We enrolled 19 Japanese patients who met the specific criteria for inclusion at the six collaborating institutions. The PLSFRS assessments were performed by two evaluators at defined time points and analyzed for intra-rater and inter-rater reliability and consistency between the in-person and telephone interviews. Results The Japanese version of the PLSFRS was developed by a specialized company and translator, and modified to consider the Japanese lifestyle through a consensus among motor neuron specialists. The quadratic-weighted kappa coefficients for the intra-rater and the inter-rater agreement were substantial (intra-rater: 0.691-1.000, inter-rater: 0.634-1.000). Moreover, the intraclass correlation coefficient for the PLSFRS total score was 0.997 (95% confidence interval, 0.992–0.999). Conclusions This study provides results regarding the Japanese version of the PLSFRS intra-rater and inter-rater reliability and consistency between in-person and telephone interviews.
