Artificial intelligence-generated targets and inter-observer variation in online adaptive radiotherapy of bladder cancer

Abstract

Background and purpose: Daily target re-delineation in online adaptive radiotherapy (oART) introduces uncertainty. The aim of this study was to evaluate artificial intelligence (AI) generated contours and inter-observer target variation among radiotherapy technicians in cone-beam CT (CBCT) guided oART of bladder cancer. Materials and methods: For each of 10 consecutive patients treated with oART for bladder cancer, one CBCT was randomly selected and retrospectively included. The bladder (CTV-T) was AI-segmented (CTV-TAI). Seven radiotherapy technicians independently reviewed and edited CTV-TAI, generating CTV-TADP. Contours were benchmarked against a ground truth contour (CTV-TGT) delineated blindly from scratch. CTV-TADP and CTV-TAI were compared to CTV-TGT using volume, dice similarity coefficient, and bidirectional local distance. Dose coverage (D99%>95 %) of CTV-TGT was evaluated for treatment plans optimized for CTV-TAI and CTV-TADP with clinical margins. Inter-observer variation among CTV-TADP was assessed using coefficient of variation and generalized conformity index. Results: CTV-TGT ranged from 48.7 cm3 to 211.6 cm3. The median [range] volume difference was 4.5 [−17.8, 42.4] cm3 for CTV-TADP and −15.5 [−54.2, 4.3] cm3 for CTV-TAI, compared to CTV-TGT. Corresponding dice similarity coefficients were 0.87 [0.71, 0.95] and 0.84 [0.64, 0.95]. CTV-TGT was adequately covered in 68/70 plans optimized on CTV-TADP and in 6/10 plans optimized on CTV-TAI with clinical margins. The median [range] coefficient of variation was 0.08 [0.05, 0.11] and generalized conformity index was 0.78 [0.71, 0.88] among CTV-TADP. Conclusions: Target re-delineation in CBCT-guided oART of bladder cancer demonstrated non-isotropic inter-observer variation. Manual adjustment of AI-generated contours was necessary to cover ground truth targets.