We report the set-up of the Intracranial Tumor Segmentation (ICTS) dataset. This dataset was retrieved from clinical work of radiosurgery, contoured by qualified neurosurgeons and radiation oncologists. It contains contrast-enhanced T1-weighted images of 1500 patients, together with the labels of tumors to be treated. The ICTS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource.