Radiation-induced damage and instabilities in back-illuminated silicon detectors have proved to be challenging in multiple NASA and commercial applications. In this paper, we develop a model of detector quantum efficiency (QE) as a function of Si–SiO2 interface and oxide trap densities to analyze the performance of silicon detectors and explore the requirements for stable, radiation-hardened surface passivation. By analyzing QE data acquired before, during, and after, exposure to damaging UV radiation, we explore the physical and chemical mechanisms underlying UV-induced surface damage, variable surface charge, QE, and stability in ion-implanted and delta-doped detectors. Delta-doped CCD and CMOS image sensors are shown to be uniquely hardened against surface damage caused by ionizing radiation, enabling the stability and photometric accuracy required by NASA for exoplanet science and time domain astronomy.