Language is sustained by large-scale networks in the human brain. Stroke often severely affects function and network dynamics. However, the adaptive potential of the brain to compensate for lesions is poorly understood. A key question is whether upregulation of the right hemisphere is adaptive for language recovery. Targeting the potential for short-term reorganization in the lesioned brain, we applied 'virtual lesions' over left anterior or posterior inferior frontal gyrus (IFG) in post-stroke patients with left temporo-parietal lesions prior to functional neuroimaging. Perturbation of the posterior IFG selectively delayed phonological decisions and decreased phonological activity. The individual response delay was correlated with the upregulation of the lesion homologue, likely reflecting compensation. Moreover, stronger individual tract integrity of the right superior longitudinal fascicle was associated with lesser disruption. Our results provide evidence for functional and structural underpinnings of plasticity in the lesioned language network, and a compensatory role of the right hemisphere.