Src homology 2 domain-containing phosphatase 2 (SHP2) is an attractive target for cancer therapy due to its multifaceted roles in both tumor and immune cells. Herein, we designed and synthesized a novel series of proteolysis targeting chimeras (PROTACs) using a SHP2 allosteric inhibitor as warhead, with the goal of achieving SHP2 degradation both inside the cell and in vivo. Among these molecules, compound P9 induces efficient degradation of SHP2 (DC50 = 35.2 ± 1.5 nM) in a concentration- and time-dependent manner. Mechanistic investigation illustrates that the P9-mediated SHP2 degradation requires the recruitment of the E3 ligase and is ubiquitination- and proteasome-dependent. P9 shows improved anti-tumor activity in a number of cancer cell lines over its parent allosteric inhibitor. Importantly, administration of P9 leads to a nearly complete tumor regression in a xenograft mouse model, as a result of robust SHP2 depletion and suppression of phospho-ERK1/2 in the tumor. Hence, P9 represents the first SHP2 PROTAC molecule with excellent in vivo efficacy. It is anticipated that P9 could serve not only as a new chemical tool to interrogate SHP2 biology but also as a starting point for the development of novel therapeutics targeting SHP2.