Abeliophyllum distichum Nakai is known as a monotypic genus endemic to South Korea. Currently, several pharmacological studies have revealed that A. distichum extract exhibits diverse biological functions, including anti-cancer, anti-diabetic, anti-hypertensive, and anti-inflammatory activities. In this study, we present the anti-osteoporotic activity of A. distichum extract by inhibiting osteoclast formation. First, we show that the methanolic extract of the leaves of A. distichum, but not extracts of the branches or fruits, significantly inhibits receptor activator of the NF-κB ligand (RANKL)-induced osteoclast differentiation. Second, our transcriptome analysis revealed that the leaf extract (LE) blocks sets of RANKL-mediated osteoclast-related genes. Third, the LE attenuates the phosphorylation of extracellular signal-related kinase. Finally, treatment with the LE effectively prevents postmenopausal bone loss in ovariectomized mice and glucocorticoid-induced osteoporosis in zebrafish. Our findings show that the extract of A. distichum efficiently suppressed osteoclastogenesis by regulating osteoclast-related genes, thus offering a novel therapeutic strategy for osteoporosis.