Pyrimidine is a privileged scaffold in many synthetic compounds exhibiting diverse pharmacological activities, and is used for therapeutic applications in a broad spectrum of human diseases. In this study, we prepared a small set of pyrimidine libraries based on the structure of two hit compounds that were identified through the screening of an in-house library in order to identify an inhibitor of anoctamin 1 (ANO1). ANO1 is amplified in various types of human malignant tumors, such as head and neck, parathyroid, and gastrointestinal stromal tumors, as well as in breast, lung, and prostate cancers. After initial screening and further structure optimization, we identified Aa3 as a dose-dependent ANO1 blocker. This compound exhibited more potent anti-cancer activity in the NCI-H460 cell line, expressing high levels of ANO1 compared with that in A549 cells that express low levels of ANO1. Our results open a new direction for the development of small-molecule ANO1 blockers composed of a pyrimidine scaffold and a nitrogen-containing heterocyclic moiety, with drug-like properties.