In Bangladesh, there are significant number of medicinal plants, but currently no comprehensive record of these valuable species is publicly available. Alarmingly, some of these plants are in a precarious state of endangerment. Therefore, we are creating a unique dataset of Bangladeshʼs rare, endangered, and threatened medicinal plants to support conservation efforts. It will help us to track and conserve endangered plant species, ensuring a more organized approach to research and preservation efforts. We conducted on-site visits to the National Botanical Garden and The Government Unani and Ayurvedic Medical College, capturing photographs of these plants in optimal sunlight conditions at various times of the day. This involved fieldwork, detailed image annotations, dataset organization, diversity augmentation, and contribution to the preservation of our natural heritage. We have collected a total of 16 types of rare and endangered medicinal plant leaf photos to create our unique dataset consisting of a total of 3494 images. This dataset will help researchers in biodiversity conservation through building efficient machine learning models and applying advanced machine learning techniques to identify rare and endangered medicinal plants.