The effect of carbonation on the abrasion resistance of alkali-activated slag (AAS) was investigated. Various activator sets were selected for synthesizing AAS specimens, and the compressive strength was measured before and after carbonation. The abrasion resistance of the specimens was measured in accordance with the ASTM C944 test method. The relationship between the mass loss caused by abrasion and compressive strength was analyzed to understand the effect of matrix strength on abrasion resistance. Test results showed that the decrease in compressive strength of AAS specimens by carbonation reduced their abrasion resistance. In addition, the abrasion resistance of AAS before and after carbonation was sensitively influenced by activator type. It can be concluded that additional caution is required when using AAS where abrasion may have occurred.