The COVID-19 pandemic, caused by the SARS-CoV-2 virus, has significantly impacted global healthcare, underscoring the importance of exploring the virus’s effects on infected individuals beyond treatments and vaccines. Notably, recent findings suggest that SARS-CoV-2 can infect the gut, thereby altering the gut microbiota. This study aimed to analyze the gut microbiota composition differences between COVID-19 patients experiencing mild and severe symptoms. We conducted 16S rRNA metagenomic sequencing on fecal samples from 49 mild and 43 severe COVID-19 cases upon hospital admission. Our analysis identified a differential abundance of specific bacterial species associated with the severity of the disease. Severely affected patients showed an association with Enterococcus faecium, Akkermansia muciniphila, and others, while milder cases were linked to Faecalibacterium prausnitzii, Alistipes putredinis, Blautia faecis, and additional species. Furthermore, a network analysis using SPIEC-EASI indicated keystone taxa and highlighted structural differences in bacterial connectivity, with a notable disruption in the severe group. Our study highlights the diverse impacts of SARS-CoV-2 on the gut microbiome among both mild and severe COVID-19 patients, showcasing a spectrum of microbial responses to the virus. Importantly, these findings align, to some extent, with observations from other studies on COVID-19 gut microbiomes, despite variations in methodologies. The findings from this study, based on retrospective data, establish a foundation for future prospective research to confirm the role of the gut microbiome as a predictive biomarker for the severity of COVID-19.