Supercontinuum (SC) with broad bandwidth and high coherence is crucial in the SC-based frequency comb source generation. In this paper, we numerically investigate the mid-infrared (MIR) SC generations with the three optical modes (TE00, TE10, and TE20) in a multimode chalcogenide (As2Se3) strip waveguide. The waveguide structure is carefully engineered to ensure that the pump pulses are propagated in the normal dispersion regions of the considered three optical modes. Highly coherent and octave-spanning MIR SCs are generated when the optimized pump pulse with 80-fs pulse duration, 3-kW peak power, and 3-μm center wavelength is used. Moreover, the nonlinear dynamics of the SC generation are numerically analyzed. Finally, the SC-based frequency combs are numerically demonstrated when a pulse train with a repetition rate of 50 MHz is used as the pump source and launched into the multimode As2Se3-based strip waveguide. It is believed that the generated MIR SC and SC-based frequency comb sources have important applications in biophotonics, metrology, and sensing.