In this paper, we realize a 3.96 kW all-fiberized and polarization-maintained (PM) amplifier with narrow linewidth and near-diffraction-limited beam quality. Based on a master oscillator power amplifier (MOPA) configuration seeded with phase-modulated single-frequency laser, a 3.96 kW signal laser is achieved with a 3 dB linewidth of 0.62 nm at the pump power of 5.02 kW. At the maximum output power, the polarization extinction ratio (PER) is ~13.9 dB, and the beam quality (M2 factor) is M2x = 1.31, M2y = 1.41. As far as we know, this is the maximum output power of PM narrow linewidth fiber laser with near-diffraction-limited beam quality and all-fiber format.