In this work, we applied commercially available 2-pyridinecarboxylic acid to modify cellulose by simple manipulations, and then anchored low-toxicity metal nickel onto the modified cellulose to prepare the heterogeneous catalyst (CL-AcPy-Ni). The obtained catalyst was characterized by FT-IR, TG-DSC, BET, XRD, SEM-EDS, ICP-OES, XPS, and GPC. The catalytic performance of CL-AcPy-Ni in the Suzuki cross-coupling reaction was investigated using 4-methyl iodobenzene and phenylboronic acid as the model substrates reacting in THF under 120 °C for 24 h. The catalytic ability of CL-AcPy-Ni for various halobenzenes and phenylboronic acid derivatives was also further investigated under optimal conditions and demonstrated good catalytic activity, and a series of diaryls were successfully synthesized. Finally, this green nickel-based catalyst could be reused for five successive cycles by simple centrifugation.