Coat color and birth weight, as easily selected traits in cattle, play important roles in cattle breeding. Therefore, we carried out a genome-wide association study on birth weight and coat color to identify loci or potential linkage regions in 233 Simmental × Holstein crossbred beef cattle. The results revealed that nine SNPs were significantly associated with coat color (rs137169378, rs110022687, rs136002689, Hypotrichosis_PMel17, PMEL_1, rs134930689, rs383170073, rs109924971, and rs109146332), and these were in RNF41, ZC3H10, ERBB3, PMEL, and OR10A7 on BTA5. Interestingly, rs137169378, rs110022687, rs136002689, Hypotrichosis_PMel17, and PMEL_1 showed strong linkage disequilibrium (r2 > 0.8) and were significantly associated with coat color. Notably, Hypotrichosis_PMel17 and PMEL_1 were located in the gene PMEL (p = 2.22 × 10−18). Among the five significant SNPs associated with coat color, the birth weight of heterozygous individuals (AB) was greater than that of homozygous individuals (AA). Notably, the birth weight of heterozygous individuals with Hypotrichosis_PMel17 and PMEL_1 genotypes was significantly greater than that of homozygous individuals (0.01 p p PMEL appears to be a candidate gene affecting coat color in cattle, and coat color may have a selective effect on birth weight. This study provides a foundation for the breeding of beef cattle through GWAS for coat color and birth weight.