We report on the synthesis and physical properties of cm-sized CoGeO3 single crystals grown in a high pressure mirror furnace at pressures of 80 bar. Direction dependent magnetic susceptibility measurements on our single crystals reveal highly anisotropic magnetic properties that we attribute to the impact of strong single ion anisotropy appearing in this system with TN∼33.5 K. Furthermore, we observe effective magnetic moments that are exceeding the spin only values of the Co ions, which reveals the presence of sizable orbital moments in CoGeO3.