This paper describes the design, construction, validation, and calibration of a thermal conductivity measuring apparatus for geothermal backfill materials in the range from 0.13–2.80 W/m·K. The developed apparatus is based on the Transient Hot Wire (THW) method whose mathematical basis is the Infinite Linear Source (ILS) model. The apparatus consists of a nichrome hot wire, an adjustable direct current power supply, a temperature sensor (K-type thermocouple), and a datalogger. For the validation and calibration of the developed apparatus, four standard samples have been used with a known thermal conductivity, to 3.0 W/m·K. Furthermore, the thermal conductivity of four geothermal backfill materials of common use (bentonite, neat cement, cement–sand mortar, and cement–bentonite mortar) has been measured using both the developed apparatus and a commercial meter.