Acoustic emission (AE) is capable of monitoring the cracking activities inside materials. In this study, embedded sensors were employed to monitor the AE behavior of early age concrete. Type 1–3 cement-based piezoelectric composites, which had lower mechanical quality factor and acoustic impedance, were fabricated and used to make sensors. Sensors made of the composites illustrated broadband frequency response. In a laboratory, the cracking of early age concrete was monitored to recognize different hydration stages. The sensors were also embedded in a mass concrete foundation to localize the temperature gradient cracks.