This paper reports for the first time the incorporation of in-situ reduced graphene oxide (rGO) into geopolymers. The resulting rGO–geopolymeric composites are easy to manufacture and exhibit excellent mechanical properties. Geopolymers with graphene oxide (GO) concentrations of 0.00, 0.10, 0.35 and 0.50% by weight were fabricated. The functional groups, morphology, void filling mechanisms and mechanical properties of the composites were determined. The Fourier transform infrared (FTIR) spectra revealed that the alkaline solution reduced the hydroxyl/carbonyl groups of GO by deoxygenation and/or dehydration. Concomitantly, the spectral absorbance related to silica type cross-linking increased in the spectra. The scanning electron microscope (SEM) micrographs indicated that rGO altered the morphology of geopolymers from a porous nature to a substantially pore filled morphology with increased mechanical properties. The flexural tests showed that 0.35-wt.% rGO produced the highest flexural strength, Young's modulus and flexural toughness and they were increased by 134%, 376% and 56%, respectively.