The structure and thermal properties of yttrium alumino-phosphate glasses, of nominal composition (Y2O3)(0.31-z)(Al2O3)(z)(P2O5)(0.69) with 0 less than or similar to z less than or similar to 0.31, were studied by using a combination of neutron diffraction, Al-27 and P-31 magic angle spinning nuclear magnetic resonance, differential scanning calorimetry and thermal gravimetric analysis methods. The Vickers hardness of the glasses was also measured. The data are compared to those obtained for pseudo-binary Al2O3-P2O5 glasses and the structure of all these materials is rationalized in terms of a generic model for vitreous phosphate materials in which Y3+ and Al3+ act as modifying cations that bind only to the terminal (non-bridging) oxygen atoms of PO4 tetrahedra. The results are used to help elucidate the phenomenon of rare-earth clustering in phosphate glasses which can be reduced by substituting Al3+ ions for rare-earth R3+ ions at fixed modifier content.