Research has shown that participants can extract the average facial expression from a set of faces, when these were presented at fixation. In this study, we investigated whether this performance would be modulated by eccentricity, given that neural resources are limited outside the foveal region. We also examined whether or not there would be compulsory averaging in the parafovea, as has been previously reported for the orientation of Gabor patches by Parkes et al. (2001). Participants were presented with expressive faces (alone or in sets of nine; at fixation or at 3 degrees to the left or right), and were asked to identify the expression of the central target face or to estimate the average expression of the set. Our results revealed that although participants were able to extract average facial expressions in central and parafoveal conditions, their performance was superior in the parafovea, suggesting facilitated averaging outside the fovea by peripheral mechanisms. Furthermore, regardless of whether the task was to judge the expression of the central target or set average, participants had a tendency to identify central targets’ expressions in the fovea but were compelled to average in the parafovea, a finding consistent with compulsory averaging. The data also supported averaging over substitution models of crowding. We conclude that the ability to extract average expressions in sets of faces and identify single targets’ facial expressions is influenced by eccentricity.