The European Academic Software Award was initiated in 1994. It is a biennial competition which is organised by the European Knowledge Media Association. Academics and students are able to submit software they have developed which is then evaluated by a team of European expert-jurors. In this paper, we describe how the current EASA evaluation process runs and we then comment on evaluation in general, and specific aspects of the procedure which need to be reorganised, modified, abolished or developed for the next competition. A methodological revision of the EASA evaluation grid and a synthesis of the results are proposed.