Rights statement: © Owner/Author, 2017. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in LIMITS '17 Proceedings of the 2017 Workshop on Computing Within Limits http://dx.doi.org/10.1145/3080556.3080567
Accepted author manuscript, 709 KB, PDF document
Available under license: CC BY-NC: Creative Commons Attribution-NonCommercial 4.0 International License
Final published version
Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Conference contribution/Paper › peer-review
Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Conference contribution/Paper › peer-review
}
TY - GEN
T1 - The Limits of Evaluating Sustainability
AU - Remy, Christian
AU - Bates, Oliver Emile Glaves
AU - Thomas, Vanessa
AU - Huang, Elaine M.
N1 - Conference code: 3
PY - 2017/6/22
Y1 - 2017/6/22
N2 - Designing technology with sustainability in mind is becoming more and more important, especially considering future scenarios of limited resources where the world’s current lifestyle of wasteful consumption needs to change. But how can researchers believably argue that their solutions are indeed sustainable? How can consumers and technology users reliably acquire, understand, and apply information about environmental sustainability? Those questions are difficult to answer, especially in research domains where the impact on sustainability is not immediately measurable, such as sustainable HCI. The evaluation of sustainability is an ongoing problem that is often glossed over, but we believe the community needs to intensify its efforts to articulate its evaluation methods to other disciplines and external stakeholders. Even if those disciplines and stakeholders understand the importance of designing for sustainability, we need convincing arguments – such as validation through thorough evaluations – to showcase why a specific design solution works in the real world. In this paper, we analyze this problem by highlighting examples of sustainable HCI research in which evaluation of sustainability failed. We also look at previous research that sought to address this issue and discuss how their solutions can be generalized – and when they might fail. While we do not have the final answer, our intention is to start a discussion as to why sustainable HCI research is oftentimes not doing enough to justify the validity of its solutions. We close our paper by suggesting a few examples of what we believe to be potential ways to address those issues and take action to improve the evaluation of sustainability.
AB - Designing technology with sustainability in mind is becoming more and more important, especially considering future scenarios of limited resources where the world’s current lifestyle of wasteful consumption needs to change. But how can researchers believably argue that their solutions are indeed sustainable? How can consumers and technology users reliably acquire, understand, and apply information about environmental sustainability? Those questions are difficult to answer, especially in research domains where the impact on sustainability is not immediately measurable, such as sustainable HCI. The evaluation of sustainability is an ongoing problem that is often glossed over, but we believe the community needs to intensify its efforts to articulate its evaluation methods to other disciplines and external stakeholders. Even if those disciplines and stakeholders understand the importance of designing for sustainability, we need convincing arguments – such as validation through thorough evaluations – to showcase why a specific design solution works in the real world. In this paper, we analyze this problem by highlighting examples of sustainable HCI research in which evaluation of sustainability failed. We also look at previous research that sought to address this issue and discuss how their solutions can be generalized – and when they might fail. While we do not have the final answer, our intention is to start a discussion as to why sustainable HCI research is oftentimes not doing enough to justify the validity of its solutions. We close our paper by suggesting a few examples of what we believe to be potential ways to address those issues and take action to improve the evaluation of sustainability.
KW - evaluation
KW - sustainability
KW - sustainable HCI
KW - SHCI
KW - sustainable interaction design
U2 - 10.1145/3080556.3080567
DO - 10.1145/3080556.3080567
M3 - Conference contribution/Paper
SN - 9781450349505
SP - 103
EP - 110
BT - LIMITS '17 Proceedings of the 2017 Workshop on Computing Within Limits
PB - ACM
CY - New York
T2 - ACM LIMITS 2017
Y2 - 22 June 2017 through 24 June 2017
ER -