Home > Research > Publications & Outputs > Towards a Framework for Evaluating CSAM Prevent...

Research

Links

Keywords

View graph of relations

Towards a Framework for Evaluating CSAM Prevention and Detection Tools in the Context of End-to-end-encryption Environments: a Case Study

Research output: Book/Report/Proceedings › Commissioned report

Published

Standard

Towards a Framework for Evaluating CSAM Prevention and Detection Tools in the Context of End-to-end-encryption Environments: a Case Study. / Peersman, Claudia; Llanos, José Tomas; May-Chahal, Corinne et al.
1 ed. Bristol : REPHRAIN, 2023. 30 p.

Research output: Book/Report/Proceedings › Commissioned report

Harvard

Peersman, C, Llanos, JT, May-Chahal, C, McConville, R, Chowdhury, PD & De Cristofaro, E 2023, Towards a Framework for Evaluating CSAM Prevention and Detection Tools in the Context of End-to-end-encryption Environments: a Case Study. vol. 1, 1 edn, REPHRAIN, Bristol . <https://www.rephrain.ac.uk/files/2023/02/Safety-Tech-Challenge-Fund-evaluation-framework-report.pdf>

APA

Peersman, C., Llanos, J. T., May-Chahal, C., McConville, R., Chowdhury, P. D., & De Cristofaro, E. (2023). Towards a Framework for Evaluating CSAM Prevention and Detection Tools in the Context of End-to-end-encryption Environments: a Case Study. (1 ed.) REPHRAIN. https://www.rephrain.ac.uk/files/2023/02/Safety-Tech-Challenge-Fund-evaluation-framework-report.pdf

Vancouver

Peersman C, Llanos JT, May-Chahal C, McConville R, Chowdhury PD, De Cristofaro E. Towards a Framework for Evaluating CSAM Prevention and Detection Tools in the Context of End-to-end-encryption Environments: a Case Study. 1 ed. Bristol : REPHRAIN, 2023. 30 p.

Author

Peersman, Claudia ; Llanos, José Tomas ; May-Chahal, Corinne et al. / Towards a Framework for Evaluating CSAM Prevention and Detection Tools in the Context of End-to-end-encryption Environments : a Case Study. 1 ed. Bristol : REPHRAIN, 2023. 30 p.

Bibtex

@book{62a01c05cd64489e8282da222c51f5ce,
title = "Towards a Framework for Evaluating CSAM Prevention and Detection Tools in the Context of End-to-end-encryption Environments: a Case Study",
abstract = "Through the Safety Tech Challenge Fund, the UK Government awarded funding to five projects to prototype innovative, automated technologies to help keep children safe in E2EE environments, such as online messaging platforms, while ensuring user privacy is respected.To enable academic scrutiny, the UK National Research Centre on Privacy, Harm Reduction and Adversarial Influence Online (REPHRAIN) was requested by the Department for Culture Media and Sport to act as an independent, external evaluator to each of these five projects. This is the first independent, public evaluation of automated industry tools developed for online child protection.The report presents:The finalised version of the evaluation criteria, following public consultation. Aside from performance these also include criteria focusing on human rights impact, security, explainability, transparency, fairness, accountability, etc. The criteria are intended to highlight the trade-offs that are faced when selecting different approaches for online child protection purposes in the context of E2EE environments. Additionally, they can be used as a guidance by the safety tech industry to help build public trust in their systems, to positively influence AI technology developments for online child protection, and to ensure all users benefit from these solutions.A case study in which these criteria were implemented as part of a formal evaluation of each Proof-of-Concept (PoC) tool funded by the Safety Tech Challenge Fund. We describe the presence or absence of different measures that assure compliance with each criterion and provide guidance where possible when certain criteria were not met.A discussion on how future research can support a framework for evaluating CSAM detection and prevention tools.",
keywords = "Child protection, Online harm, Safety technology, Evaluation Frameworks",
author = "Claudia Peersman and Llanos, {Jos{\'e} Tomas} and Corinne May-Chahal and Ryan McConville and Chowdhury, {Partha Das} and {De Cristofaro}, Emiliano",
year = "2023",
month = feb,
day = "23",
language = "English",
volume = "1",
publisher = "REPHRAIN",
edition = "1",

}

RIS

TY - BOOK

T1 - Towards a Framework for Evaluating CSAM Prevention and Detection Tools in the Context of End-to-end-encryption Environments

T2 - a Case Study

AU - Peersman, Claudia

AU - Llanos, José Tomas

AU - May-Chahal, Corinne

AU - McConville, Ryan

AU - Chowdhury, Partha Das

AU - De Cristofaro, Emiliano

PY - 2023/2/23

Y1 - 2023/2/23

N2 - Through the Safety Tech Challenge Fund, the UK Government awarded funding to five projects to prototype innovative, automated technologies to help keep children safe in E2EE environments, such as online messaging platforms, while ensuring user privacy is respected.To enable academic scrutiny, the UK National Research Centre on Privacy, Harm Reduction and Adversarial Influence Online (REPHRAIN) was requested by the Department for Culture Media and Sport to act as an independent, external evaluator to each of these five projects. This is the first independent, public evaluation of automated industry tools developed for online child protection.The report presents:The finalised version of the evaluation criteria, following public consultation. Aside from performance these also include criteria focusing on human rights impact, security, explainability, transparency, fairness, accountability, etc. The criteria are intended to highlight the trade-offs that are faced when selecting different approaches for online child protection purposes in the context of E2EE environments. Additionally, they can be used as a guidance by the safety tech industry to help build public trust in their systems, to positively influence AI technology developments for online child protection, and to ensure all users benefit from these solutions.A case study in which these criteria were implemented as part of a formal evaluation of each Proof-of-Concept (PoC) tool funded by the Safety Tech Challenge Fund. We describe the presence or absence of different measures that assure compliance with each criterion and provide guidance where possible when certain criteria were not met.A discussion on how future research can support a framework for evaluating CSAM detection and prevention tools.

AB - Through the Safety Tech Challenge Fund, the UK Government awarded funding to five projects to prototype innovative, automated technologies to help keep children safe in E2EE environments, such as online messaging platforms, while ensuring user privacy is respected.To enable academic scrutiny, the UK National Research Centre on Privacy, Harm Reduction and Adversarial Influence Online (REPHRAIN) was requested by the Department for Culture Media and Sport to act as an independent, external evaluator to each of these five projects. This is the first independent, public evaluation of automated industry tools developed for online child protection.The report presents:The finalised version of the evaluation criteria, following public consultation. Aside from performance these also include criteria focusing on human rights impact, security, explainability, transparency, fairness, accountability, etc. The criteria are intended to highlight the trade-offs that are faced when selecting different approaches for online child protection purposes in the context of E2EE environments. Additionally, they can be used as a guidance by the safety tech industry to help build public trust in their systems, to positively influence AI technology developments for online child protection, and to ensure all users benefit from these solutions.A case study in which these criteria were implemented as part of a formal evaluation of each Proof-of-Concept (PoC) tool funded by the Safety Tech Challenge Fund. We describe the presence or absence of different measures that assure compliance with each criterion and provide guidance where possible when certain criteria were not met.A discussion on how future research can support a framework for evaluating CSAM detection and prevention tools.

KW - Child protection

KW - Online harm

KW - Safety technology

KW - Evaluation Frameworks

M3 - Commissioned report

VL - 1

BT - Towards a Framework for Evaluating CSAM Prevention and Detection Tools in the Context of End-to-end-encryption Environments

PB - REPHRAIN

CY - Bristol

ER -