Home > Research > Publications & Outputs > Trust, systems and accidents

Research

Links

Text available via DOI:

View graph of relations

Trust, systems and accidents: Designing complex systems

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Chapter

Published

Standard

Trust, systems and accidents: Designing complex systems. / Dalcher, Darren.
Procs 10TH IEEE Int Conf and Workshop on the Engineering of Computer-Based Systems. IEEE COMPUTER SOC, 2003. p. 31-38.

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Chapter

Harvard

Dalcher, D 2003, Trust, systems and accidents: Designing complex systems. in Procs 10TH IEEE Int Conf and Workshop on the Engineering of Computer-Based Systems. IEEE COMPUTER SOC, pp. 31-38. https://doi.org/10.1109/ECBS.2003.1194780

APA

Dalcher, D. (2003). Trust, systems and accidents: Designing complex systems. In Procs 10TH IEEE Int Conf and Workshop on the Engineering of Computer-Based Systems (pp. 31-38). IEEE COMPUTER SOC. https://doi.org/10.1109/ECBS.2003.1194780

Vancouver

Dalcher D. Trust, systems and accidents: Designing complex systems. In Procs 10TH IEEE Int Conf and Workshop on the Engineering of Computer-Based Systems. IEEE COMPUTER SOC. 2003. p. 31-38 doi: 10.1109/ECBS.2003.1194780

Author

Dalcher, Darren. / Trust, systems and accidents : Designing complex systems. Procs 10TH IEEE Int Conf and Workshop on the Engineering of Computer-Based Systems. IEEE COMPUTER SOC, 2003. pp. 31-38

Bibtex

@inbook{bbf12f7bfd714192b9c97ed2f2c91b46,
title = "Trust, systems and accidents: Designing complex systems",
abstract = "Trust is easier to destroy than create, hence, trust in overly applied automation may erode following accidents. This paper looks at the crash of a revolutionary supersonic fighter that resulted from over-reliance on protection technology. The protection system has been automated to the extent that it was impossible for the pilot to regain control and convince the system that there was a problem. Complete trust in the safety of the system has thus been translated into a new kind of computer-assisted error, where in the interest of safety the only possible exit strategy is outlawed by the system leading to the potential (or in this case, the actual) destruction of the system it was meant to protect. Overall, trust appears to be an emergent function that takes in safety issues affecting the entire system as well as the relationship between the product, client and developer and the trade-offs that underpin decisions. Operators, working as part of a system, abrogate some of their responsibility by implicitly or explicitly passing on control to computerised systems. While operators function as an integral part of systems, their trust in the ability and safety of the system plays a key role in the ensuing success or failure.",
author = "Darren Dalcher",
year = "2003",
doi = "10.1109/ECBS.2003.1194780",
language = "English",
isbn = "0769519172",
pages = "31--38",
booktitle = "Procs 10TH IEEE Int Conf and Workshop on the Engineering of Computer-Based Systems",
publisher = "IEEE COMPUTER SOC",

}

RIS

TY - CHAP

T1 - Trust, systems and accidents

T2 - Designing complex systems

AU - Dalcher, Darren

PY - 2003

Y1 - 2003

N2 - Trust is easier to destroy than create, hence, trust in overly applied automation may erode following accidents. This paper looks at the crash of a revolutionary supersonic fighter that resulted from over-reliance on protection technology. The protection system has been automated to the extent that it was impossible for the pilot to regain control and convince the system that there was a problem. Complete trust in the safety of the system has thus been translated into a new kind of computer-assisted error, where in the interest of safety the only possible exit strategy is outlawed by the system leading to the potential (or in this case, the actual) destruction of the system it was meant to protect. Overall, trust appears to be an emergent function that takes in safety issues affecting the entire system as well as the relationship between the product, client and developer and the trade-offs that underpin decisions. Operators, working as part of a system, abrogate some of their responsibility by implicitly or explicitly passing on control to computerised systems. While operators function as an integral part of systems, their trust in the ability and safety of the system plays a key role in the ensuing success or failure.

AB - Trust is easier to destroy than create, hence, trust in overly applied automation may erode following accidents. This paper looks at the crash of a revolutionary supersonic fighter that resulted from over-reliance on protection technology. The protection system has been automated to the extent that it was impossible for the pilot to regain control and convince the system that there was a problem. Complete trust in the safety of the system has thus been translated into a new kind of computer-assisted error, where in the interest of safety the only possible exit strategy is outlawed by the system leading to the potential (or in this case, the actual) destruction of the system it was meant to protect. Overall, trust appears to be an emergent function that takes in safety issues affecting the entire system as well as the relationship between the product, client and developer and the trade-offs that underpin decisions. Operators, working as part of a system, abrogate some of their responsibility by implicitly or explicitly passing on control to computerised systems. While operators function as an integral part of systems, their trust in the ability and safety of the system plays a key role in the ensuing success or failure.

U2 - 10.1109/ECBS.2003.1194780

DO - 10.1109/ECBS.2003.1194780

M3 - Chapter

SN - 0769519172

SP - 31

EP - 38

BT - Procs 10TH IEEE Int Conf and Workshop on the Engineering of Computer-Based Systems

PB - IEEE COMPUTER SOC

ER -