Home > Research > Publications & Outputs > The Aesthetics of Disharmony: Harnessing Sounds...

Research

Associated organisational unit

Electronic data

  • Mario Escarce - Solato

    Rights statement: This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in https://doi.org/10.1145/3611045.

    Accepted author manuscript, 22.7 MB, PDF document

    Available under license: CC BY: Creative Commons Attribution 4.0 International License

Links

Text available via DOI:

Keywords

View graph of relations

The Aesthetics of Disharmony: Harnessing Sounds and Images for Dynamic Soundscapes Generation

Research output: Contribution to Journal/Magazine › Journal article › peer-review

Published

Standard

The Aesthetics of Disharmony: Harnessing Sounds and Images for Dynamic Soundscapes Generation. / Escarce Junior, Mario; Rossmann Martins, Georgia; Soriano Marcolino, Leandro et al.
In: ACM - PACMHCI CHI PLAY, Vol. 7, No. CHI PLAY, 399, 04.10.2023, p. 665-698.

Research output: Contribution to Journal/Magazine › Journal article › peer-review

Harvard

Escarce Junior, M, Rossmann Martins, G, Soriano Marcolino, L & Rubegni, E 2023, 'The Aesthetics of Disharmony: Harnessing Sounds and Images for Dynamic Soundscapes Generation', ACM - PACMHCI CHI PLAY, vol. 7, no. CHI PLAY, 399, pp. 665-698. https://doi.org/10.1145/3611045

APA

Escarce Junior, M., Rossmann Martins, G., Soriano Marcolino, L., & Rubegni, E. (2023). The Aesthetics of Disharmony: Harnessing Sounds and Images for Dynamic Soundscapes Generation. ACM - PACMHCI CHI PLAY, 7(CHI PLAY), 665-698. Article 399. https://doi.org/10.1145/3611045

Vancouver

Escarce Junior M, Rossmann Martins G, Soriano Marcolino L, Rubegni E. The Aesthetics of Disharmony: Harnessing Sounds and Images for Dynamic Soundscapes Generation. ACM - PACMHCI CHI PLAY. 2023 Oct 4;7(CHI PLAY):665-698. 399. Epub 2023 Sept 29. doi: 10.1145/3611045

Author

Escarce Junior, Mario ; Rossmann Martins, Georgia ; Soriano Marcolino, Leandro et al. / The Aesthetics of Disharmony: Harnessing Sounds and Images for Dynamic Soundscapes Generation. In: ACM - PACMHCI CHI PLAY. 2023 ; Vol. 7, No. CHI PLAY. pp. 665-698.

Bibtex

@article{09353a6058d74347994c3c87447985bf,
title = "The Aesthetics of Disharmony: Harnessing Sounds and Images for Dynamic Soundscapes Generation",
abstract = "This work presents an autonomous approach that explores the dynamic generation of relaxing soundscapes for games and artistic installations. Differently from past works, this system can generate music and images simultaneously, preserving human intent and coherency. We present our algorithm for the generation of audiovisual instances and also a system based on this approach, verifying the quality of the outcomes it can produce in light of current approaches for the generation of images and music. We also instigate the discussion around the new paradigm in arts, where the creative process is delegated to autonomous systems, with limited human participation. Our user study (N=74) shows that our approach overcomes current deep learning models in terms of quality, being recognized as human production, as if the outcome were being generated out of an endless musical improvisation performance.",
keywords = "Computer Networks and Communications, Human-Computer Interaction, Social Sciences (miscellaneous)",
author = "{Escarce Junior}, Mario and {Rossmann Martins}, Georgia and {Soriano Marcolino}, Leandro and Elisa Rubegni",
year = "2023",
month = oct,
day = "4",
doi = "10.1145/3611045",
language = "English",
volume = "7",
pages = "665--698",
journal = "ACM - PACMHCI CHI PLAY",
number = "CHI PLAY",

}

RIS

TY - JOUR

T1 - The Aesthetics of Disharmony: Harnessing Sounds and Images for Dynamic Soundscapes Generation

AU - Escarce Junior, Mario

AU - Rossmann Martins, Georgia

AU - Soriano Marcolino, Leandro

AU - Rubegni, Elisa

PY - 2023/10/4

Y1 - 2023/10/4

N2 - This work presents an autonomous approach that explores the dynamic generation of relaxing soundscapes for games and artistic installations. Differently from past works, this system can generate music and images simultaneously, preserving human intent and coherency. We present our algorithm for the generation of audiovisual instances and also a system based on this approach, verifying the quality of the outcomes it can produce in light of current approaches for the generation of images and music. We also instigate the discussion around the new paradigm in arts, where the creative process is delegated to autonomous systems, with limited human participation. Our user study (N=74) shows that our approach overcomes current deep learning models in terms of quality, being recognized as human production, as if the outcome were being generated out of an endless musical improvisation performance.

AB - This work presents an autonomous approach that explores the dynamic generation of relaxing soundscapes for games and artistic installations. Differently from past works, this system can generate music and images simultaneously, preserving human intent and coherency. We present our algorithm for the generation of audiovisual instances and also a system based on this approach, verifying the quality of the outcomes it can produce in light of current approaches for the generation of images and music. We also instigate the discussion around the new paradigm in arts, where the creative process is delegated to autonomous systems, with limited human participation. Our user study (N=74) shows that our approach overcomes current deep learning models in terms of quality, being recognized as human production, as if the outcome were being generated out of an endless musical improvisation performance.

KW - Computer Networks and Communications

KW - Human-Computer Interaction

KW - Social Sciences (miscellaneous)

U2 - 10.1145/3611045

DO - 10.1145/3611045

M3 - Journal article

VL - 7

SP - 665

EP - 698

JO - ACM - PACMHCI CHI PLAY

JF - ACM - PACMHCI CHI PLAY

IS - CHI PLAY

M1 - 399

ER -