Toward manipulating user perceptions of objects by altering interaction sounds

Bustoni, Isna Alfi (2025) Toward manipulating user perceptions of objects by altering interaction sounds. MPhil(R) thesis, University of Glasgow.

Abstract

Humans naturally use interaction sounds emitted from physical contact with objects to gather information about their properties, such as size, texture, and quality. Augmenting these interaction sounds may manipulate our perception of the object’s properties. Furthermore, such augmentation could be useful in conveying extra information. For instance, augmenting the perceived weight of a cup by manipulating the interaction sound could help users track their daily food and carbohydrate intake to aid them in their diet. While previous work has demonstrated the effect of reverb on room size perception in various contexts, such as VR gaming, few studies have explored the potential of manipulating interaction sound, such as adding reverb or changing the sound, to alter user perception of object properties.

In two experiments, this thesis explored the effects of different auditory feedback (surface materials, musical instruments) and reverb parameters (mixing, depth) on perceived simultaneity, unity, agency, and object properties (object size, material, and room size), along with their recognition. Through the experiments, it was discovered that modifying the sounds emitted from tapping an audible object can affect our perception of its size and the size of the room in which it is located. In regards to the user ability to recognize auditory feedback , it was discovered that auditory feedback did not considerably impact the accuracy of audio recognition, whereas reverb played a more significant role.

This thesis presents a discussion of the findings, along with the limitations of the current study and suggestions for future research. Lastly, it provides guidelines on augmenting interaction sounds based on our experiments and findings.

• Item Type: Thesis (MPhil(R))
• Qualification Level: Masters
• Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
• Colleges/Schools: College of Science and Engineering > School of Computing Science
• Supervisor's Name: Brewster, Professor Stephen and McGill, Dr. Mark
• Date of Award: 2025
• Depositing User: Theses Team
• Unique ID: glathesis:2025-84878
• Copyright: Copyright of this thesis is held by the author.
• Date Deposited: 10 Feb 2025 10:16
• Last Modified: 10 Feb 2025 10:17
• Thesis DOI: 10.5525/gla.thesis.84878
• URI: https://theses.gla.ac.uk/id/eprint/84878