A toolkit of resource-sensitive, multimodal widgets

Crease, Murray (2001) A toolkit of resource-sensitive, multimodal widgets. PhD thesis, University of Glasgow.

Abstract

This thesis describes an architecture for a toolkit of user interface components which allows the presentation of the widgets to use multiple output modalities - typically, audio and visual. Previously there was no toolkit of widgets which would use the most appropriate presentational resources according to their availability and suitability. Typically the use of different forms of presentation was limited to graphical feedback with the addition of other forms of presentation, such as sound, being added in an ad hoc fashion with only limited scope for managing the use of the different resources. A review of existing auditory interfaces provided some requirements that the toolkit would need to fulfil for it to be effective. In addition, it was found that a strand of research in this area required further investigation to ensure that a full set of requirements was captured. It was found that no formal evaluation of audio being used to provide background information has been undertaken. A sonically-enhanced progress indicator was designed and evaluated showing that audio feedback could be used as a replacement for visual feedback rather than simply as an enhancement. The experiment also completed the requirements capture for the design of the toolkit of multimodal widgets. A review of existing user interface architectures and systems, with particular attention paid to the way they manage multiple output modalities presented some design guidelines for the architecture of the toolkit. Building on these guidelines a design for the toolkit which fulfils all the previously captured requirements is presented. An implementation of this design is given, with an evaluation of the implementation showing that it fulfils all the requirements of the design

• Item Type: Thesis (PhD)
• Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
• Colleges/Schools: College of Science and Engineering > School of Computing Science
• Supervisor's Name: Brewster, Prof. Stephen and Gray, Mr Philip
• Date of Award: 2001
• Depositing User: Miss Louise Annan
• Unique ID: glathesis:2001-6645
• Copyright: Copyright of this thesis is held by the author.
• Date Deposited: 27 Aug 2015 08:34
• Last Modified: 21 Sep 2015 14:55
• URI: https://theses.gla.ac.uk/id/eprint/6645