Programming the multimodal interface
- Rensselaer Polytechnic Inst., Troy, NY (United States). Dept. of Computer Science
- Lawrence Livermore National Lab., CA (United States)
Fundamental problems will confront those who wish to take full advantage of the power of tomorrow's multimodal environments. We argue that our recently introduced concept of meta-widget, when embedded within a high level, networked user interface server, can support the effective implementation of complex multimedia applications. We develop algorithms which enable a multimodal system to select the best'' combination of representations for the various information packets'' in a display at any moment. If no acceptable - combination of available representations can be found, strategies are provided for creating a new and useful, if not beautiful, representation to resolve the impasse. A running example is provided to motivate and clarify the discussion.
- Research Organization:
- Lawrence Livermore National Lab., CA (United States)
- Sponsoring Organization:
- USDOE; National Science Foundation (NSF); USDOE, Washington, DC (United States); National Science Foundation, Washington, DC (United States)
- DOE Contract Number:
- W-7405-ENG-48
- OSTI ID:
- 6379210
- Report Number(s):
- UCRL-JC-112195; CONF-9304147-1; ON: DE93013084; CNN: CDA-8805910
- Resource Relation:
- Conference: INTERCHI 93: interact and computation human interaction, Amsterdam (Netherlands), 24-29 Apr 1993
- Country of Publication:
- United States
- Language:
- English
Similar Records
An XML Driven Graphical User Interface and Application Management Toolkit
An SML Driven Graphical User Interface and Application Management Toolkit
Related Subjects
INTERACTIVE DISPLAY DEVICES
PROGRAMMING
ALGORITHMS
COMPUTER GRAPHICS
COMPUTER NETWORKS
EQUIPMENT INTERFACES
HUMAN FACTORS
COMPUTER OUTPUT DEVICES
COMPUTER-GRAPHICS DEVICES
DISPLAY DEVICES
MATHEMATICAL LOGIC
990200* - Mathematics & Computers