Kortum P. (ed.) HCI Beyond the GUI. Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces

Подождите немного. Документ загружается.

Rienks, R. J., Nijholt, A., & Barthelmess, P. (2006). Pro-active meeting assistants: Attention

please! Paper presented at the 5th Workshop on Social Intelligence Design, Osaka.

Robert-Ribes, J., Schwartz, J.-L., Lallouache, T., & Escudier, P. (1998). Complementarity

and synergy in bimodal speech: Auditory, visual, and auditory-visual identification

of French oral vowels in noise.

Journal of the Acoustical Society of America

103(6):

3677–89.

Rogozan, A., & Dele

glise, P. (1998). Adaptive fusion of acoustic and visual sources for auto-

matic speech recognition.

Speech Communication

26(1–2):149–61.

Ruiz, N., Taib, R., & Chen, F. (2006).

Examining the redundancy of multimodal input

. Paper

presented at the 2006 Australian International Conference on Computer–Human Interac-

tion, Sydney.

Salber, D., & Coutaz, J. (1993a). Applying the Wizard of Oz technique to the study of multi-

modal systems. Paper presented at the Third International Conference on Human–

Computer Interaction, Moscow.

Salber, D., & Coutaz, J. (1993b). A Wizard of Oz platform for the study of multimodal sys-

tems. Paper presented at the 1993 SIGCHI Conference on Human Factors in Computing

Systems, Amsterdam.

Sellen, A. J., & Harper, R. H. (2003).

The Myth of the Paperless Office

. Cambridge, MA: MIT

Press.

Siroux, J., Guyomard, M., Multon, F., & Remondeau, C. (1995). Modeling and processing of

the oral and tactile activities in the Georal tactile system. Paper presented at the First

International Conference on Cooperative Multimodal Communication, Eindhoven.

Stock, O., & Zancanaro, M., eds. (2005).

Multimodal Intelligent Information Presentations

New York: Springer.

Stotts, D., Bishop, G., Culp, J., Miller, D., Gyllstrom, K., & Lee, K. (2005).

Facetop on the

Tablet PC: Assistive Technology in Support of Classroom Note-Taking for Hearing-

Impaired Students

. Technical Report. Chapel Hill: University of North Carolina.

Suhm, B. (1998). Multimodal Interactive Error Recovery for Non-Conversational Speech

User Interfaces. PhD diss., University of Karlsruhe (Germany).

Suhm, B., Myers, B. A., & Waibel, A. (1999). Model-based and empirical evaluation of mul-

timodal interactive error correction. Paper presented at the 1999 SIGCHI Conference on

Human Factors in Computing Systems, Pittsburgh.

Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise.

Journal of the Acoustical Society of America

26(2):212–15.

Summerfield, Q. (1992). Lipreading and audio-visual speech perception.

Philosophical

Transactions of the Royal Society of London: Biological Sciences

335(1273):71–78.

Tang, A., McLachlan, P., Lowe, K., Saka, C. R., & MacLean, K. (2005). Perceiving ordinal

data haptically under workload. Paper presented at the 7th International Conference on

Multimodal Interfaces, Trento, Italy.

Tang, J. C. (1991). Finding from observational studies of collaborative work.

International

Journal of Man–Machine Studies

34(2):143–60.

Tomlinson, M. J., Russell, M. J., & Brooke, N. M. (1996). Integrating audio and visual infor-

mation to provide highly robust speech recognition. Paper presented at the 1996 IEEE

International Conference on Acoustics, Speech, and Signal Processing, Atlanta.

Turk, M., & Robertson, G. (2000). Perceptual user interfaces (introduction).

Communica-

tions of the Association for Computing Machinery

43(3):32–34.

12 Multimodal Interfaces: Combining Interfaces

442

Van Leeuwen, D. A., & Huijbregts, M. A. H. (2006). The AIM speaker diarization system for

NIST RT06’s meeting data. Paper presented at the NIST Rich Transcription 2006 Spring

Meeting Recognition Evaluation.

van Turnhout, K., Terken, J., Bakx, I., & Eggen, B. (2005). Identifying the intended

addressee in mixed human–human and human–computer interaction from non-verbal

features. Paper presented at the 7th International Conference on Multimodal Interfaces,

Trento, Italy.

Vatikiotis-Bateson, E., Munhall, K. G., Hirayama, M., Lee, Y., & Terzopoulos, D. (1996). The

dynamics of audiovisual behavior of speech.

Speechreading by Humans and Machines:

Models, Systems and Applications

150:221–32.

Verbree, D., Rienks, R. J., & Heylen, D. K. J. (2006a). Dialogue-act tagging using smart fea-

ture selection: Results on multiple corpora. Paper presented at the First International

IEEE Workshop on Spoken Language Technology, Palm Beach, FL.

Verbree, D., Rienks, R. J., & Heylen, D. K. J. (2006b). First steps towards the automatic con-

struction of argument-diagrams from real discussions.

Frontiers in Artificial Intelligence

and Applications

144:183–94.

Vergo, J. (1998). A statistical approach to multimodal natural language interaction. Paper

presented at the AAAI Workshop on Representations for multi-modal Human–Computer

Interaction, Madison, WI.

Verlinden, M., Zwitserlood, I., & Frowein, H. (2005). Multimedia with Animated Sign

Language for Deaf Learners. Paper presented at the World Conference on Educational

Multimedia, Hypermedia & Telecommunications, ED-MEDIA, Montre

al.

Vo, M. T. (1998). A Framework and Toolkit for the Construction of Multimodal Learning

Interfaces. PhD diss., Carnegie Mellon University.

Vo, M. T., & Wood, C. (1996). Building an application framework for speech and pen input

integration in multimodal learning interfaces. Paper presented at the 1996 IEEE Interna-

tional Conference on Acoustics, Speech, and Signal Processing, Atlanta.

Wahlster, W. (2006). Dialogue systems go multimodal: The SmartKom experience. In

Wahlster, W., ed.,

SmartKom: Foundations of Multimodal Dialogue Systems

. Berlin:

Springer, 3–27.

Wahlster, W., Andre, E., Finkler, W., Profitlich, H.-J., & Rist, T. (1993). Plan-based integra-

tion of natural language and graphics generation.

Artificial Intelligence

63:387–427.

Wainer, J., & Braga, D. P. (2001). Symgroup: Applying social agents in a group interaction

system. Paper presented at the 2001 International ACM SIGGROUP Conference on

Supporting Group Work, Boulder, CO.

Wang, J. (1995). Integration of eye-gaze, voice and manual response in multimodal user

interfaces. Paper presented at the 1995 IEEE International Conference on Systems, Man

and Cybernetics, Vancouver, BC.

Wang, K. (2004). From multimodal to natural interactions. Paper presented at the W3 Work-

shop on Multimodal Interaction. Position Paper. Available at

http://www.w3.org/2004/

02/mmi-workshop/wang-microsoft.html

Wang, S., & Demirdjian, D. (2005). Inferring body pose from speech content. Paper

presented at the 7th International Conference on Multimodal Interfaces.

Wickens, C. D., Sandry, D., & Vidulich, M. (1983). Compatibility and resource competition

between modalities of input, central processing, and output.

Human Factors

25(2):227–48.

References

443

Xiao, B., Girand, C., & Oviatt, S. L. (2002). Multimodal integration patterns in children.

Paper presented at the 7th International Conference on Spoken Language Processing,

Denver.

Xiao, B., Lunsford, R., Coulston, R., Wesson, R. M., & Oviatt, S. L. (2003). Modeling multi-

modal integration patterns and performance in seniors: Toward adaptive processing

of individual differences. Paper presented at the 5th International Conference on Multi-

modal Interfaces, Vancouver, BC.

Zancanaro, M., Lepri, B., & Pianesi, F. (2006). Automatic detection of group functional roles

in face to face interactions. Paper presented at the 8th International Conference on

Multimodal Interfaces, Banff, Alb.

Zhai, S., Morimoto, C. H., & Ihde, S. (1999). Manual and gaze input cascaded (MAGIC)

pointing. Paper presented at the 1999 SIGCHI Conference on Human Factors in Comput-

ing Systems, Pittsburgh.

Zoltan-Ford, E. (1991). How to get people to say and type what computers can understand.

International Journal of Man–Machine Studies

34(4):527–47.

12 Multimodal Interfaces: Combining Interfaces

444

Index

Accelerometers, 112–113

drift, 119

Food Simulator project, 294–295

Accessibility applications

auditory interfaces, 165–166

haptic interfaces, 46–51

IVR interfaces, 232–233

mobile applications, 413–415

multimode interfaces, 368–369, 386

olfactory interfaces, 282–283

small-screen interfaces, 321–322, 330–335

Accuracy

haptic position sensing, 62

multimode interfaces, 361–362

Acoustic models, 210–211

Action priority, in gesture interfaces, 98

Active-matrix displays, 312

Active movement, in haptic interface

design, 61

Actuation

haptic interfaces, 57–58

smell generation, 270

Adaptation

auditory environments and

displays, 188–189

multimodal interfaces, 427–428

olfactory interfaces, 284

Additive sound synthesis, 158–159

Address books, 366

Adduction, 91–92

Admittance control, 27

Adobe Audition tool, 242

Air cannons, 279–280, 282

Alesis 3630 compressor/limiter, 247

Alternative feedback, in small-screen

interfaces, 348

Alternative modalities, in multimodal

interfaces, 428

Americans with Disabilities Act, 387

AmiGram tool, 426

Amoore, J. E., 269

Animated characters, 399

Annotations, in multimodal interfaces, 426

Announcement voice, for IVR

interfaces, 240–241, 248, 262–263

Annoyance, sound, 163

Anvil tool, 426

Applied Voice Input Output Society

(AVIOS), 215

Arguments, for gesture interfaces, 96

Arm exoskeletons, 40–43

Aromas.

See

Olfactory interfaces

ARTHUR project, 96

Aspect ratios, 315

Attribution theory, 199–200

Audification, 149, 160

Audio-only games, 165

Auditory cues, in locomotion interfaces,

123

Auditory display systems (ADSs), 156–157

Auditory icons, 149, 160

Auditory interfaces, 8, 147–148, 161–162

accessibility, 165–166

advanced, 163–165

applications, 171–172

audification, 149, 160

case studies, 187

constraints, 170–171

cross-modal collaborative display,

180–182

data representation and processing,

157–158

Auditory interfaces (

Continued)

design guidelines, 182–187

dimensions, 153–154

display systems, 156–157, 159–161, 174–175,

177–182

drawbacks, 163

future trends, 187–189

human factors design, 167–177

human sensitivity, 151–153

implementations, 161–166

perceptual considerations, 154–156

requirements, 173–174, 182–183

sonification, 148–149, 161, 188

sound production, 176–177

sound properties, 150–151

sound synthesis, 158–159

symbolic/semantic

representations, 149–150, 175

task analysis, 167–170

testing, 177–182

Auditory overload, 163

Auditory senses, in locomotion, 111

Automated conversations, 198–199

design guidelines, 220–224

error handling, 202–208, 221–224

escape hatches, 224

personas, 200–202, 221

prompts, 201–208

terminology, 224

Automated self-help, 365–366

Automatic speech recognition (ASR), 208

Axel, R., 269

Background noise, 154–155

Baddeley, A. D., 420

Baecker, R., 334

Ballas, J. A., 178

Ballot debacle, 13

Bandwidth

sensory motor control, 35

sound, 152

Banking applications, 229, 232

Barbagli, F., 34

Barras, S., 182

Beaconless trackers, 119

Beacons, 117–119

Beat gestures, 85

Bekesy, G., 285

Bellik, Y., 413

Benchmarks, for gesture interfaces,

99–101

Bergamasco, M., 42

Bernard, M. L., 333

Binary menu choices, in IVR

interfaces, 251–252

BIP.

See

Break-in-presence events

Biting force

generations, 299–301

measurements, 297–299

Bitter taste, 291

BlackBerry Pearl, 319

Blattner, M., 185–186

Blending, in olfactory interfaces, 270,

272–277

Blindness

computer games for, 165

haptic interfaces for, 47–50

multimodal interfaces for, 413–414

Boiling point, of odor intensity, 283

Bolt, R. A., 394, 403

Bone vibration microphones, 293–295

Bottom-up VUI systems, 198

Bowers, J., 180–182

Bowman, D. A., 132

Boxing game, 5–6

Braille displays, 48, 414

Brain interfaces

brain–computer, 20–21

small-screen, 353

Breadth, of menus, 332–333

Break-in-presence (BIP) events, 134–135

Brewster, M., 183, 186

Brightness, in small-screen

interfaces, 307–308, 311

BþTree interfaces, 334

Buck, L., 269

Buffer unit generators, 159

Burger, D., 413

Butterfly ballot debacle, 13

Cameras, in small-screen interface

testing, 339–342

Canceling IVR interface actions, 249, 257

Capabilities

design for, 14–15

haptic interfaces, 60–61

locomotion interfaces, 137–138

Carbon fiber tubing, 35

Card sort techniques, 237

Cartesian joysticks, 38–39

Case studies

auditory interfaces, 187

gesture interfaces, 102

haptic interfaces, 64

Index

446

IVR interfaces, 264

locomotion interfaces, 139

multimodal interfaces, 430

multimode interfaces, 386

olfactory interfaces, 289

small-screen interfaces, 351

taste interfaces, 304

VUIs, 224

Cassell, J., 77, 85–86

Cater, J. P., 276

Cathode ray tubes (CRTs), 311

CAVE system, 121

Ceiling-mounted haptic interfaces, 41

Character size, in small-screen

interfaces, 326–327

Charter system, 401

Cheese, in biting force generation, 299–301

Chemical senses, 267–268, 296

Chen, J., 33–34

Chin, J. P., 333

Christian, K., 47–48

Classifications

computer vision interfaces, 78–79

gesture interface development, 102

Click wheels, 318

Cognitive factors

auditory interfaces, 178

locomotion interfaces, 133–134

multimodal interfaces, 416–420

Collaboration

auditory interfaces, 180–182

multimodal interfaces, 400–403, 431–432

Collapse-to-zoom technique, 338

Collars, scent, 278–279

Color perception, 310–311

Command gestures, 86

Commercial speech.

See

Voice user

interfaces (VUIs)

Common GUI elements, in small-screen

interfaces, 336–339

Communications assistants (CAs), 233

Compact scent generators, 271

Compass, 119

Complementarity

gesture interfaces, 97

multimodal interfaces, 417–418

Complex data, sonification of, 148–149

Compliance resolution, 33–34

Comprehension on small-screen interfaces,

336

Computational platforms, in sensory motor

control, 36

Computer vision interfaces, 78–79

Concentration, in odor intensity, 283

Concept design and models

auditory interfaces, 183–184

multimodal interfaces, 403–405

support for, 13

Concurrency

auditory interfaces, 185

multimode interfaces, 382

Cones, eye, 308

Confirming user input, in IVR interfaces, 260

Confusion, in multimode interfaces, 362

Conscious, bottom-up, gesture interface

development, 98

Consistency

design for, 15–16

IVR interfaces, 254–255

multimode interfaces, 383–384

Constraints, in auditory interface

design, 170–171

Contact area, in exoskeletons devices, 62

Contact microphone taps, 245–246

Context

auditory interfaces, 170, 175, 178

conversations, 198

gesture interfaces, 87, 95–96

multimodal interfaces, 429–430

Contrast, in small-screen interfaces, 308,

327–328

Control bandwidth, in sensory motor

control, 35

Control gestures, 86

Control, in haptic interfaces, 27

Converged multimode interfaces, 363

Conversational death spirals, 202

Conversations

automated.

See

Automated conversations

voice.

See

Voice user interfaces (VUIs)

Coordinate frames, in haptic interface

design, 62

Cordless phones, 245

Corneas, eye, 308

Corrupted data, in multimode interfaces, 362

Crackers, in biting force generation,

299–301

Critical feedback, in small-screen

interfaces, 348

Cross-adaptation, in olfactory interfaces, 284

Cross-modal display, in auditory

interfaces, 180–182

CUBRICON multimodal system, 395

Cultural issues, in gesture interfaces, 94

Index

447

Customer service representatives

(CSRs), 233–234

Cutaneous touch, 25

Cybersickness, 130–132, 136–137

CyberSphere, 125–126

Dance Dance Revolution game, 120, 122

Data accuracy, in multimode

interfaces, 361–362

Data analysis, in multimodal

interfaces, 425–426

Data collection and mining

auditory interfaces, 158, 179

IVR interfaces, 235–237, 263–264

multimodal interfaces, 423

Data glove, 78

Data polarity, of sound, 153–154

Data representation and processing, in

auditory interfaces, 157–158

Data requirements

haptic interfaces, 53–56

specifications, 56–58

Data transfer, in IVR interfaces, 247

Days of week collection, in IVR interfaces, 264

Deafness.

See also

Auditory interfaces

IVR interfaces for, 233

multimodal interfaces for, 414

Death spirals, conversational, 202

Degrees of freedom

Food Simulator project, 293–294

haptic interface devices, 36–38, 56

Deictic gestures, 85

Delays, in IVR interfaces, 259

Delta-sigma simulation, 276

Depth, of menus, 332–333

Descriptive labels, in gesture interfaces, 85–87

Descriptive menu options, in VUIs, 221

Design guidelines

auditory interfaces, 182–187

gesture interfaces, 94–98

haptic interfaces, 60–64

IVR interfaces, 247–264

locomotion interfaces, 137–139

multimodal interfaces, 426–430

multimode interfaces, 374–375, 377, 381–386

olfactory interfaces, 286–288

small-screen interfaces, 343–351

taste interfaces, 304

VUIs, 220–224

Design principles, 12

consistency, 15–16

error recovery, 17

feedback, 16–17

future, 18–23

simplicity, 17–18

user conceptual model and goals, 13

user knowledge, 14

user skills and capabilities, 14–15

Desktop, in auditory interface

accessibility, 165–166

Detail design, in auditory interfaces, 184–187

Detection threshold value, in olfactory

interfaces, 284

Dial-through, in IVR interfaces, 249–250

Dialog boxes, in small-screen interfaces, 337

Dialog design, 184

Dialog managers, in multimodal

interfaces, 405

Dialogs, directed, 217

Dictation systems, 214

Dictionaries, in speech recognition

systems, 210–211

Differential threshold value, in olfactory

interfaces, 284

Diffusers, in smell generation, 270, 273–275

Diffusivity, in odor intensity, 283

Digital audio players, 319

Digital paper-based interfaces, 411–413

Digital storage oscilloscopes (DSOs), 320

Dimensions, auditory, 153–154

Directed dialogs, 217

Direction, in locomotion interfaces, 108, 110

Disabilities

Braille displays, 48

computer games for, 165

IVR interfaces, 233

multimodal interfaces, 413–414

multimode interfaces, 380

Disambiguation

gesture interfaces, 97–98

multimodal interfaces, 392–393

Discourse markers, 223–224

Displays

auditory interfaces, 156–157, 159–161,

174–175, 177–182

locomotion interfaces, 121

small-screen interfaces, 312–314, 329–330

Disruptive interpretations, 428–429

Distinct menu options, in VUIs, 221

Distraction, in locomotion interfaces, 133–134

DMS100 system, 231

Document cameras, in small-screen interface

testing, 341–342

Dollars & Scents system, 274–275

Index

448

Dots per inch (DPI), in small-screen

interfaces, 314–315, 329

Dragon’s Lair, 21

Drift, 119

DS Lite, 320

Dual tone multifrequency (DTMF) keypads

IVR interfaces, 229–230, 238, 242, 246–247

small-screen interfaces, 316

Duchnicky, R. L., 336

Durlach, N. I., 31

Dynamic gestures, 86

Dynamic organization, of small-screen

space, 338

EarBender database, 182

Earcons, 149, 160

Early fusion, in multimodal interfaces, 404

Early prototyping, 177–178

Early testing, in multimode

interfaces, 377–378

Echoic memory, 155

Economics, in locomotion interfaces,

142–143

Effective designs, 12

Efficient designs, 12

small-screen interfaces, 350

Electrocardiogram (ECG) machines, 148

Electronic nose (e-nose), 286

Electronic paper (e-paper), 313

Elkerton, J., 336

Emblems, in gesture interfaces, 85

Emotion, auditory interfaces for, 162

Emotion Tool, 77

Environments

auditory interfaces, 170

haptic interfaces, 27–28

small-screen interfaces, 324

Equipment

IVR interface testing, 245–247

small-screen interfaces, 320–321

Equivalence, in gesture interfaces, 97

Ergonomics, in gesture interfaces, 91–93

Error handling and correction, 17

automated conversations, 202–208, 221–224

IVR interfaces, 238–239, 261

multimodal interfaces, 392–393, 428

small-screen interfaces, 347

Error spirals, 428

Ertan, S., 50

Escape hatches, in automated conversations,

224

eSign project, 414

Evaluating haptic interfaces, 59–60

Evaporation, in smell generation, 269

Exoskeletons, 40–43, 53–54, 62

Exploratory prototypes, 378

Extensible Markup Language (XML), 387

Extraneous information, in small-screen

interfaces, 344–345

Extreme delays, in IVR interfaces, 259

Eye position and tracking, in small-screen

interfaces, 323–324, 353

Eyes, 308

Face gaze and expression, 79

Face-mounted odor-emitting devices, 288

Facetop Tablet, 414–415

Facial expressions

gesture interfaces, 77

multimodal interfaces, 399

Facial gestures, 77

Familiarity of users, in auditory

interfaces, 167

Feature creep, 18

Features, in multimodal interfaces

fusion, 404

identification, 421–422

Feedback

design for, 16–17

gesture interfaces, 96–97

IVR interfaces, 259–260

kinesthetic, 52–57

locomotion interfaces, 116, 121–124

small-screen interfaces, 348–349

tactile, 52, 55–56, 58

Field Medic Information System, 397

Field-of-view (FOV), in locomotion

interfaces, 132

File management, in gesture interfaces, 90

Filtering sound, 153

Fingers, in gesture interfaces, 91–93

Firefighting simulators, 276, 278

Five-DOF arm exoskeletons, 42

Fixed temporal threshold, in multimodal

interfaces, 405

Flat displays, in locomotion interfaces, 121

Fleming, S. A., 110

Flexibility, in multimode interfaces, 387

Flexible OLED displays, 352

FlexiForce sensors, 297

Flight simulators, 123

Floor-mounted haptic interfaces, 41

Floor switches, for motion sensing, 120

Flowcharts, in IVR interfaces, 238–239

Index

449

Flying, in locomotion interfaces, 124, 132

Foley effects, 164

Fonts, for small-screen interfaces, 327–329

Food Simulator project, 292–293

biting force generation, 299–301

biting force measurements, 297–299

design guidelines, 304

future trends, 304–305

haptic interfaces, 293–294

multisensory display, 294–297

testing, 302–304

Foot-candles (ft-c), 308

Foot-Lamberts (ft-L), 308

Forbrig, P., 360, 374–375

Force

biting measurements, 297–299

Food Simulator project, 293

hand controllers, 36–37

haptic interface design, 61

sensory motor control, 33–34

Formal models, for multimodal interfaces, 422

Forms-based interfaces, 427

Four-DOF joysticks, 38

Freeman, W. T., 93

Frequency, sound, 150–152

Friction, in haptic interface design, 63

Fully integrated multimode interfaces, 363

Functional consistency, in IVR interfaces, 255

Functional labels, in gesture interfaces, 85–86

Functional prototypes, 245

Functionality, in small-screen interfaces, 344

Fusion, in multimodal interfaces, 403–404

Future trends

auditory interfaces, 187–189

design, 18–23

gesture interfaces, 103

haptic interfaces, 64–65

IVR interfaces, 264–265

locomotion interfaces, 141–143

multimodal interfaces, 430–432

multimode interfaces, 386–388

olfactory interfaces, 289

small-screen interfaces, 351–353

taste interfaces, 304–305

VUIs, 224–226

Gait reproduction, 128–129

Gaiter system, 128

Games, 5–6

audio in, 164–165

mobile, 320

Gantt charts, 401

Gas sensors, 286

Gaver, W. W., 185

Gaze interface, 353

Geiger counter example, 174

Geographic positioning systems (GPS), 166

Gesture interfaces, 5–7, 75–77, 102–103

applicability, 77, 79–80

computer vision interfaces, 78–79

context awareness, 95–96

cultural issues, 94

design guidelines, 94–98

ergonomics and intuitivity, 91–93

face gaze and expression, 79

feedback, 96–97

future, 103

heuristics and metaphors, 88–90

human factors design, 87–93

integration and disambiguation, 97–98

mechanical and tactile interfaces, 78

Midas touch, 94

multimodal interfaces, 399–400

nature, 80–81

process and benchmarks, 99–101

relation to other modes, 81–84, 97–98

sequencing, 94–95

taxonomies, 85–87

technical- vs. human-based gestures, 87–90

technology, 77

vocabulary, 98–102

Geven, A., 333

Global preferences, in multimode

interfaces, 385

Goals

design for, 13

locomotion interfaces, 137

Google Voice Local Search, 225

Grammars, in speech recognition

systems, 210–211

Graphical information, haptic access to,

48–49

Graphical user interfaces (GUIs), for small-

screen interfaces, 312, 336–339

Gravitational field, 119

Grice, H. P., 198

Grounding, in haptic interfaces, 57

Group behavior, multimodal

communication, 402–403

Groupings

auditory interfaces, 155

IVR interface data collection, 237

Guidance of user input, in multimodal

interfaces, 422

Index

450

Habitation, in olfactory interfaces, 284

Hajian, A., 34

Hale, K. S., 52

Hand–eye coordination tasks, 52

Hand masters, 42–44

Hands

gesture interfaces, 91–93

haptic interfaces, 36–37, 42–44

Handwriting recognition, 396

Haptic and Audio Virtual Environment

(HAVE), 48–49

Haptic interfaces, 4–5, 25–26, 56–58

accessibility applications, 46–51

case studies, 64

data requirements, 53–56

design guidelines, 60–64

Food Simulator project, 293–294

fundamentals, 26–28

future trends, 64–65

human factors design, 51–58

human perception, 30–32

human sensing, 28–30

implementations, 36–38

nonportable, 38–42

portable, 42–43

sensory motor control, 32–35

tactile, 43–46

technology, 35

testing, 58–60

Hardkeys, 318

Hardware

auditory interfaces, 156–157

haptic interfaces, 26–27

Harmony Remote mirrors, 321

Head directed systems, 124, 139

Head-mounted displays (HMDs), 121

Head-related transfer functions (HRTFs),

157

Headphones, in auditory interfaces,

156–157

Heads-up displays, 352

Hearing.