Kortum P. (ed.) HCI Beyond the GUI. Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces

Подождите немного. Документ загружается.

Acknowledgments

As with any such endeavor, there are many people who played an important role

in helping the project come to fruition. First, thanks to my friends and colleagues

who contributed to the book—without their dedicated efforts and expertise, this

book would not exist.

I would also like to thank my editors at Morgan Kaufmann, Denise Penrose,

Mary James, and Asma Palmeiro, for their unending patience in helping to make

this book a reality. Arnie Lund, Caroline Jarrett, Gavin Lew, Christine Alverado,

and Randolph Bias provided enormously helpful reviews, and the book is better

for their substantial and copious comments on the early versions. Finally, I would

like to thank Michael Riley, my first human factors professor at the University of

Nebraska, for sparking my love of human factors as a discipline.

Dedication

To Rebecca.

Preface

Contributors

Aaron Bangor, AT&T Laboratories, Austin, TX (bangor@labs.att.com)

Bangor is a principal member of technical staff at AT&T Labs, Inc., in Austin. He

has worked on a wide variety of user interface designs, including applications that

have multiple interfaces of different modalities. He earned a Ph.D. in human fac-

tors engineering from Virginia Tech and is a certified human factors professional.

Bangor serves on the Texas Governor’s Committee on People with Disabilities. He

is also active in the Human Factors and Ergonomics Society, including part editor

of the forthcoming American national standard:

Human Factors Engineering of

Software User Interfaces

. (Chapter 11)

Paulo Barthelmess, Adapx, Seattle, WA (Paulo.Barthelmess@naturalinteraction.

com)

Barthelmess is a research scientist working with collaboration technology at

Adapx. His research interests are in human-centered multimodal systems, explor-

ing intelligent interfaces to facilitate the work of co-located or distributed groups

of people. His current focus is on supporting collaborative document-centered

annotation work using digital paper. Barthelmess has an extensive software engi-

neering background, having worked in industry in many capacities for over 20

years. He received a Ph.D. in computer science from the University of Colorado

at Boulder. (Chapter 12)

Virginia Best, Boston University, Boston, MA (ginbest@cns.bu.edu)

Best studied medical science at the University of Sydney, and received her Ph.D.

in 2004 after specializing in human auditory spatial perception. She then worked

as a research associate at Boston University, where she examined the role of spa-

tial hearing in realistic multiple-source environments, and developed an interest

in how spatial hearing is affected by hearing impairment. In 2008, she will con-

tinue her work on hearing impairment as a research fellow at the University of

Sydney. (Chapter 2)

Jeff Brandt, AT&T Laboratories, Austin, TX (brandt@labs.att.com)

Brandt began his career with the AT&T Labs Human Factors Group in 1996,

ensuring that new products and services are useful to and usable by AT&T’s cus-

tomers. He manages the Austin Human Factors Laboratory facilities and performs

interface design and usability testing for Internet Protocol Television applications.

Past projects include disaster recovery, privacy management, outgoing call con-

trol, voice dial, unified communications, and bill formatting. Brandt holds 5

patents and has 43 patents pending. He earned the M.S. in industrial engineering

from the University of Washington and B.S. in cognitive/experimental psychology

from Oregon State University. (Chapter 7)

Derek Brock, Intelligent Systems Section, Navy Center for Applied Research

in Artificial Intelligence, U.S. Naval Research Laboratory, Washington, DC

(derek.brock@nrl.navy.mil)

Brock is a computer scientist at the U.S. Naval Research Laboratory’s Center for

Applied Research in Artificial Intelligence. His work involves the application of

auditory display, cognitive architectures, and models of human language use to

the design of collaborative interfaces for desktop, immersive, mobile, and robotic

systems. He holds B.S. and M.S. degrees in computer science and computer gra-

phics and multimedia systems from George Washington University. Brock is a

member of the Acoustical Society of America (ASA), Cognitive Science Society,

Association for the Advancement of Artificial Intelligence (AAAI), and Interna-

tional Community for Auditory Display (ICAD). (Chapter 5)

Christopher Frauenberger, Department of Computer Science, Queen Mary,

University of London, London, UK (frauenberger@dcs.qmul.ac.uk)

Frauenberger is a Ph.D. student in the Interaction Media Communication Group

at the Department of Computer Science, Queen Mary, University of London.

His research focuses on alternative modes of interacting with technology with a

special interest in the design of auditory displays. Since 2006, he is a member of

the board of the International Community for Auditory Display and contributes

toward establishing audio and sound as a highly efficient alternative for human–

computer interaction designers. (Chapter 5)

Erik Granum, Department of Media Technology and Engineering Science at

Aalborg University, Aalborg, Denmark (eg@vision.auc.dk)

Granum is a professor of information systems and head of the Department of

Media Technology and Engineering Science at Aalborg University, Denmark.

His interests cover pattern recognition, continually operating vision systems,

motion analysis, color vision, multimedia interfaces, visualization, virtual reality,

Contributors

xii

and creative use of media technology. He has been coordinator and partner of a

range of national and international research projects and networks in computer

vision, media technologies, and virtual reality. He was a major contributor in

the establishment of a multimedia and virtual reality center at Aalborg University,

and pursues interdisciplinary educations and research. (Chapter 3)

Abhishek Gupta, Rice University, Houston, TX (abhi@rice.edu)

Gupta received the bachelor of technology (honors) degree in mechanical engi-

neering from the Indian Institute of Technology, Kharagpur, and the M.S. degree

in mechanical engineering from Rice University in 2004, where he is currently a

doctoral student. His current research interests include design and control of hap-

tic interfaces, nanorobotic manipulation with haptic feedback, and robot-assisted

training and rehabilitation in virtual environments. (Chapter 2)

Thomas Hermann, Neuroinformatics Group, Faculty of Technology, Bielefeld

University, Bielefeld, Germany (thermann@techfak.uni-bielefeld.de)

Hermann studied physics and received a Ph.D. in computer science at Bielefeld

University in 2002. He is a research professor at Bielefeld University where he

launched the research on sonification. Hermann serves as member of the Interna-

tional Community for Auditory Display (ICAD) board of directors and is German

delegate and vice chair of the EU COST Action IC0601 (SID, sonic interaction

design). He is initiator and organizer of the International Workshop on Interactive

Sonification and guest editor of an

IEEE Multimedia

special issue on interaction

sonification. His research fields are sonification, data mining, and human–

computer interaction. (Chapter 5)

Susan L. Hura, SpeechUsability, Cumming, GA (susan.hura@speechusability.

com)

Hura is the founder of SpeechUsability, a consultancy focused on improving cus-

tomer experience by incorporating user-centered design practices in speech tech-

nology projects. She founded the usability program at Intervoice, and prior to that

worked a member of the human factors team at Lucent Technologies. As faculty

member at Purdue University, she cofounded a multidisciplinary team researching

novel approaches to speech recognition. Hura holds a Ph.D. in linguistics from the

University of Texas at Austin. She served as co-chair of SpeechTEK 2007 and 2008,

and is a member of the board of directors of AVIOS. (Chapter 6)

Hiroo Iwata, Graduate School of Systems and Information Engineering,

University of Tsukuba, Tsukuba, Japan (iwata@kz.tsukuba.ac.jp)

Iwata is a professor in the Graduate School of Systems and Information Engineer-

ing, University of Tsukuba. His research interests include haptic interfaces,

Contributors

xiii

locomotion interfaces, and spatially immersive displays. Iwata received the B.S.,

M.S., and Ph.D. degrees in engineering from the University of Tokyo. He is a found-

ing member of the Virtual Reality Society of Japan. (Chapter 9)

Philip Kortum, Rice University, Houston, TX (pkortum@rice.edu)

Kortum is currently a faculty member in the Department of Psychology at Rice

University in Houston. Prior to joining Rice, he worked for almost a decade at

SBC Laboratories (now AT&T Laboratories) doing human factors research and

development in all areas of telecommunications. Kortum continues to do work

in the research and development of user-centric systems in both the visual (web

design, equipment design, and image compression) and auditory domains (tele-

phony operations and interactive voice response systems). He received his

Ph.D. from the University of Texas at Austin. (Chapter 1)

Marcia O’Malley, Rice University, Houston, TX (omalleym@rice.edu)

O’Malley received the B.S. degree in mechanical engineering from Purdue Univer-

sity, and the M.S. and Ph.D. degrees in mechanical engineering from Vanderbilt

University. Her current research interests include nanorobotic manipulation with

haptic feedback, haptic feedback and shared control between robotic devices and

their human users for training and rehabilitation in virtual environments, and

educational haptics. She is co-chair of the ASME Dynamic Systems and Controls

Division Robotics Technical Committee, and a member of the IEEE Technical

Committee on Haptics. (Chapter 2)

Chris Masterton, Optimal Interfaces, Cary, NC (chris@optimalinterfaces.com)

Masterton has been a practicing interaction designer and usability specialist for

more than 8 years. His broad user interface design experience includes large

e-commerce websites for clients like IBM and Lloyds of London; interactive sites

for Tribal DDB, Tourism British Columbia, Ontario Tourism; mobile phone inter-

face design for Nokia and Motorola; and usability testing for DirectTV, Clorox,

Intrawest, and the University of Minnesota, among others. In 1997, Chris achieved

his bachelor’s degree in cognitive science with a certificate in computing science

from Simon Fraser University. For the past 7 years, Chris has also been the

instructor for user interface design at the University of British Columbia’s soft-

ware engineering continuing studies program. (Chapter 10)

Dan Mauney, HumanCentric, Vancouver, BC, Canada (dmauney@

humancentrictech.com)

Mauney is a 14-year veteran in the wireless telecommunications human factors

profession. He has developed a broad view and understanding of the wireless

Contributors

xiv

telecommunications market by working directly for a major North American wire-

less operator (SBC Wireless, now AT&T), a major handset manufacturer (Nokia), a

content provider (Mobileum), a wireless accessory manufacturer (Jabra Corpora-

tion), and currently for a service provider specializing in the wireless telecommu-

nications field (HumanCentric Technologies). At HumanCentric Technologies,

Mauney leads a team of human factors professionals specializing in helping cli-

ents with small screen design and evaluation. He holds a Ph.D. and M.S. in

industrial en gineering and human fac tors from Virginia Tech. (Chapter 10 )

James T. Miller, AT&T Laboratories, Austin, TX (miller@labs.att.com)

Miller is a principal member of the Technical Staff at AT&T Labs, Inc. He is pri-

marily responsible for the development, testing, and evaluation of web pages that

present consumer and business products for sale and that provide online support

for those products. In addition, he is also responsible for the development of inter-

active voice response systems, including some that use speech recognition. Miller

earned his Ph.D. from the University of Colorado at Boulder. (Chapter 11)

Thomas B. Moeslund, Laboratory of Computer Vision and Media Technology,

Aalborg University, Aalborg, Denmark (tbm@cvmt.dk)

Moeslund is an associate professor at the Computer Vision and Media Technology

lab at Aalborg University, Denmark. He obtained his M.S. and Ph.D. degrees in

1996 and 2003, respectively, both from Aalborg University. He is actively involved

in both national and international research projects, and is currently coordinating

a national project and work package leader in an international project. His pri-

mary research interests include visual motion analysis, pattern recognition, inter-

active systems, computer graphics, multimodal systems, and machine vision.

Moeslund has more than 70 publications in these areas. (Chapter 3)

John Neuhoff, Department of Psychology, The College of Wooster, Wooster, OH

(jneuhoff@wooster.edu)

Neuhoff is a member of the board of directors for the International Community

for Auditory Display (ICAD). He plays the saxophone and teaches auditory display

and cognitive science at The College of Wooster. His work has been published in

Nature

Science

, the

Proceedings of the National Academies of Science

, and he has

edited a book on ecological psychoacoustics. He has received grants from the

National Science Foundation, and the National Institute for Occupational Safety

and Health. His saxophone career has yet to blossom. (Chapter 5)

Michael Nielsen, Laboratory of Computer Vision and Media Technology, Aalborg

University, Aalborg, Denmark (mnielsen@cvmt.dk)

Contributors

Nielsen is an assistant professor in the study of media at Aalborg University. His

Ph.D. thesis was focused on three-dimensional reconstruction-based sensors in

precision agriculture, and he has also worked with gesture interfaces and shadow

segmentation. Research interests include aspects of media technology such as

interface design, games, camera-based interfaces, color and light theory, and

shadow segmentation. (Chapter 3)

Sharon Oviatt, Adapx, Seattle, WA (sharon.oviatt@adapx.com)

Oviatt is a distinguished scientist at Adapx and president of Incaa Designs. Her

research focuses on human-centered interface design and cognitive modeling,

communication technologies, spoken language, pen-based and multimodal inter-

faces, and mobile and educational interfaces. She has published over 120 scientific

articles in a wide range of venues, including work featured in recent special issues

Communications of the ACM

Human–Computer Interaction

Transactions on

Human–Computer Interaction

IEEE Multimedia

Proceedings of IEEE

, and

IEEE

Transactions on Neural Networks

. She was founding chair of the advisory board

for the International Conference on Multimodal Interfaces and General Chair of

the ICMI Conference in 2003. In 2000, she was the recipient of a National Science

Foundation Creativity Award for pioneering work on mobile multimodal inter-

faces. (Chapter 12)

S. Camille Peres, Psychology Department, University of Houston-Clear Lake,

Houston, TX (peresSC@uhcl.edu)

Peres is currently an assistant professor in psychology at the University of

Houston-Clear Lake. Her research is generally focused on the cognitive mechan-

isms associated with the acquisition of new skills, and specifically mechanisms

associated with acquisition and use of efficient methods, optimal designs for inter-

active auditory displays, and incorporation of simulations in the teaching of statis-

tics. Peres received her Ph.D. in psychology from Rice University with a focus on

human–computer interaction. (Chapter 5)

Sharif Razzaque, Computer Science, University of North Carolina, Chapel Hill,

NC (sharif@cs.unc.edu)

Razzaque is a research scientist for InnerOptic Technology, where he develops

augmented-reality surgical tools for solving spatial coordination problems faced

during surgery. He received his Ph.D. in computer science at the University of

North Carolina at Chapel Hill for work in virtual environment locomotion inter-

faces. He has previously worked on haptic interfaces, physiological monitoring,

Contributors

xvi

medical imaging, collaborative satellite–engineering tool development at Lock-

heed Martin, and cochlear implants at the University of Michigan. (Chapter 4)

Barbara Shinn-Cunningham, Departments of Cognitive and Neural Systems and

Biomedical Engineering, Director of CNS Graduate Studies, Boston University,

Boston, MA (shinn@cns.bu.edu)

Shinn-Cunningham is an associate professor in cognitive and neural Systems

and biomedical engineering at Boston University. Her research explores spatial

hearing, auditory attention, auditory object formation, effects of reverberant

energy on sound localization and intelligibility, perceptual plasticity, and other

aspects of auditory perception in complex listening situations. Shinn-Cunningham

is also engaged in collaborative studies exploring physiological correlates of audi-

tory perception. She received the M.S. and Ph.D. in electrical engineering and

computer science from the Massachusetts Institute of Technology. (Chapter 5)

Tony Stockman, Department of Computer Science, University of London,

London, UK (tonys@dcs.qmul.ac.uk)

Stockman is a senior lecturer at Queen Mary, University of London, and a board

member of the International Community for Auditory Display (ICAD). He first

employed data sonification to assist in the analysis of physiological signals during

his doctoral research in the mid-1980s. He has over 30 years of experience as a

consultant and user of assistive technology and has published over 30 papers on

auditory displays and data sonification. (Chapter 5)

Moritz Sto

rring, ICOS Vision Systems, Belgium (moritz.sto

rring@icos.be)

Sto

rring studied electrical engineering at the Technical University of Berlin, and at

the Institut National Polytechnique de Grenoble, France, and received the PhD

from Aalborg University, Denmark. As an associate professor at Aalborg Univer-

sity, his research interests included physics-based color vision, outdoor computer

vision, vision-based human–computer interaction, and augmented reality. In

2006, Sto

rring moved to industry where he is focused on automatic visual inspec-

tion of electronic components and intellectual property rights IPR. (Chapter 3)

Louise Valgerður Nickerson, Department of Computer Science, Queen Mary,

University of London, London, UK (lou@dcs.qmul.ac.uk)

Valgerður Nickerson is a Ph.D. student at Queen Mary, University of London, in

the Department of Computer Science. Her work focuses on developing auditory

overviews using nonspeech sound for the visually impaired and for mobile and

wearable computing. She holds a B.A. in French and Italian Language and

Contributors

xvii

Literature from the University of Virginia, and a M.S. in advanced methods in

computer science from Queen Mary. (Chapter 5)

Mary C. Whitton, Computer Science, University of North Carolina, Chapel Hill,

NC (whitton@cs.unc.edu)

Whitton is a research associate professor in the Department of Computer Science,

University of North Carolina at Chapel Hill. She has been working in high-

performance graphics, visualization, and virtual environments since she cofounded

the first of her two entrepreneurial ventures in 1978. At UNC since 1994, Whitton’s

research focuses on what makes virtual environment systems effective and on

developing techniques to make them more effective when used in applications

such as simulation, training, and rehabilitation. She earned M.S. degrees in guidance

and personnel services (1974) and electrical engineering (1984) from North Carolina

State University. (Chapter 4)

Yasuyuki Yanagida, Department of Information Engineering, Faculty of Science

and Technology, Meijo University, Nagoya, Japan (yanagida@ccmfs.meijo-

u.ac.jp)

Yanagida is a professor in the Department of Information Engineering, Faculty of

Science and Technology, Meijo University. He received his Ph.D. in mathematical

engineering and information physics from the University of Tokyo. Yanagida was

a research associate at the University of Tokyo and a researcher at Advanced

Telecommunication Research Institute International before he moved to Meijo

University. His research interests include virtual reality, telexistence, and display

technologies for various sensory modalities. (Chapter 8)

Contributors

xviii

CHAPTER

Introduction to the Human Factors

of Nontraditional Interfaces

Philip Kortum

1.1

STRUCTURE OF THE BOOK

As human factors professionals, we are trained in the art of interface design.

However, more and more of that training has centered on computer interfaces.

More specifically, it has focused on the graphical user interfaces (GUIs) that have

become ubiquitous since the advent of the computer.

While the GUI remains the most common interface today, a host of other

interfaces are becoming increasingly prevalent.

HCI Beyond the GUI

describes

the human factors of these nontraditional interfaces. Of course, the definition of

a “nontraditional” interface is rather arbitrary. For this book, I attempted to select

interfaces that covered all of the human senses, and included nontraditional inter-

faces that are widely used, as well as those that are somewhat (if not totally)

neglected in most mainstream education programs. Many of these interfaces will

evoke a strong “wow” factor (e.g., taste interfaces) since they are very rare, and

commercial applications are not generally available. Others, such as interactive

voice response interfaces, may not seem as exciting, but they are incredibly

important because they are widely deployed, and generally very poorly designed,

and it is likely that every human factors professional will be asked to work on one

of these during the course of her career. This book brings together the state of the

art in human factors design and testing of 11 major nontraditional interfaces, and

presents the information in a way that will allow readers who have limited famil-

iarity with these interfaces to learn the fundamentals and see how they are put

into action in the real world.

Each chapter in the book is structured similarly, covering the most important

information required to design, build, and test these interfaces. Specifically, each

chapter will address the following aspects.