Input / Output devices, Input / Output devices, technologies and techniques technologies and techniques

SI3 – Master ISI : IHM02 2006/2007 1

Input / Output devices, Input / Output devices, technologies and techniques technologies and techniques

Diane Lingrand [email protected] http://www.polytech.unice.fr/~lingrand

SI3 – Master ISI : IHM02 2006/2007 2

Today's topic

Input / output devices

– mouse, keyboard, etc.

Taxonomies

Evaluation

Next time:

– displays

– About 3D space and more

Inputs / outputs

Input

– text (keyboard, handwritten)

– position (mouse, GPS, ...)

– audio (speech recognition)

Text entry

Handwritten

– totally free

– constrained

SI3 – Master ISI : IHM02 2006/2007 5

Graffiti, Calligrapher 8.3, xscribble

uni-stroke alphabet

SI3 – Master ISI : IHM02 2006/2007 6

Keyboard's layout

AZERTY, QWERTY, ..., Dvorak (1936).

Ergonomic keyboards Logical keyboard

Mackenzie and Zhang, CHI'99

Hunter, Zhai and Smith, CHI 2000

SI3 – Master ISI : IHM02 2006/2007 9

Games

SI3 – Master ISI : IHM02 2006/2007 10

Wearable computer

2005

Mobility

Twiddler

WristPC

SI3 – Master ISI : IHM02 2006/2007 13

Chord Keyboard: Microwriter (1980)

SI3 – Master ISI : IHM02 2006/2007 14

Another Chord Keyboards

BAT keyboard (Infogrip)

CyKey (Bellaire Electronics)

Keyboards for PDA Mobile phone

Example: Glyph (F. Poirier, Univ. Bretagne Sud)

SI3 – Master ISI : IHM02 2006/2007 17

Glyph alphabet

SI3 – Master ISI : IHM02 2006/2007 18

Motor handicap

limiting displacements

logical keyboard

Ex: KeyGlasses (M. Raynal, Univ. Toulouse)

Pointing devices

absolute / relative

– graphic tablet, touchscreen, optical pen

– mouse, joystick, trackball

Mouse

invented in 1967 by Douglas Engelbart and co.

« any device that is

SI3 – Master ISI : IHM02 2006/2007 21

touchscreen, camera mouse, eye mouse ...

touchpad

pointing stick

Alternative pointing devices

foot mouse

trackball

SI3 – Master ISI : IHM02 2006/2007 22

where :

MT is the average time taken to complete the movement.

a and b are empirical constants, and can be determined by fitting a straight line to measured data.

A is the distance from the starting point to the center of the target or amplitude of movement.

W is the width of the target measured along the axis of motion. W can also be thought of as the allowed error tolerance in the final position, since the final point of the motion must fall within ± W/2 of the target's centre.

Evaluation of pointing task:

Fitt's law (1954)

W A

Accot and Zhai Steering law (1997)

Extension to 2D space

Special case of path = straight tunnel of constant width W

Joystick

Axes (absolute value)

Buttons (up/down)

Hats (discrete value: up, right, ...)

Trackballs (relative 2D value)

SI3 – Master ISI : IHM02 2006/2007 25

Other ....

Mouth joystick « as a » joystick

Jouse2 (Infogrip)

SI3 – Master ISI : IHM02 2006/2007 26

Gaming

Joypad, ....

Eye - tracking

Method:

– Image Processing

– Cornea reflexion

Positionning

GPS

Wifi

RFID

SI3 – Master ISI : IHM02 2006/2007 29

Laval Virtuel, 2006

Use your imagination !

Gestaction 3D

SI3 – Master ISI : IHM02 2006/2007 30

Taxonomies

An exhaustive list is unusable

GKS: logical device

– Locator, Stroke, Valuator, Choice, Pick, String

1974-84 :Foley

– Select, Position, Orient, Ink, Text, Value

1983: Buxton

1991: Card, Mackinlay and Robertson

1984: Foley 1983: Buxton's Taxonomy

SI3 – Master ISI : IHM02 2006/2007 33

Card, MacKinlay

and Robertson

(1997)

SI3 – Master ISI : IHM02 2006/2007 34

Mackinlay's radio

VolumeKnob = <R_z, [0^o, 270^o], , I, [0^o, 270^o], {}>

= R_z : [0^o, 270^o] [0^o, 270^o] Volume = < InputDomain: [0, 25] decibels>

Connection composition:

Connect (VolumeKnob, Volume, f( deg) = C_v * decibels) VolumeKnob Volume

Layout composition:

VolumeKnobT1(x)SelectionKnobT2(x)StationKnobT3(x)

Merge composition:

GenericTablet_xy = Generic1DTablet_x X Generic1DTablet_y

Limitations

2D event (x;y) 2D event (x;y)

Ouputs

Audio

Visual

– screen / monitor

SI3 – Master ISI : IHM02 2006/2007 37

BCI: Brain Computer Interfaces

Non-invasive / Invasive

Paralysed people

– control of a robotic arm, ...

Blind people

– camera + electrodes in the visual cortex

SI3 – Master ISI : IHM02 2006/2007 38

Tools and libraries

Using different input devices:

– drivers

– libraries:

VRPN : Virtual Reality Peripheral Network

SDL (www.libsdl.org): Simple DirectMedia Layer

Speech recognition

Speech synthesis (TTS=text-to-speech)

– http://en.wikipedia.org/wiki/Speech_synthesis

Handwritten recognition

Gestures recognition

CHI at the Movie Theater

1968

2001 2002

2003

Bibliography

Ken Hinckley « The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications » , chapter 7, 2003, J.A.

Jacko and A. Sears editors.

J. Accot and Sh. Zhai « More than dotting the i's – Foundations for

crossing-based interfaces » CHI 2002

Bill Buxton: http://www.billbuxton.com