HOMECONTACTACCESS|LINK  JAPANESE


Research of Multi-Modal Human Interface

■Multi-Modal Mouse

  Since it became clear that there are effects, like movement becomes quick when there was not only vision but a tactile sense from research of feeling integration, it is expectable that introducing a tactile sense display into a computer interface has effects, such as increase in efficiency of operation and reduction of a visual burden. Then, the multi-modal mouse which contained the tactile sense display in the mouse which is the interface device of a graphic user interface (GUI) was developed.(Patent2)

  And the Pointin task experiment was conducted and the effect of tactile sense information was analyzed. Consequently, as that there is an effect of a tactile sense in shortening of click operation time, increase of the effective size of a target, etc., and additional information, it was shown compared with hearing and vision that a tactile sense is the most effective.
< br>

  About this research, joint research with MacKenzie of Canada and the department of Guelph university computer science is carried out.

  Since the multi-modal mouse contains the tactile sense display, the application as interface equipment for a visually impaired person is possible for it. Then, the system which presents the two-dimension-position information on cursor, target's (icon's) existence information, the approach information on a target, window information, etc. tactile is developed using a multi-modal mouse.

  A mouse is interface equipment for POINTINGU operation, and there is little flexibility of operation. Then, the effect of the tactile sense information in the object operation to which the 触力覚 display was built in hold, develop a mouse and using grip operation that the object in work space can be operated in grip operation is analyzed experimentally.

next>>






2002 Akamatsu Lab.