Controlling the electronic equipment by using arm-pointing gesture
The user controls electric equipment such as a TV, a nursing bed, a CD player,
and a heater by using arm-pointing gestures.
We developed an interface that controls the menu by swinging the arm as if using a joystick.
We also installed face recognition for personal identification.
For gesture recognition, the system utilizes horizontal arm direction and height of the arm.
The system records the initial direction and height when the target is decided.
The system calculates the arm movement based on the initial arm position.
Each piece of equipment has several functions. For example, the TV has three basic functions: turning on/off the power, changing the channels, and turning up/down the volume. Swinging of the arm up or down changes the function, and swinging of the arm to the right or left executes each function.
Each piece of equipment has several functions. For example, the TV has three basic functions: turning on/off the power, changing the channels, and turning up/down the volume. Swinging of the arm up or down changes the function, and swinging of the arm to the right or left executes each function.
An example of manipulating the TV
1. The user points his arm at the TV to turn on the power. 2. After the trigger time of about 1 second, the system chooses the TV as the operation target, records the initial direction of the arm (DoA), and turns on the TV. 3. The user moves his arm to the right (left) to change the channel. 4. The system detects the gesture by comparing it with the initial DoA and changes to the next higher (lower) channel of the TV. 5. During the user keeps his arm to the right (or left), the system changes the channels continuously. 6. If the user moves his arm down or up, the system changes the function. The turning up/down the volume of the TV is selected. 7. The user moves his arm to the right (or left), the system detects it, and the system turns up (or down) the volume. 8. If the user finished the arm-pointing gesture, the system finishes the operational mode when arm pointing is not detected during a fixed time (about 2.5 seconds).
If the system identifies the user, it automatically chooses the channel that the user frequently watches when the TV is turned on.
DEMO MOVIE
Controlling the TV by using arm-pointing gesture. (the first half)
Controlling the TV by using arm-pointing gesture. (the second half)
[ Back to Foundations&Applications | Top]
Copyright© National Institute of Advanced Industrial Science and Technology (AIST). All rights reserved