Discovering Intuitive Gestures for Smart TV Control Based on Depth Camera Technology

Institute of Information Industry and Sheng Kai Tang


Do you think waving your hands in the air to switch channels of TV is a good idea?  Actually, the body gestures for TV games using large muscle motors are good for exercising but are not proper for controlling. So, we develop the idea of mindSet, including Plane-based, Vision-based and Affordance-based gestures. mindSet using small muscle motors not only reveals intuitive gestures, but also implements these gestures based on popular depth camera system, Kinect. According to our testing of mindSet, users are able to successfully execute commands via gestures in a shorter time and with more comfortable feelings than that of convention ways.