CMU

Storytelling Cubes V2

Storytelling Cubes V2

Developing active cubes representing underlying structure

Sheng Kai Tang, Mark D Gross
Computational Design Program, CMU
Ellen Yi-Luen Do
ACME Lab, Georgia Tech

Introduction

Storytelling is a very critical activity for children, either as a listener or a teller, in terms of development of narrative skills and realization of the world. Generally, by 3 years old, children are gradually skilled at labeling items and further realizing relations among them. These skills are rudiments for advanced storytelling activity later. Proper assistance and guidance including story books and caregivers are required for the precedent achievements.

For the goal of this research, we seek to provide a computationally enhanced tool to assist storytelling behavior. Specifically, we aim at assisting children’s behaviors of labeling and correlating before 3 years old which are critical abilities and moment for their future development. We develop a set of tangible cubes, named Storytelling Cubes (SC), which can physically represent underlying structure of story characters, actively monitor children’s behaviors/choices, continuously evaluate their progresses and dynamically modify based on their progress. SC is both an assistant tool for storytelling and an experimental instrument for studying children’s learning behavior.


Adaptive Mouse

Adaptive Mouse

Toward a discovery of formal and functional adaptabilities

Sheng Kai Tang
User Experience Design, ASUS
Computational Design Program, CMU

Introduction

Adaptive Mouse (AM) consists of a smart material which is deformable and is capable of recognizing the deformation. The deformation provides perfect and comfortable ergonomic shape for users’ diverse hand gestures. The smart material itself could also dynamically activate any areas at will for conventional buttons and scroll wheel. The prediction of active areas is based on the recognition results of users’ hand gestures. Working with AM, all users have to do is to hold it with his/her comfortable and preferred hand gestures, then acting their fore and middle fingers intuitively will always correctly trigger related button functions. Users can also freely move the mouse and always get cursor feedbacks accurately.

Publication

Tang, S.K. and Tang, W. Y.: 2010, Adaptive Mouse: A Computer Mouse Achieving Form-Function Synchronization. In Proceeding of CHI 2010, p2785-2792.

Adaptive Camera

Adaptive Camera

Compensating for the disappeared formal implication by functional adaptability

Sheng Kai Tang
Computational Design Program, CMU

Introduction

Adaptive Camera is discovering the idea that whether it is possible to compensate the elimination of formal implications for flexible operation by providing functional adaptability. In detail, I am going to create a digital camera which has no elements of implications at all such as a rigid shutter button and a boxlike appearance. However, with functional adaptability users could still use this camera intuitive as normal. The button of this camera will be automatically assigned and the orientation of the camera scene will be calibrated as well based on how users hold it.


Hemisphere

Hemisphere

Hemisphere

Proximity Sensor Based Gesture Recognition For Social Robot Interaction

Sheng Kai Tang
Computational Design Program, CMU

Introduction

Robot control is a popular issue in robotics field. More and more researchers dedicate in developing easy and intuitive solutions for robot programming and control. The most popular approach is to recognize human’s gestures through computer vision applications. However, these computer vision based recognitions are limited by camera. In other words, the user should face a camera and keep in a specific distance in order for the computer vision application to capture clear images. Our idea is to provide user a mobil device which can also recognize user’s gesture command. Through this device, user can freely move in a space and give commands to a robot at the same time.

Documentation

Tang, S.K.: 2007, Hemisphere: An Intuitive Tangible User Interface for Controlling Domestic Robot, Final Report for “Computational Beauty of Nature” offered by Prof. Ramesh Krishnamurti.

Video

 


A Touch Free Microwave Door

A Touch Free Microwave Door

Sheng Kai Tang
Computational Design Program, CMU

Introduction

After studying 12 user’s behaviors of using a microwave oven through Contexual Inquiry Method, we finally figure out that a touch free interface is needed due to oily hands of users which always interrupt the cooking process. For clean and safty reasons, we create this touch free interface for users to test again. After comparing with previous ordinary microwave door, our touch free door does improve the usability of a microwave oven.


Co-Music Room

Co-Music Room

Co-Music Room

A Computational Enhanced Space For Children

Sheng Kai Tang, Tsung Hsien Wang, Yu Chang Hu
COmputational DEsign Lab, CMU

Introduction

Co-Music room is a music space designed for children to explore the music through collaborating with each other. The original idea is to allow children to play the music and experience the corporations though the process. This space, an 8×8 cube, consists of two fundamental components that are circular tile sensors on the floor and ball-shape sensors hanging on the ceiling. Both these two parts are utilized to activate the sound in this space, including music pitches and short tunes. Basically, each circular tile sensor in this demonstration is set up for one single music pitch and we have 7 different dimensional tile sensors in this stage. The other five ceiling ball sensors are regarded as the switches for background music tunes.

Publication

Tang, S.K., Wang, T.H. and Hu, Y.C.: 2006, Co-Music Room, Final Document for “Architectural Robotics” offered by Prof. Mark D. Gross.

Video

 
 

Storytelling Cubes

Storytelling Cubes

Storytelling Cubes

A Tangible User Interface For Children

Sheng Kai Tang, Ellen Do, Mark D. Gross
COmputational DEsign Lab, CMU

Introduction

Storytelling Cubes, unlike other open ended storytelling systems giving children unlimited capacity of extension to create unlimited stories, enable children to discover as many as possible combinations by means of providing a limited set of cubes where elements and underlying structures of stories are embedded. Storytelling Cubes also enhance children’s learning experiences by a set of wireless tangible devices connecting to an animated graphical system. By playing with Storytelling Cubes, we tend to enable children to observe the relations, similarities and differences between elements, stories and ideas. Furthermore, children are anticipated to create their own idea from those learned story structures or elements. It is not only a way for children to perceive ideas but also training for them to cultivate their creativity.

Publication

Tang, S.K., Do, E. and Gross, M.D.: 2005, Storytelling Cubes: A Tangible Interface for Playing a Story, A poster for HCII 12th Anniversary Celebration.


Tangible User Interface For Modelling

Tangible User Interface For Modelling

Tangible User Interface For Modelling

Wen Yan Tang, Sheng Kai Tang
Kun Shan University of Technology

Introduction

Recently, more and more researchers dedicated in the development of human computer interaction for CAD systems, such as gestural input of three dimensional coordinates, flexible manipulation of NURBS objects, and the creation of force feedback. These research results indicated that the more intuitive control the device can provide in modeling process, the more creative solutions can be generated. Based on what mention above, the problems of this research are that what kind of interactions with computer is necessary for designer while modeling? How to develop an intuitive modeling interface that fulfills the criteria generated by previous question? The objective of this research is to develop a tactile modeling interface by which designer could create three dimensional models as freely as playing with clay.

Publication

Tang, W.Y. and Tang, S.K.: 2006, A development of tactile modeling interface, In Proceedings of The Eleventh Conference on Computer Aided Architectural Design Research in Asia 2006. Conference Poster Link.