Welcome to Pengyu Hong's Homepage

Simon Says

A technique for posture and gesture modeling and recognition in real-time, interactive environments. The gesture model is represented by a Finite State Machine (FSM). The 2D locations of the head and both hands are tracked by three robust color trackers. The technique has been successfully tested on a set of postures and gestures, e.g., raise left hand, waving left hand, waving right hand, drawing a circle, drawing a figure eight, etc. We applied the proposed technique to build an experimental system that allows the user to play a real-time game of "Simon Says" with the computer. Using Microsoft VC++ 6.0 on WinNT 4.0. This was a summer internship project at Microsoft Research Lab, where I worked with Dr. Matthew Turk when he was there in 1999.

Simon says: Raise your right hand

References:

Constructing Finite State Machines for Fast Gesture Recognition. Pengyu Hong, Matthew Turk, Thomas S. Huang. 15th International Conference on Pattern Recognition, Barcelona, Spain, Sep 3-7, 2000. [pdf].

Gesture Modeling and Recognition Using Finite State Machines. Pengyu Hong, Matthew Turk, Thomas S. Huang. The 4th IEEE InternationalConference on Automatic Face and Gesture Recognition, March 28-30, 2000, Grenoble, France.