\b\fs48 \cf0 RESEARCH PROJECTS\
\pard\pardeftab720\sa240
\b0\fs24 \cf0 \
\pard\pardeftab720\sa298
\b\fs36 \cf0 Gesture\
\pard\tx220\tx720\pardeftab720\li720\fi-720
\ls2\ilvl0
\b0\fs24 \cf2 {\listtext \'95 }{\field{\*\fldinst{HYPERLINK "file:///afs/csail.mit.edu/group/mug/www/data/projects/handbody"}}{\fldrslt
\f1 \cf0
\f0 \cf2 \ul \ulc2
\b\fs28 Gesture Interaction with Unmanned Vehicles}}
\b\fs28 \cf0 \uc0\u8232
\fs20 Project Lead: {\field{\*\fldinst{HYPERLINK "http://people.csail.mit.edu/yalesong/"}}{\fldrslt \cf2 \ul \ulc2 Yale Song}}\uc0\u8232
\b0\fs24 This project explores gesture-based interaction between humans and unmanned vehicles on the aircraft carrier deck environment. Based on estimated hand and body poses, the objective is to extract meaningful gestures from a sequence of camera captured image frames. \
\ls2\ilvl0\cf2 {\listtext \'95 }{\field{\*\fldinst{HYPERLINK "file:///afs/csail.mit.edu/group/mug/www/data/projects/tabletop"}}{\fldrslt
\f1 \cf0
\f0 \cf2 \ul \ulc2 }}{\field{\*\fldinst{HYPERLINK "file:///afs/csail.mit.edu/group/mug/www/data/projects/tabletop-kinect"}}{\fldrslt
\b\fs28 \ul Bare Hand Continuous Gesture Analysis for Natural Multimodal Interaction}}
\b\fs28 \cf0 \uc0\u8232
\fs20 Project Lead: {\field{\*\fldinst{HYPERLINK "http://people.csail.mit.edu/yingyin/"}}{\fldrslt \cf2 \ul \ulc2 Ying Yin}}\uc0\u8232
\b0\fs24 In this project, we are developing a real-time 3D hand gesture recognition system for large display (horizontal or vertical) interaction. Using a Kinect, we are able to track the fingertips of bare hands in real-time. The gesture-based interactive interface allows users to do both path and pose gestures seamlessly, and responds to continuous and discrete flow gestures promptly and appropriately. \
\pard\tx220\tx720\pardeftab720\li720\fi-720\sa280
\ls3\ilvl0
\b\fs28 \cf0 {\listtext \'95 }Completed Projects
\b0\fs24 \
\pard\tx220\tx720\pardeftab720\li720\fi-720
\ls3\ilvl0\cf2 {\listtext \'95 }{\field{\*\fldinst{HYPERLINK "file:///afs/csail.mit.edu/group/mug/www/data/projects/tabletop"}}{\fldrslt \ul Real-time Continous Hand Gesture on a Tabletop}}\cf0 : Gesture recognition with a colored glove and a commercial webcam.\
\pard\pardeftab720\sa298
\b\fs36 \cf0 Sketch\
\pard\tx220\tx720\pardeftab720\li720\fi-720
\ls4\ilvl0
\b0\fs24 \cf2 {\listtext \'95 }{\field{\*\fldinst{HYPERLINK "file:///afs/csail.mit.edu/group/mug/www/data/projects/chemink"}}{\fldrslt
\f1 \cf0
\f0 \cf2 \ul \ulc2
\b\fs28 ChemInk}}
\b\fs28 \cf0 \uc0\u8232
\fs20 Project Lead: {\field{\*\fldinst{HYPERLINK "http://people.csail.mit.edu/ouyang/"}}{\fldrslt \cf2 \ul \ulc2 Tom Ouyang}}\uc0\u8232
\b0\fs24 ChemInk is a new sketch recognition framework for chemical structure drawings that combines multiple levels of visual features using a jointly trained conditional random field. The result is a recognizer that is better able to handle the wide range of drawing styles found in messy freehand sketches. A preliminary user study also showed that participants were on average over twice as fast using our sketch-based system compared to ChemDraw, a popular CAD-based tool for authoring chemical diagrams. \
\ls4\ilvl0\cf2 {\listtext \'95 }{\field{\*\fldinst{HYPERLINK "file:///afs/csail.mit.edu/group/mug/www/data/projects/physink"}}{\fldrslt
\f1 \cf0
\f0 \cf2 \ul \ulc2
\b\fs28 PhysInk}}
\b\fs28 \cf0 \uc0\u8232
\fs20 Project Lead: {\field{\*\fldinst{HYPERLINK "http://people.csail.mit.edu/jscott/"}}{\fldrslt \cf2 \ul \ulc2 Jeremy Scott}}\uc0\u8232
\b0\fs24 PhysInk is a physics-enabled sketching app for tablets and digital whiteboards that lets you quickly create animations of physical structure and behavior. You can sketch a device's parts in 2D, then move these parts to demonstrate the device's behavior. PhysInk understands 2D physics with the help of the {\field{\*\fldinst{HYPERLINK "http://box2d.org/"}}{\fldrslt \cf2 \ul \ulc2 Box2D physics engine}}. It also understands causality, so it can generate a simulation of your device in action. \
\ls4\ilvl0\cf2 {\listtext \'95 }{\field{\*\fldinst{HYPERLINK "http://rationale.csail.mit.edu/clocksketch"}}{\fldrslt
\f1 \cf0
\f0 \cf2 \ul \ulc2
\b\fs28 Digital Clock Drawing Test}}
\b\fs28 \cf0 \uc0\u8232
\fs20 Project Lead: {\field{\*\fldinst{HYPERLINK "http://people.csail.mit.edu/davis/"}}{\fldrslt \cf2 \ul \ulc2 Randall Davis}}\uc0\u8232
\b0\fs24 \
\pard\tx220\tx720\pardeftab720\li720\fi-720\sa280
\ls5\ilvl0
\b\fs28 \cf0 {\listtext \'95 }Completed Projects
\b0\fs24 \
\pard\tx220\tx720\pardeftab720\li720\fi-720
\ls5\ilvl0\cf2 {\listtext \'95 }{\field{\*\fldinst{HYPERLINK "file:///afs/csail.mit.edu/group/mug/www/data/projects/assist"}}{\fldrslt \ul ASSIST}}\cf0 : A Shrewd Sketch Interpretation and Simulation Tool\
\pard\pardeftab720\sa298
\b\fs36 \cf0 Multimodal\
\pard\tx220\tx720\pardeftab720\li720\fi-720
\ls6\ilvl0
\b0\fs24 \cf2 {\listtext \'95 }{\field{\*\fldinst{HYPERLINK "file:///afs/csail.mit.edu/group/mug/www/data/projects/sketchprog"}}{\fldrslt
\f1 \cf0
\f0 \cf2 \ul \ulc2
\b\fs28 Sketch Programming}}
\b\fs28 \cf0 \uc0\u8232
\fs20 Project Lead: {\field{\*\fldinst{HYPERLINK "http://people.csail.mit.edu/acorrea/"}}{\fldrslt \cf2 \ul \ulc2 Andrew Correa}}\uc0\u8232
\b0\fs24 In this project we are building a sketch-and-speech prototyping tool that translates programmers' high-level graphical insights to low-level code, avoiding an otherwise lengthy and error-prone coding process. \
\pard\pardeftab720 -->
