0.25
0.5
0.75
1.25
1.5
1.75
2
The Future of Natural User Interface
Published on Sep 18, 20124514 Views
Natural user interaction devices such as Microsoft Kinect create tremendous excitements and opportunities for researchers and technologists in multimedia computing. Despite commercial success of th
Related categories
Chapter list
The Future of Natural User Interaction00:00
Kinect from Insiders’ Perspective (1)00:54
Video: An interview with Kinect contributors01:00
Kinect from Insiders’ Perspective (2)04:58
Core Technologies & Problems06:20
Kinect, You and Your Avatar (1)06:40
Kinect, You and Your Avatar (2)06:45
Kinect, You and Your Avatar (3)06:53
Core Technologies07:06
Tracking07:23
Kinect Identity (identity tracking)07:30
Kinect Identity08:05
Solution?08:55
Body dimension10:19
Challenges and our solution10:55
Video: Kinect Identity 11:31
Tracking Head Pose (head orientation)14:34
From image to pose – and only pose!15:12
Training Kinect to track head pose16:24
Head MoCap Data (1)16:45
Head MoCap Data (2)16:52
Head MoCap Data (3)17:05
Manifold embedding by Multi-class LDA (2)17:15
Head Pose Tracking18:01
Facial Feature Tracking18:16
Video: Avatar Kinect19:55
Research Issues (1)21:21
Research Issues (2)21:34
Existing Best Approach - AAM (Active Appearance Model)21:54
Drawbacks of AAM-based Approaches22:38
AAM vs Explicit Shape Regression22:54
Gesture Control: Control how your avatar moves23:40
Understanding the player’s movement23:59
Pose Correction & Tagging25:40
Skeleton/Pose Tagging26:19
Context-Based Pose Correction & Tagging27:12
The Gesture Component of Kinect SDK28:26
Digitization: Bring physical objects into cyber space29:22
Object Digitization (1)29:59
Object Digitization (2)30:35
Video: Object Digitization31:08
Major Research Issues (1)34:55
Major Research Issues (2)37:26
Face Digitization & Animation ("creating my avatar that looks me & moves like me")38:14
High-Fidelity Facial Animation (1)39:52
High-Fidelity Facial Animation (2)40:49
High-Fidelity Facial Animation (3)41:32
Face Digitization42:16
Image-based Approach42:58
Kinect-based 3D Face Modeling44:03
Comparison44:44
What about hair?45:41
Video: Single-View Hair Modeling for Portrait Manipulation45:59
Our Vision (1)48:41
Our Vision (2)48:59
Our Vision (3)49:03
Our Vision (4)49:07
Future of Kinect: turning Sci-Fi into reality49:21
Beyond Kinect: Cloud + NUI50:42
Where are we today?51:53
Emerging Research Themes53:24
To Recap ...53:56
Thank You!55:28