Interaction Techniques in Scene Planner System based on Tangible User Interface

Based on the notion of desktop TUI,four kinds of user interface elements are proposed on the condition of single camera.By investigating the main characteristics of common interaction tasks in TUI systems,we build a three-level system frame,supporting the four kinds of semantics above.Combined with the characteristics of the scene planner system itself,four kinds of markers are designed to carry the four kinds of semantics respectively;they are assigned to implement different interaction subtasks.In order to solve the contradiction between a wide scene and a narrow FOV,the techniques of dynamic scale space,dynamic binding,two-hand interaction and occlusion are proposed based on paddle.We also propose the interaction technique based on time and spatial multiplexing following the principles of cognitive psychology.Furthermore,a toolkit based on TUI is built up,several applications based on these techniques are demonstrated.