Build Your World and Play In It
October 6, 2010Update: “Build Your World and Play In It…” won Best Student Paper @ ISMAR 2010!
Next week we will be presenting our latest work at the IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2010) in Seoul, South Korea. ISMAR is the main augmented reality conference.
Novel display and interaction technology has enabled projecting digital content onto complex physical surfaces, freeing content from the confines of a limited, flat monitor display. These projection based interfaces are becoming increasingly feasible for use in ubiquitous display and interaction as projectors decrease in size, cost and power consumption. Everyday, passive objects can be transformed into interactive display surfaces through the use of novel projector-camera systems based on Spatial Augmented Reality. Walls, desks, foam core, clay models, wooden blocks, sand pits, among other materials, can be turned into interactive displays allowing for a new range of interaction possibilities. By acquiring a full 3D model of the display surface, we can interact directly with the world around us.
Abstract
We present a novel way of interacting with everyday objects by representing content as interactive surface particles. Users can build their own physical world, map virtual content onto their physical construction and play directly with the surface using a stylus. A surface particle representation allows programmed content to be created independent of the display object and to be reused on many surfaces. We demonstrated this idea through a projector-camera system that acquires the object geometry and enables direct interaction through an IR tracked stylus. We present three motivating example applications, each displayed on three example surfaces. We discuss a set of interaction techniques that show possible avenues for structuring interaction on complicated everyday objects, such as Surface Adaptive GUIs for menu selection. Through an informal evaluation and interviews with end users, we demonstrate the potential of interacting with surface particles and identify improvements necessary to make this interaction practical on everyday surfaces.
For more details see the paper: pdf
Or ask!
Augmented Engineering 
Amazing blog! Do you have any suggestions for aspiring writers?
I’m planning to start my own site soon but I’m a
little lost on everything. Would you suggest starting with a free platform like WordPress or go for a paid option?
There are so many options out there that I’m totally confused .. Any recommendations? Thanks a lot!
[…] Build your world and play on it https://augmentedengineering.wordpress.com/2010/10/06/build-your-world-and-play-in-it/ […]
[…] We have had a blast the last couple of weeks playing around with the Kinect and seeing everyone’s cool projects. After Santa is done handing out Christmas presents, we will release our Projector-Camera Calibration Library which includes a module for the Kinect camera. The library will eventually include a structured light module as well. We are also toying around with combining the Kinect with our previous work on Interacting with Surface Particles on Complex Objects. […]
[…] reality as part of their research at the University of Illinois. What they have come up with is a stylus-based input system that can use physical objects to create a virtual landscape. Above you can see that an environment was built using white blocks. A camera maps a virtual world […]
[…] reality as part of their research at the University of Illinois. What they have come up with is a stylus-based input system that can use physical objects to create a virtual landscape. Above you can see that an environment was built using white blocks. A camera maps a virtual world […]
Very cool! But “particle” isn’t the right word at all.
[…] reality as part of their research at the University of Illinois. What they have come up with is a stylus-based input system that can use physical objects to create a virtual landscape. Above you can see that an environment was built using white blocks. A camera maps a virtual world […]
This is so awesome. I can just imagine the applications of this in a large scale environment. This could radically change how computers are utilized and perceived in society.
[…] Build your world and play on it https://augmentedengineering.wordpress.com/2010/10/06/build-your-world-and-play-in-it/ […]
[…] reader Brett Jones sent me a video of his (and his team) work that they’re currently presenting at ISMAR, the AR conference […]
[…] Read the complete article here. […]
[…] map virtual content on 3d physical constructions and “play” with them. For more details check out Jones’ website. I think that Angry Birds would be prefect on such a […]