The Next Dimension of Digital: The musings of digital artists and animators

The holographic video showed a tiny, 3-D man jogging in place inside a glass cube. The little black-and-white jogger can be viewed from the front, side or back.

Attendees at the 2007 Special Interest Group on Graphics and Interactive Techniques (SIGGRAPH) conference for digital artists and animators walked around the cube to view the moving figure from every angle.

It doesn?t take a futurist to imagine that this could be the next generation of television, or an early stage of something that replaces TV. The jogger is fascinating. What if you could control him like a video game character? And what if you had two controllable avatars that could box or sword fight?

SIGGRAPH, which is a special interest group of the Association for Computing Machinery, is something of a window into the future of digital media. It was at a SIGGRAPH conference, years ago, that virtual reality was first demonstrated in public. In 1982, the conference saw the first demonstration of the morphing of digital images. In later years, graphics researchers demonstrated the physics and math required to make computer pixels simulate cloth fabric, to make light reflect and to make smoke rise fluidly from a fire.

Whether this holographic video materializes as a consumer device in the next 10 or 20 years remains to be seen. But a look around SIGGRAPH?s emerging technology exhibit, where hologram man jogged, showed that traditional two-dimensional TV will face plenty of competition in coming years.

At a nearby exhibit, people put their hands into an empty box and had them appear on a computer screen where they could poke and prod a 3-D jack-in-the-box. At another exhibit, people put on a cyborg glove to feel the weight and resistance of objects in a 3-D world. Others watched a 3-D video on a flat-panel television without wearing special glasses. For any of these cutting-edge technologies, the cost of hardware and software is an obstacle to making the transition from lab curiosity to consumer product. The creators of the holographic video?the University of Southern California?s Institute for Creative Technologies, Fakespace Labs and Sony?say that at the rate hardware prices are falling, the technology could be available for home use in 10 years.
Technically known as an ?interactive 360-degree light field display,? the holographic video is rendered by modified off-the-shelf hardware. Overhead, a modified version of a digital projector fires 5,000 frames per second onto a rapidly spinning mirror.

In traditional 3-D video, the illusion of three dimensions is created by sending slightly different images to each eye, recreating the slightly different perspective eyes have in the real world.

The holographic video is a series of these 3-D videos, recorded and reproduced from 288 viewing angles, like 288 slices of a pie. The projector is sending out 288 3-D videos, one for each slice of the pie, on each rotation of the mirror. When viewers move from side to side, they see a different slice of the pie. Just as the brain perceives the series of frames of a movie as a single moving image, it perceives changes in viewing angle as horizontal motion. In viewers? minds, they see a jogger from multiple angles. In reality, they are switching among 288 simultaneous videos.

This first demonstration of the holographic video is in black and white with a small 3-D figure. Researchers say the technology can be upgraded fairly easily to include color and larger figures.

Not far from the little jogger are two flat-screen, 3-D TV monitors. One, from Texas Instruments, requires special battery-powered glasses and is expected to be offered to consumers soon. The company says 3-D capability can easily be added to its DLP HDTVs; it expects to sell 1 million 3-D ready televisions by the end of 2008. The other TV, which produces its 3-D illusions for the naked eye, is available to businesses with a need and a budget for a $70,000 monitor.