Since then, personal computer users have continued to live under the tyranny of the mice, windows, icons and pull-down menus originally invented at the Xerox Palo Alto Research Centre in the 1970s and popularised by Apple and Microsoft in the next decade.
Last year, however, the arrival of the Nintendo Wii and the Apple iPhone began to break down the logjam in technological innovation for the way humans interact with computers.
Both devices extend the idea of directly controlling objects on the screen and blending that ability with visually compelling physics software that brings computer screens to life in new, immersive ways. With a Wii, a wave of the hand can slam a tennis ball in cyberspace; with the iPhone, a flick of a finger can slide a photograph across the screen like paper on a table.
The idea of directly manipulating information on a computer screen is almost as old as computer graphics terminals, going back at least to 1963, to Ivan Sutherland’s Sketchpad drawing system he created. Since then, a thriving scientific and engineering discipline has sprung up around systems that bridge what was originally called the man-machine interface. What is new is a convergence of more powerful and less expensive computer hardware and an inspired set of mostly younger software designers who came of age well past the advent of the original graphical user interface paradigm of the 1970s and ’80s. This new generation is “mostly under 25,” said Joy Mountford, who until last month was vice president for design innovation at an advanced development group at Yahoo.
One intriguing example of this new immersive approach to Web navigation is the PicLens software from Cooliris, a 10-person start-up based here. This software plug-in for Web browsers tries to make it possible to navigate, find and share information by directly browsing the images, video and other digital media that are increasingly common on the Web.
PicLens currently offers a small icon cue inset in each Web photo that lets users know they are at a site like Facebook, Google or Flickr that can be browsed with the software. Clicking on the icon transports the user away from the conventional page-oriented Web into an immersive browsing environment.
No browser frame
The software does away with the browser frame and gives the user the effect of flying through a three-dimensional space that feels like an unending hallway of images. In the future, the Cooliris designers plan to make it possible to browse text and video as well.
“I’ve wondered for a long time why the computer interface hasn’t changed from 20 years ago,” said Austin Shoemaker, a former Apple Computer software engineer and now chief technology officer of Cooliris. “People should think of a computer interface less as a tool and more as a extension of themselves or as extension of their mind.”
Some of these ideas can be traced back to the 1990s, to work done at the M.I.T. Media Lab. More recently, the idea of a multitouch display, where images could be moved or scaled by direct touch, was brought to life both by Jeff Han, a computer science researcher at the Courant Institute of Mathematical Sciences at New York University and by W. Daniel Hillis and Bran Ferren, researchers at the consulting firm Applied Minds, who developed a “touch table” world map.
The transition to more immersive displays is happening in part because of more powerful computer hardware, but also because of an explosion of more powerful programming tools. These tools offer visual effects that were once within the grasp of only the most skillful programmers to a wide audience with only basic skills.
Indeed, the more powerful graphics-oriented software has spilled over into the creation of palettes for a new generation of software-oriented artists.
The common theme of all of the technologies will be a new kind of immersive experience.
“If you’re looking for what’s next after the Web browser, this is it,” said Bill Joy, a partner at the Kleiner Perkins Caulfield & Byers, the venture firm that is funding Cooliris.
