3D Perspective Corrected Spherical Displays
Lead: Sid Fels
3DPS is a new interactive spherical 3D Perspective-corrected, and Stereoscopic – called a 3DPS display system. The approach is based on fish tank virtual reality (FTVR) that uses stereo and head-coupled virtual reality on high-resolution desktop displays. However, our new class of FTVR display technology uses geometric shapes such as cubes and spheres, to create a contained virtual reality volume. Our distinct approach will allow the display to be manipulated for viewing and controlling a 3D scene from different perspectives by more than one person.
The display system is auto-calibrated via 3D reconstruction of each projected pixel on the display using a single inexpensive camera. With the automatic calibration, the multiple-projector system supports a seamlessly blended imagery on the spherical screen. With the calibration, it is possible to create wall-papered imagery like the earth. Multiple viewers can walk around and visualise the seamless imagery on the sphere. Furthermore, we incorporate head tracking with the display to present 3D content with motion parallax by rendering perspective-corrected images. The viewer can naturally visualise 3D scenes within the sphere from arbitrary viewpoints.
As the system has been properly built, our work focuses on developing and evaluating techniques for 3D visualisation and interaction using the unique property of the spherical FTVR. We believe the spherical FTVR is a promising direction and can be a novel, disruptive technology for teleconferencing, art and design, collaborative visualisation for big data, gaming and computer-aided design (CAD) environments.
In relation to this project, we also constructed a personal, spherical, multi-projector perspective-corrected rear-projected display called Spheree. Spheree uses multiple calibrated pico-projectors inside a spherical display with content rendered from a user-centric viewpoint. Spheree uses optical tracking for head-coupled rendering, providing parallax-based 3D depth cues. Spheree is compact, supporting direct interaction techniques. For example, 3D models can be modified via 3D interactions on the sphere, providing a 3D sculpture experience.