|Publication number||US7023466 B2|
|Application number||US 10/053,492|
|Publication date||Apr 4, 2006|
|Filing date||Nov 2, 2001|
|Priority date||Nov 3, 2000|
|Also published as||EP1405264A2, EP1405264A4, US20020135673, WO2002042999A2, WO2002042999A3, WO2002042999A9|
|Publication number||053492, 10053492, US 7023466 B2, US 7023466B2, US-B2-7023466, US7023466 B2, US7023466B2|
|Inventors||Gregg E. Favalora, Joshua Napoli, Michael Halle|
|Original Assignee||Actuality Systems, Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (20), Non-Patent Citations (12), Referenced by (94), Classifications (25), Legal Events (7)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This application claims priority from U.S. Provisional Application Ser. No. 60/245,786, filed on Nov. 3, 2000, which is incorporated herein by reference in its entirety.
This invention relates to electronic displays, and more particularly to three-dimensional electronic displays.
Images, even when rendered in high quality, appear flat when displayed on a flat monitor. Numerous approaches toward displaying images that appear three-dimensional have been proposed. These approaches fall into two main categories: volumetric and stereoscopic.
Volumetric displays produce three-dimensional imagery by generating a collection of points within a volume that emit, or appear to emit, light. If these points emit light isotropically, the image appears ‘ghosted’ or ‘transparent.’ A typical volumetric display does not create a true three-dimensional light field because the volume elements are not perceived to block each other, and the images therefore do not display occlusion. Volumetric displays have been disclosed by a number of researchers, including Hirsch (U.S. Pat. No. 2,967,905), Ketchpel (U.S. Pat. No. 3,140,415), and Lewis et al. (IEEE Trans. Elec. Dev., 18, No. 9, pp. 724–732, 1971).
The most common form of stereoscopic displays use shuttered or passively polarized eyewear, in which the observer wears eyewear that blocks one of two displayed images from each eye. Examples include passively polarized glasses, and rapidly alternating shuttered glasses (see, for example, U.S. Pat. No. 4,523,226, awarded to Lipton et al.). While this approach has resulted in some success, having being adopted for use by professionals in the fields of molecular modeling and CAD, these methods have not met with widespread acceptance as observers generally do not like to wear equipment over their eyes. This consideration has motivated developments in the field of autostereoscopic displays.
Autostereoscopic displays perform stereo separation of images internally, and do not require an observer to use additional eyewear. A number of researchers have developed displays that present a different image to each eye, so long as the observer remains in a fixed position in space. Most of these are variations on the parallax barrier method, in which a fine vertical grating or lenticular lens array is placed in front of a display screen. When the observer's eyes remain fixed at a particular location in space, each eye can only see one set of display pixels (even or odd) through the grating or lens array. Each set of pixels displays a view of the image, which the human visual system interprets as a three-dimensional image.
Holographic and pseudo-holographic displays output a partial light field, presenting many different views simultaneously. Also, the imagery can be photorealistic, exhibiting occlusion and other viewpoint-dependent effects (e.g., reflection). This approach has the potential to allow many observers to see the same image simultaneously, but of course requires far greater computational ability and bandwidth than is generally required for a two-view stereo display for a single observer. In many cases, these displays generate a two-dimensional light field, providing horizontal, not vertical, parallax.
In U.S. Pat. No. 5,172,251, Benton discloses a display that creates a light field by holographic light wave interference. More recently, Eichenlaub et al. (Proc. SPIE, 3639, p. 110–121, 1999) disclosed a discrete light field display, which produces up to 24 discrete viewing zones, each with a different or pre-stored image. As each of the observer's eyes transitions from one zone to another, the image appears to jump to the next zone. An observer perceives a sense of depth due to stereo disparity when the observer's two eyes are in two different zones.
The invention features three-dimensional display apparatus and methods. Displays of the invention generate three-dimensional imagery by endowing selected points in an image space (e.g., an image plane or image volume) with the perceived ability to emit light, either isotropically or with trajectory-dependent amplitude.
In general, in one aspect, the invention features a method for forming a three dimensional image by providing components of the image in a series of frames to an image space. The method includes the following steps: (i) scanning an image of a light shaping element over an image space wherein each of a plurality of zones of the light shaping element is projected to each of a plurality of zones of the image space; and (ii) selectively illuminating portions of the light shaping element zones during each of a plurality of frames during the scan, wherein each zone of the light-shaping element scatters the illumination and at least a portion of the scattered illumination provides a component of the three-dimensional image in the image space.
Embodiments of the three-dimensional image-forming method can include any of the following features. During the scanning, every zone of the light-shaping element can be projected to every zone of the image space. Scanning the image of the light-shaping element further can include reflecting the scattered illumination off a scanning optic towards the image space. The light-shaping element image scanning can be in a first direction over the image space (e.g., a vertical direction). The light-shaping element scanning over the image space can also be in a second direction, perpendicular to the first direction (e.g., a horizontal direction).
Each zone of the light-shaping element can scatters light into a predetermined trajectory, such as a trajectory horizontal to a horizontal plane. Each zone of the light-shaping element can also diffusely scatter light. The light-shaping element can be divided into a plurality of sections. During the scanning each section can be projected to a different depth plane in the image space. In some embodiments, each zone can be projected to a different depth in the image space.
The method can also include scattering the scattered illumination from the light-shaping element in a vertical direction at the image space. This can increase the vertical dimension of a viewing zone.
In general, in another aspect, the invention features a three-dimensional display system that forms a three-dimensional image by providing components of the image in a series of frames to an image space. The three-dimensional display includes a spatial light modulator, a light-shaping element, which includes a number of zones, and a scanning optic, which projects an image of the light-shaping element to an image space. During operation, the scanning optic scans the image of the light-shaping element over the image space, and in each of several frames during the scan, the spatial light modulator selectively illuminates portions of the light-shaping element zones, and each zone scatters the illumination. Some of the illumination scattered by the light-shaping element provides a component of the three-dimensional image in the image space.
The three-dimensional display system can include any of the following features. The spatial light modulator can include a plurality of rows and columns of elements, and each row of elements can correspond to a zone of the light-shaping element. In some cases, each element of the spatial light modulator corresponds to a zone of the light-shaping element. Each zone of the light-shaping element can scatter illumination from the spatial light modulator into a predetermined trajectory, such as a horizontal and/or vertical trajectory. Each zone of the light-shaping element can be a grating (e.g., a transmission grating or a reflection grating). The light-shaping element can be partitioned into several light shaping element sections. Each light-shaping element section can include a plurality of zones, and each light-shaping element section can be positioned in a different plane along an axis (e.g., an optical axis). The light-shaping element can be a diffusing screen and can diffusely scatter illumination from the spatial light modulator. In such cases, the diffusing screen can be placed at a non-perpendicular angle with respect to an optical axis. Each of at least two zones of the light-shaping element can be projected to a different depth plane in the light-shaping element image.
The scanning optic in the three-dimensional display system can be a cylindrical polygonal scanner, which reflects light from the light-shaping element towards the image space. A condensing lens can be included in the optical path of the display system, which focuses illumination from the light-shaping element onto the scanning optic. A telecentric relay can also be included in the optical path of the display to relay the image of the light-shaping element to the image space. The display can also include a vertically diffusing screen positioned in the image space.
Embodiments of the invention have many advantages. For example, a three-dimensional display system can be easily converted from a stereoscopic display to a volumetric display by replacing a single optical component in the display (e.g., the light-shaping element). Moreover, the three-dimensional display system can exhibit properties of both a volumetric display and a stereoscopic display in a single embodiment. Additionally, switching one or two of the optical components can easily convert a stereoscopic display between a horizontal-parallax-only display and a full-parallax display.
Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Although methods and materials similar or equivalent to those described herein can be used in practice or testing of the present invention, suitable methods and materials are described below. All publications, patent applications, patents, and other reference materials mentioned herein are incorporated by reference in their entirety. In case of conflict, the present specification, including definitions, will control. In addition, the materials, methods and examples are illustrative only and not intended to be limiting.
Other features and advantages of the invention will be apparent from the following detailed description, and from the claims.
Like reference symbols in the various drawings indicate like elements.
Referring now to
To aid in the description, it is useful to define three orthogonal axes, namely a vertical axis 310, a horizontal axis, which is the same as horizontal rotation axis 250, and a depth axis 290. The observer typically positions their eyes in a horizontal plane, and looks down depth axis 290 towards output lens 280. The observer focuses on a re-imaged three-dimensional scene, which hovers between output lens 280 and the observer's eyes. Vertical axis 310, depth axis 290, and horizontal rotation axis 250 correspond to the vertical, depth, and horizontal dimensions of the three-dimensional image as perceived by the observer.
Depth axis 290 is parallel to the optical axis, which is shown unfolded in
SLM 210 is a reflective micro electromechanical device, such as a Texas Instruments DMD™, which consists of an array of independently switchable micro-mirrors. The array size depends on the choice of SLM, but will typically include several hundred rows and several hundred columns of micro-mirrors (e.g., an XGA device having 1,024×768 resolution). Micro-mirrors have an “on” state and an “off” state. In the “on” state, a micro-mirror reflects a beam of collimated light from the light source toward a portion of light-shaping element 220. In the “off” state, a micro-mirror directs light from the light source away from the light-shaping element. During operation, SLM driver 120 (see
Light-shaping element 220 lies in a plane perpendicular to the (optical) depth axis 290. Referring now to
The number of columns in the SLM determines the horizontal spatial resolution of the image. Mirrors in different columns of the same row illuminate different portions of the same zone of the light-shaping element. Hence, when projected to the image space, light rays originating from different portions of the same light-shaping element zone will appear to the observer to have the same angular trajectory, but will originate from different areas of the image.
Referring back to
As cylindrical polygonal scanner 240 rotates, it scans an image 270 of the light-shaping element in a vertical direction over image space 510 in image plane 260. Hence, the apparent source of a light ray to the observer (who is focused on image plane 260) depends on the position of image 270 in the scan. By switching an appropriate micro-mirror “on” at the correct time during the scan, the display can project a light ray originating from the micro-mirror to any desired vertical location in image space 510.
To briefly summarize, during a single scan the HPO display system provides light rays having any of N different trajectories to N×M discrete points in the image space, where N is the number of rows and M is the number of columns of the SLM.
Note that the scan sequence illustrated in
Before describing how the HPO display actually generates a three-dimensional image, it is instructive to review the general principles involved in an image's formation. Stereoscopic displays present spatial information to an observer by recreating the light field (e.g., wavefront) emitted (or reflected) by physical objects. Referring to
A more practical approach is to approximate the light field of point 601 in a piecewise fashion (
This piecewise approximation of a light field is more amenable to display a dynamic image, as the plane wave trajectory from each discrete element of the display can be adapted to display changes in the image. This is illustrated by the following example. Referring to
While point 760 appears laterally displaced from point 750, this approximation process can simulate the light fields of points at different depths in space as well. For example, to display point 770, which is positioned further from the observer than point 750, display 701 generates plane waves having ray trajectories 771, 772, and 773 from elements 710, 720, and 730, respectively. Light rays 771, 772, and 773 diverge less rapidly than light rays 711, 721, and 731, thereby approximating the light field of a point further from the observer than point 750 (see
Note that in generating an image of points at different depths and positions in a three dimensional image, display 701 emits light rays with carefully selected trajectories, originating from appropriate locations in an image plane.
Referring now to
In frame t=1 of the scan (see
At a later time frame in the scan, t=2 (see
At a still later time frame in the scan, t=3 (see
The above-described HPO display provides for occlusion in three-dimensional images. This property stems from the display's ability to modulate the intensity of discrete light field portions (e.g., each plane wave) in an image. Occlusion occurs when a first element blocks another element from view in at least a portion of the image. This happens naturally in true three-dimensional scenes when the first element is in the observer's direct line of sight to the second element. Occlusion is an important depth cue to an observer. The following example illustrates how the HPO display provides occlusion in an image. Referring to
The current embodiment provides a multi-view HPO image, similar to a holographic stereogram. In some embodiments, the display can be adapted to provide a volumetric image instead. Referring to
As the image of diffusing screen 1110 is scanned over image volume 1130, each horizontal zone of the diffuser scans out a different depth plane (e.g., a plane perpendicular to optical axis 1109) in image volume 1130. Polygonal scanner 240 projects light scattered by a point 1140, for example, on diffusing screen 1110 to a depth plane 1150 in image volume 1130. The vertical location of the projected point in image volume 1130 depends the position of the light-shaping element image in the scan when the light is generated. Display optics 1101 can address N×M points in each depth plane in image volume 1130, where N×M is the resolution of SLM 210.
To illustrate how display optics 1101 generates a three-dimensional image, consider a simple example of an image that includes three points in a horizontal plane of image volume 1130. Referring to
Each of the three points in horizontal plane 1205 is generated in a single, different time frame during a scan as follows. Referring to
Referring now to
Embodiments of a stereoscopic HPO display and a volumetric display have now been described. The light-shaping element is the only optical component that differs between the display optics of these displays. In some embodiments, a light-shaping element can provide a structured light field (e.g., similar to the light field generated by the HPO display) to multiple depth planes in an image volume, thereby combining elements of a stereoscopic and volumetric three-dimensional image. Referring to
Each section of light shaping element 1301 includes multiple zones. For simplicity, section 1313 is depicted as having five zones, 1360–1364. Similarly, sections 1312, 1311, and 1310 have zones 1369–1373, 1379–1383, and 1389–1393, respectively. While light-shaping element 1301 is depicted as having 20 zones in total, the total number of zones is actually the same as the number of rows in the micro-mirror array of the SLM (e.g., 768 for a XGA SLM). Each zone is a transmission grating, with a grating period and orientation designed to scatter light from the SLM into a predetermined horizontal trajectory in a horizontal plane. Light-shaping element 1301 is designed so that each section can provide ray trajectories that span the same range in a horizontal plane.
Condensing lens 230 and cylindrical polygonal scanner 240 project each section of light shaping element 1301 to a different depth plane along optical axis 1390 in an image volume 1360. Sections 1310, 1311, 1312, and 1313 are projected to depth planes 1320, 1330, 1340, and 1350, respectively. During operation, cylindrical polygonal scanner 240 scans an image of light shaping element 1301 over image volume 1360. SLM 210 selectively directs illumination 205 from a light source to portions of light-shaping element 1301, which scatters the illumination into trajectories in the horizontal plane. Illumination scattered by each section of light-shaping element 1301 is projected to image volume 1360. The projected illumination appears to an appropriately positioned observer to originate from the different depth planes in image volume 1360. For example, light scattered by light-shaping element section 1313 is projected to depth plane 1350, the plane to which the observer's eyes are focused when viewing this scattered light.
Display optics 1300 combines the properties of a HPO display and a volumetric display to generate a hybrid three-dimensional image. Each zone of the light-shaping element provides a light ray with a discrete trajectory, allowing the display to construct a stereoscopic image. Additionally, each zone of the light-shaping element also imparts depth information to the scattered light ray, so that stereoscopic image also fills a volume. Points at nearly any depth in the image volume can be rendered, typically by using the element whose imaged depth is closest to that point. Referring to
The light-shaping element section that is scanned over the depth plane in which the point lies generates the three rays for each point. A different zone in the appropriate light shaping element section generates each ray of each point. The three-point three-dimensional image is thus generated in nine frames during a scan.
While hybrid light-shaping element 1301 has four sections, other embodiments are not so limited. A light-shaping element can be partitioned into as many sections as are needed, based on the general characteristics of the objects being imaged. The more sections a light-shaping element has, the more “volumetric” the display becomes, but at the cost of angular resolution for ray trajectories.
The light-shaping element does not necessarily need to be physically partitioned into a “stair-stepped” collection of sections. Given more sophisticated methods of forming the light-shaping element (e.g., using a two-step holographic exposure), only the image of the light-shaping element needs to be projected to different depth planes in the image volume. The light-shaping element itself can be a single, planar element, further simplifying the optical design of different display embodiments.
The above-described principles of image generation can be adapted to provide full-parallax three-dimensional images. Referring to
Display optics 1501 includes a transmissive SLM 1510, a light-shaping element 1520, and an x-y scanning system 1540. SLM 1510 relays collimated illumination 1505 to dynamically chosen areas of light-shaping element 1520. Also included in display optics 1501 is a condensing lens 1530, which focuses light scattered by the light-shaping element onto x-y scanning system 1540 (e.g., a mirror mounted on a galvanometer, or a pair of cylindrical polygonal scanners). X-y scanning system 1540 projects the scattered light onto a screen 1550 positioned at an image plane 1551. Magnifying optics 1560 magnifies a three-dimensional image at image plane 1551 for an observer 1501 focused on the image plane.
SLM 1510 (e.g., a ferroelectric liquid crystal display) includes pixels 1601–1616, which act as independent dynamic light shutters to modulate the transmission of collimated illumination 1505 from a laser light source (not shown). Actually, SLM 1510 has many more pixels than the sixteen pixels shown in
Light-shaping element 1520 is composed of tiled diffractive zones 1621–1636. Such devices are further described in U.S. patent application Ser. No. 09/648,313, which is incorporated herein by reference, in its entirety. Each light-shaping element zone corresponds to a pixel in SLM 1510. A light ray relayed through an “on” pixel is incident on the corresponding light-shaping element zone, where it is scattered into a trajectory determined by the orientation and grating period of the diffractive zone. For example, light-shaping element zones 1621, 1628, and 1635 scatter light rays 1660, 1640, and 1650 into trajectories 1665, 1645, and 1655, respectively.
Zones 1621–1636 provide trajectories having vertical and/or horizontal components. This distinguishes light shaping element 1520 from light shaping element 220 of HPO display 101 (see
X-y scanning system 1540 performs a raster scan of an image of light shaping element 1520 over screen 1550. SLM 1510 addresses the appropriate zones of light shaping element 1520 only in those timeslots in which x-y scanning system 1540 places the beams exiting light shaping element 1520 in the appropriate horizontal and vertical co-ordinates in image plane 1551 to create a desired three-dimensional image.
A three-dimensional image is generated in image plane 1551 as follows: a processor examines a three-dimensional dataset, and creates a list of zones on the light shaping element to illuminate, sorted by depth. The processor supplies this data to the SLM as a time-series of two-dimensional matrices (each corresponding to a time frame), which dictates when the appropriate zones of the light-shaping element should be illuminated in order to create the three-dimensional image.
Other full-parallax display embodiments are contemplated. For example, the light-shaping element in HPO display 100 (see
In general, in the embodiments described above, any light source can be used to provide light to the spatial light modulator. The light source can include any additional components (e.g., optical components) necessary to provide the SLM with collimated illumination incident at the appropriate angle for the SLM to direct toward the light-shaping element.
In some embodiments, the light source is a laser light source. For example, in displays utilizing a diffractive light-shaping element to provide plane wave trajectories, a coherent, monochromatic light source can be desirable in order to minimize the dispersive effects of the light-shaping element. Alternatively, the light source can be a broadband, incoherent light source. For example, when the SLM and light-shaping element exhibit minimal wavelength dependence (e.g., when the SLM is a micro-mirror array and the light shaping element is a tilted diffusing screen), a broadband light source can be used to provide a white image.
In some embodiments, the display provides a full-color image. For example, a broadband light source can be used to supply white light to an SLM, which includes an absorptive color filter array. The color filter array absorbs a spectral component from each ray directed toward the light-shaping element by the SLM. Each plane wave forming the image thus provides additional spectral information to the image. A full color three-dimensional image results from additive color mixing of the spectral components at the image plane. Another example is a display utilizing time sequential color addition to generate a full-color three-dimensional image. Each frame during a scan projected to the image space consists of three sub-frames, in which the SLM is illuminated with sequential red, green, and blue illumination. Each sub-frame generates a red, green, or blue component to the frame. Obviously, such a display requires an SLM with a response time sufficiently rapid to allow the SLM to be refreshed multiple times during each frame of the scan. An observer's visual system integrates the color-components together to yield a full-color image. An SLM with sub-frame refresh capabilities can also be dithered during a frame, to provide different levels of illumination to each plane wave constructing the image. This enables the display to generate images with grayscale.
In some embodiments, an array of light sources can function as both SLM and light source. For example, a pixelated organic light emitting diode (OLED) device can replace the light source and SLM. Additional passive optical component, such as a lenslet array, or micro-prism arrays, can be placed between the OLED device and the light-shaping element if necessary to collimate the light emitted by each OLED pixel.
Passive diffractive and diffusing light-shaping elements have been described. Generally, the light-shaping element can be any optical element or combination of optical elements that scatter incident illumination into the trajectories required to generate a three dimensional image. These can include diffractive, reflective, refractive and diffusing elements, and combinations of elements.
The systems of display optics described above can also include additional optical components for projecting the light-shaping element image to the image space. For example, the condensing lens can include any number of additional lenses or other optical components to focus light transmitted by the light-shaping element onto the scanner, projecting the light to the image space. Additional optics can also be included between the scanner and the image space. For example, a telecentric relay can image the light-shaping element to the image space. The relay can include the condensing lens plus additional lenses between the scanner and the image space. This system is particularly useful when using a light-shaping element that is tilted with respect to the optical axis.
A number of embodiments of the invention have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. For example, a system can include redundant SLM pixels or light shaping element zones. In other words, multiple pixels and/or multiple zones can scatter incident illumination into trajectories or at the same depth plane. In such cases, it is not necessary to scan every zone over the entire image space, as the display can provide all components of the three-dimensional image to the image space in a partial scan. Accordingly, other embodiments are within the scope of the following claims.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US5132839||Dec 24, 1990||Jul 21, 1992||Travis Adrian R L||Three dimensional display device|
|US5172251||Apr 12, 1990||Dec 15, 1992||Massachusetts Institute Of Technology||Three dimensional display system|
|US5694235||Mar 7, 1996||Dec 2, 1997||Telecommunications Advancement Organization Of Japan||Three-dimensional moving image recording/reproducing system which is compact in size and easy in recording and reproducing a three-dimensional moving image|
|US5745197||Oct 20, 1995||Apr 28, 1998||The Aerospace Corporation||Three-dimensional real-image volumetric display system and method|
|US5801761||Mar 26, 1993||Sep 1, 1998||Tibor; Balogh||Method and apparatus for producing three-dimensional picture|
|US5815314||Oct 15, 1997||Sep 29, 1998||Canon Kabushiki Kaisha||Image display apparatus and image display method|
|US5854613||May 31, 1996||Dec 29, 1998||The United Sates Of America As Represented By The Secretary Of The Navy||Laser based 3D volumetric display system|
|US5907312||Aug 9, 1996||May 25, 1999||Sharp Kabushiki Kaisha||Three-dimensional image display device|
|US5926294||Dec 12, 1996||Jul 20, 1999||Sharp Kabushiki Kaisha||Three-dimensional image display device having an elementary hologram panel and method for manufacturing the elementary hologram panel|
|US5971547 *||Jul 22, 1997||Oct 26, 1999||Reilley; Peter||Astigmatic lenticular projector system|
|US6052100||Sep 10, 1997||Apr 18, 2000||The United States Of America Represented By The Secertary Of The Navy||Computer controlled three-dimensional volumetric display|
|US6109750 *||Jun 19, 1997||Aug 29, 2000||Siemens Nixdorf Informationssysteme Aktiengesellschaft||Method for three-dimensional imaging representation on a large-screen projection surface using a laser projector|
|US6154259 *||Nov 26, 1997||Nov 28, 2000||Photera Technologies, Inc.||Multi-beam laser scanning display system with speckle elimination|
|US6201565||Feb 4, 1998||Mar 13, 2001||Holografica||Method and apparatus for displaying three-dimensional images|
|US6433930 *||Jun 18, 1999||Aug 13, 2002||Korea Institute Of Science And Technology||Multiview three-dimensional image display apparatus|
|US6437919 *||Oct 15, 1998||Aug 20, 2002||Holographic Imaging Llc||System for the production of a dynamic image for display|
|WO2000075698A1||May 18, 2000||Dec 14, 2000||Holographic Imaging Llc||Holographic displays|
|WO2001078409A2||Apr 3, 2001||Oct 18, 2001||Tibor Balogh||Method and apparatus for the presentation of three-dimensional images|
|WO2001088598A2||May 18, 2001||Nov 22, 2001||Tibor Balogh||Method and apparatus for displaying 3d images|
|WO2002039194A1||Nov 6, 2001||May 16, 2002||Holographic Imaging Llc||3d display|
|1||Jones et al., "Real-Time Three-Dimensional Display Based On The Partial Pixel Architecture" Optics Letters vol. 20,No. 12, pp. 1418-1420, Jun. 1995.|
|2||Kishigami et al., "Real-time color three-dimensional display system using holographic optical elements" SPIE 4296:102-107 (2001).|
|3||Kullick et al., "Partial Pixels: a three-dimensional diffractive display architecture" J. Optic. Soc. Am. A vol. 12, No. 1, pp. 73-83 Jan. 1995.|
|4||LeRoy D. Dickson et al., "Holography in the EBM 3687 Supermarket Scanner," IBM J. Res. Develop., 26(2):228-234, Mar. 1982.|
|5||Miyazaki et al., "Volume Scanning three-dimensional display that uses an inclined image plane" Applied Optics vol. 40, No. 20, pp. 3354-3358, Jul. 2001.|
|6||Neil et al., "Spatial Light Modulator Based Three-Dimensional Multiplanar Display" SPIE 3012:337-341 (1997).|
|7||Nordin et al., "Demonstration of a Novel Three-Dimensional autostereoscopic display" Optics Letters 19: 12 pp. 901-903, Jun. 1994.|
|8||Perlin et al., "An Autostereoscopic Display" Computer Graphics, vol. 33, No. 3.|
|9||Perlin et al., "Recent Advances in the NYU Autostereoscopic Display" Proceedings of the SPIE, 4297:22-24, San Jose Calif (2001).|
|10||Ritsuko Kishigami et al., "Real-time color three-dimensional display . . . ," Practical Holography XV and Holographic Materials VII, Stephone A. Benton, Sylvia H. Stevenson, T. John Trout, eds., Proceedings of SPI 4296:102-107, 2001.|
|11||Slinger et al., "Progress and prospects for practical electro-holographic display systems" SPIE 4296:18-32 (2001).|
|12||Sunny Bains, "Alabama researchers create real-time 3D Display" http://www.spie.org/web/oer/january/jan97/Itconstr.html.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7277226 *||Jan 14, 2005||Oct 2, 2007||Actuality Systems, Inc.||Radial multiview three-dimensional displays|
|US7330297||Mar 4, 2005||Feb 12, 2008||Angstrom, Inc||Fine control of rotation and translation of discretely controlled micromirror|
|US7339746||May 5, 2006||Mar 4, 2008||Angstrom, Inc.||Small and fast zoom system using micromirror array lens|
|US7350922||Jun 9, 2006||Apr 1, 2008||Angstrom, Inc.||Three-dimensional display using variable focal length micromirror array lens|
|US7354167||Nov 2, 2004||Apr 8, 2008||Angstrom, Inc.||Beam focusing and scanning system using micromirror array lens|
|US7382516||Jun 18, 2004||Jun 3, 2008||Angstrom, Inc.||Discretely controlled micromirror with multi-level positions|
|US7400437||Oct 16, 2006||Jul 15, 2008||Angstrom, Inc.||Discretely controlled micromirror with multi-level positions|
|US7410266||Dec 28, 2005||Aug 12, 2008||Angstrom, Inc.||Three-dimensional imaging system for robot vision|
|US7474454||Mar 6, 2006||Jan 6, 2009||Angstrom, Inc.||Programmable micromirror motion control system|
|US7488082||Dec 12, 2006||Feb 10, 2009||Angstrom, Inc.||Discretely controlled micromirror array device with segmented electrodes|
|US7489434||May 2, 2007||Feb 10, 2009||Angstrom, Inc.||Hybrid micromirror array lens for reducing chromatic aberration|
|US7518758 *||Nov 20, 2002||Apr 14, 2009||Hsing-Tang Chien||Method and apparatus for increasing scanning resolution|
|US7525541 *||Mar 16, 2005||Apr 28, 2009||Actuality Systems, Inc.||Data processing for three-dimensional displays|
|US7535618||Mar 12, 2007||May 19, 2009||Angstrom, Inc.||Discretely controlled micromirror device having multiple motions|
|US7580178||Dec 13, 2005||Aug 25, 2009||Angstrom, Inc.||Image-guided microsurgery system and method|
|US7589884||Sep 22, 2006||Sep 15, 2009||Angstrom, Inc.||Micromirror array lens with encapsulation of reflective metal layer and method of making the same|
|US7589885||Sep 22, 2006||Sep 15, 2009||Angstrom, Inc.||Micromirror array device comprising encapsulated reflective metal layer and method of making the same|
|US7589916||Aug 10, 2007||Sep 15, 2009||Angstrom, Inc.||Micromirror array with iris function|
|US7605988||Jul 23, 2007||Oct 20, 2009||Angstrom, Inc.||Compact image taking lens system with a lens-surfaced prism|
|US7619614 *||Jan 28, 2006||Nov 17, 2009||Angstrom, Inc.||Three-dimensional optical mouse system|
|US7619807||Oct 31, 2007||Nov 17, 2009||Angstrom, Inc.||Micromirror array lens with optical surface profiles|
|US7667896||Jan 28, 2006||Feb 23, 2010||Angstrom, Inc.||DVD recording and reproducing system|
|US7742232||May 11, 2006||Jun 22, 2010||Angstrom, Inc.||Three-dimensional imaging system|
|US7751694||Dec 20, 2005||Jul 6, 2010||Angstrom, Inc.||Three-dimensional endoscope imaging and display system|
|US7768571||Nov 2, 2004||Aug 3, 2010||Angstrom, Inc.||Optical tracking system using variable focal length lens|
|US7777959||Jun 26, 2006||Aug 17, 2010||Angstrom, Inc.||Micromirror array lens with fixed focal length|
|US7843449||Sep 20, 2006||Nov 30, 2010||Apple Inc.||Three-dimensional display system|
|US7898144||Feb 4, 2006||Mar 1, 2011||Angstrom, Inc.||Multi-step microactuator providing multi-step displacement to a controlled object|
|US7978407||Jun 27, 2009||Jul 12, 2011||Holovisions LLC||Holovision (TM) 3D imaging with rotating light-emitting members|
|US8049776||May 19, 2006||Nov 1, 2011||Angstrom, Inc.||Three-dimensional camcorder|
|US8179424 *||Apr 29, 2005||May 15, 2012||Setred As||3D display method and apparatus|
|US8223195 *||Feb 13, 2008||Jul 17, 2012||Sony Corporation||Three-dimensional image pickup apparatus, three-dimensional display apparatus, three-dimensional image pickup and display apparatus and information recording method|
|US8456516 *||Jul 1, 2008||Jun 4, 2013||Barco N.V.||Methods and systems for stereoscopic imaging|
|US8537204||Jul 8, 2004||Sep 17, 2013||Gyoung Il Cho||3D television broadcasting system|
|US8587498||Mar 1, 2010||Nov 19, 2013||Holovisions LLC||3D image display with binocular disparity and motion parallax|
|US8622557||May 20, 2008||Jan 7, 2014||Stereo Display, Inc.||Micromirror array lens with self-tilted micromirrors|
|US8633967 *||Apr 23, 2007||Jan 21, 2014||Expert Treuhand Gmbh||Method and device for the creation of pseudo-holographic images|
|US8810908||Mar 18, 2008||Aug 19, 2014||Stereo Display, Inc.||Binoculars with micromirror array lenses|
|US8860790||Aug 29, 2008||Oct 14, 2014||Setred As||Rendering improvement for 3D display|
|US9083963 *||Nov 22, 2013||Jul 14, 2015||Expert Treuhand Gmbh||Method and device for the creation of pseudo-holographic images|
|US9300951||Jan 14, 2010||Mar 29, 2016||Apple Inc.||Autostereoscopic projection display device with directional control based on user's location|
|US9454013 *||Sep 12, 2013||Sep 27, 2016||Delta Electronics, Inc.||Autostereoscopic display device and projecting method using the same|
|US9454924 *||Mar 28, 2011||Sep 27, 2016||Semiconductor Energy Laboratory Co., Ltd.||Driving method of liquid crystal display device|
|US20030128407 *||Nov 20, 2002||Jul 10, 2003||Lite-On Technology Corporation||Method and apparatus for increasing scanning resolution|
|US20050180007 *||Jan 14, 2005||Aug 18, 2005||Actuality Systems, Inc.||Radial multiview three-dimensional displays|
|US20050206773 *||Nov 2, 2004||Sep 22, 2005||Kim Tae H||Optical tracking system using variable focal length lens|
|US20050230641 *||Mar 16, 2005||Oct 20, 2005||Won Chun||Data processing for three-dimensional displays|
|US20050280883 *||Jun 18, 2004||Dec 22, 2005||Angstrom Inc. & Stereo Display Inc.||Discretely controlled micromirror with multi-level positions|
|US20060007301 *||Jul 8, 2004||Jan 12, 2006||Cho Gyoung I||3D television broadcasting system|
|US20060092379 *||Dec 13, 2005||May 4, 2006||Stereo Display, Inc.||Image-guided microsurgery system and method|
|US20060120706 *||Dec 20, 2005||Jun 8, 2006||Stereo Display, Inc.||Three-dimensional endoscope imaging and display system|
|US20060152792 *||Mar 6, 2006||Jul 13, 2006||Stereo Display, Inc.||Programmable micromirror motion control system|
|US20060158432 *||Jan 28, 2006||Jul 20, 2006||Stereo Dispaly, Inc.||Three-dimensional optical mouse system|
|US20060158455 *||Jan 18, 2005||Jul 20, 2006||Kazutora Yoshino||Real clear 3D multi-user communicator|
|US20060198011 *||Mar 4, 2005||Sep 7, 2006||Stereo Display, Inc.||Volumetric three-dimensional device using two-dimensional scanning device|
|US20060198012 *||Mar 4, 2005||Sep 7, 2006||Stereo Display, Inc.||Fine control of rotation and translation of discretely controlled micromirror|
|US20060203117 *||Mar 10, 2005||Sep 14, 2006||Stereo Display, Inc.||Video monitoring system using variable focal length lens|
|US20060209423 *||May 5, 2006||Sep 21, 2006||Angstrom Inc. & Stereo Display Inc.||Small and fast zoom system using micromirror array lens|
|US20060209439 *||May 11, 2006||Sep 21, 2006||Stereo Display, Inc.||Three-dimensional imaging system|
|US20060221179 *||May 19, 2006||Oct 5, 2006||Stereo Display, Inc.||Three-dimensional camcorder|
|US20060232498 *||Jun 9, 2006||Oct 19, 2006||Stereo Display, Inc.||Three-dimensional display using variable focal length micromirror array lens|
|US20060245067 *||Jun 26, 2006||Nov 2, 2006||Stereo Display, Inc.||Micromirror array lens with fixed focal length|
|US20070040924 *||Aug 19, 2005||Feb 22, 2007||Stereo Display, Inc.||Cellular phone camera with three-dimensional imaging function|
|US20070041077 *||Aug 19, 2005||Feb 22, 2007||Stereo Display, Inc.||Pocket-sized two-dimensional image projection system|
|US20070064301 *||Oct 16, 2006||Mar 22, 2007||Stereo Display, Inc.||Discretely controlled micromirror with multi-level positions|
|US20070115261 *||Nov 23, 2005||May 24, 2007||Stereo Display, Inc.||Virtual Keyboard input system using three-dimensional motion detection by variable focal length lens|
|US20070182276 *||Feb 4, 2006||Aug 9, 2007||Stereo Display, Inc.||Multi-step microactuator|
|US20070188862 *||Feb 9, 2007||Aug 16, 2007||Teruhisa Yokosawa||Multifocal lens array and three-dimensional stereoscopic image display apparatus|
|US20070188883 *||Dec 28, 2005||Aug 16, 2007||Stereo Display, Inc.||Three-dimensional imaging system for robot vision|
|US20080018732 *||Apr 29, 2005||Jan 24, 2008||Setred Ab||3D Display Method and Apparatus|
|US20080037102 *||Aug 10, 2006||Feb 14, 2008||Stereo Display, Inc.||Micromirror with multi-axis rotation and translation|
|US20080049291 *||Oct 31, 2007||Feb 28, 2008||Stereo Display, Inc.||Micromirror arry lens with optical surface profiles|
|US20080068372 *||Sep 20, 2006||Mar 20, 2008||Apple Computer, Inc.||Three-dimensional display system|
|US20080074726 *||Sep 22, 2006||Mar 27, 2008||Stereo Display, Inc.||Micromirror array lens with encapsulation of reflective metal layer and method of making the same|
|US20080074727 *||Sep 22, 2006||Mar 27, 2008||Stereo Display, Inc.||Micromirror array device comprising encapsulated reflective metal layer and method of making the same|
|US20080143824 *||Feb 13, 2008||Jun 19, 2008||Sony Corporation||Three-dimensional image pickup apparatus, three-dimensional display apparatus, three-dimensional image pickup and display apparatus and information recording method|
|US20080194930 *||Feb 9, 2007||Aug 14, 2008||Harris Melvyn L||Infrared-visible needle|
|US20080225369 *||Mar 12, 2007||Sep 18, 2008||Stereo Display, Inc.||Discretely controlled micromirror device having multiple motions|
|US20080309190 *||Jun 13, 2007||Dec 18, 2008||Stereo Display, Inc.||Mems actuator with discretely controlled multiple motions|
|US20090027780 *||Jul 23, 2007||Jan 29, 2009||Stereo Display, Inc.||Compact image taking lens system with a lens-surfaced prism|
|US20090040586 *||Aug 10, 2007||Feb 12, 2009||Stereo Display, Inc.||Micromirror arry with iris function|
|US20090185067 *||Dec 21, 2007||Jul 23, 2009||Stereo Display, Inc.||Compact automatic focusing camera|
|US20090290244 *||May 20, 2008||Nov 26, 2009||Stereo Display, Inc.||Micromirror array lens with self-tilted micromirrors|
|US20090303569 *||May 20, 2008||Dec 10, 2009||Stereo Didplay, Inc.||Self-tilted micromirror device|
|US20090309887 *||Apr 19, 2007||Dec 17, 2009||Setred As||Bandwidth improvement for 3d display|
|US20100002295 *||Jul 1, 2008||Jan 7, 2010||Tom Kimpe||Methods and systems for stereoscopic imaging|
|US20100026795 *||Apr 19, 2007||Feb 4, 2010||Setred As||High speed display shutter for autostereoscopic display|
|US20100118118 *||Jan 14, 2010||May 13, 2010||Apple Inc.||Three-dimensional display system|
|US20100171811 *||Apr 23, 2007||Jul 8, 2010||Expert Treuhand Gmbh||Method and device for the creation of pseudo-holographic images|
|US20110109629 *||Aug 29, 2008||May 12, 2011||Setred As||Rendering improvement for 3d display|
|US20110211256 *||Mar 1, 2010||Sep 1, 2011||Connor Robert A||3D image display with binocular disparity and motion parallax|
|US20110242100 *||Mar 28, 2011||Oct 6, 2011||Semiconductor Energy Laboratory Co., Ltd.||Driving method of liquid crystal display device|
|US20140152782 *||Nov 22, 2013||Jun 5, 2014||Expert Treuhand Gmbh||Method and device for the creation of pseudo-holographic images|
|US20150015855 *||Sep 12, 2013||Jan 15, 2015||Delta Electronics, Inc.||Autostereoscopic display device and projecting method using the same|
|U.S. Classification||348/42, 348/E13.057, 348/51, 359/471|
|International Classification||G03B21/00, H04N13/04, G06T1/00, H04N13/00, G02B27/22|
|Cooperative Classification||H04N13/0495, G02B27/2271, G02B27/22, H04N13/0418, G06T1/0007, H04N13/0402, H04N13/0447, H04N13/0427|
|European Classification||G06T1/00A, H04N13/04A, H04N13/04A7, H04N13/04D, H04N13/04V5, H04N13/04L1, G02B27/22V, G02B27/22|
|Jun 3, 2002||AS||Assignment|
Owner name: ACTUALITY SYSTEMS, INC., MASSACHUSETTS
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FAVALORA, GREGG E.;NAPOLI, JOSHUA;HALLE, MICHAEL;REEL/FRAME:012947/0849;SIGNING DATES FROM 20020412 TO 20020507
|Oct 5, 2009||FPAY||Fee payment|
Year of fee payment: 4
|Dec 28, 2009||AS||Assignment|
Owner name: ELLIS AMALGAMATED LLC, D/B/A OPTICS FOR HIRE, MASS
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ACTUALITY SYSTEMS, INC.;REEL/FRAME:023708/0027
Effective date: 20091228
|Sep 29, 2011||AS||Assignment|
Owner name: ELLIS AMALGAMATED LLC, D/B/A OPTICS FOR HIRE, MASS
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ACTUALITY SYSTEMS, INC.;REEL/FRAME:026988/0664
Effective date: 20091228
|Nov 14, 2011||AS||Assignment|
Owner name: PARELLEL CONSULTING LIMITED LIABILITY COMPANY, DEL
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ELLIS AMALGAMATED LLC;REEL/FRAME:027225/0540
Effective date: 20110929
|Sep 25, 2013||FPAY||Fee payment|
Year of fee payment: 8
|Sep 28, 2015||AS||Assignment|
Owner name: GULA CONSULTING LIMITED LIABILITY COMPANY, WASHING
Free format text: MERGER;ASSIGNOR:PARELLEL CONSULTING LIMITED LIABILITY COMPANY;REEL/FRAME:036668/0632
Effective date: 20150828