|Publication number||US7118228 B2|
|Application number||US 10/701,766|
|Publication date||Oct 10, 2006|
|Filing date||Nov 4, 2003|
|Priority date||Nov 4, 2003|
|Also published as||US20050094111|
|Publication number||10701766, 701766, US 7118228 B2, US 7118228B2, US-B2-7118228, US7118228 B2, US7118228B2|
|Inventors||Gregory J. May|
|Original Assignee||Hewlett-Packard Development Company, L.P.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (35), Referenced by (18), Classifications (34), Legal Events (5)|
|External Links: USPTO, USPTO Assignment, Espacenet|
With today's digital technology, it is increasingly easier to capture and record high quality images. Digital cameras, camcorders, and other similar devices provide users with the ability to digitally capture and record a scene or a moment in time. Often, pictures and videos representing digitally captured and recorded scenes are presented on a screen or other flat surface using some type of projection device.
Image-projection devices such as liquid crystal display (LCD) projectors, digital light processing (DLP) projectors, film projectors, slide projectors, overhead projectors, etc. are used to project an image onto a surface. Typically, the receiving surface of a projected image is a wall or a screen. Projectors are commonly used to project images in a variety of places and applications. For example, projectors may be used in movie theaters, home theaters, classrooms, outdoor displays, conference rooms, or in other situations where one may desire to display an image.
Traditionally, image-projection devices have been used to project images onto a single flat or slightly curved surface. While this display method allows for multiple users to simultaneously view a two-dimensional image, an immersive environment is difficult to produce.
A display system includes a single image-projection device, and a reflective surface optically coupled to the image-projection device, wherein the reflective surface is configured to reflect a plurality of images projected by the image-projection device onto a plurality of display surfaces, the projection being along a same path as a collection of the plurality of images.
The accompanying drawings illustrate various exemplary embodiments of the present system and method and are a part of the specification. The illustrated embodiments are merely examples of the present system and method and do not limit the scope thereof.
Throughout the drawings, identical reference numbers designate similar, but not necessarily identical, elements.
In a number of situations, it may be desirable to project images, often combined with sound, to create an immersive environment where the user feels completely surrounded by, and a part of the surroundings. In order to completely immerse the user in the new environment, one or more images may be projected onto the surfaces surrounding the user. For example, if the user is in a room with four walls, the image or images would be projected onto each of the four walls. Traditional methods for projecting images on multiple walls are cost prohibitive due to the need for multiple projectors, specially designed surfaces, and required pre-morphing software.
The present specification describes a method and apparatus for projecting an image or a motion picture onto multiple surfaces using a single image-projecting device. According to one exemplary embodiment, the present system and method avoids the aforementioned issues associated with multiple projector systems by incorporating a 360-degree projection system using a single image-projecting device and a specialized mirror. The specialized mirror is configured to project images onto multiple surfaces along a same optical path as a collection of the plurality of images, thereby eliminating the need for morphing the images.
In the present specification and in the appended claims, the term “image-projecting device” or “projectors” is meant to be understood broadly as any device configured to receive an image or data representing an image and to reproduce an image based on the received content. Typical image-projecting devices or projectors may include but are in no way limited to, liquid crystal display (LCD) projectors, digital light projectors (DLP), liquid crystal on silicon (LCOS) projectors, cathode ray tube (CRT) projectors, film projectors, slide projectors, overhead projectors, light emitting diode (LED) projectors, vertical cavity emitting laser (VCEL) projectors, and the like. Similarly, the term “image” is meant to be understood broadly as meaning any still picture, motion picture, recorded film picture, real-time video feed, television broadcast picture, and the like. Moreover, the term “mirror” is meant to be understood broadly as any shape or material sufficiently reflective to reflect and reproduce a projected image. Additionally, the term “prismatic” or “prism” may refer to a polyhedron with two congruent and parallel faces (the bases) and whose lateral faces are parallelograms and may be reflective or transmissive.
In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present system and method for providing 360-degree image-projection using a single image projector. It will be apparent, however, to one skilled in the art, that the present method may be practiced without these specific details. Reference in the specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. The appearance of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment.
The image-projection device (101) illustrated in
Returning again to
In one exemplary embodiment, the image-projection device may be placed underneath the mirror, thus enabling the light projected by the projection device to reflect off the mirror onto the display surface (104,
From the mirror (102), the projected image is reflected onto a display surface (104). Image-projecting devices are capable of projecting an image onto various types of surfaces, some of which are better suited for viewing the image. Commonly used surfaces are usually flat such as a wall or a screen; however, curved and semispherical surfaces also lend themselves to particular image-projection applications. The present image-projection device (101) is optically coupled to the mirror (102) or other reflective surface such that light (103) emitted by the image-projection device (101) may be selectively reflected to and displayed on any number of the above mentioned viewing surfaces (104).
Additionally, the projected image may be displayed on a transmissive display surface (104). According to this exemplary embodiment, the mirror (102) or other reflective surface may reflect the projected image to and through the back of a transmissive surface. Once the image is transmitted through the surface, it may be viewed on the front side. According to this exemplary embodiment, the image projection device (101) and the mirror (102) may be disposed behind the transmissive display surfaces (104).
In some embodiments, an optically addressed display (OAD) (105) may be used to enhance the brightness of the projected image and/or retain the image for a specified amount of time. An OAD may be a passive or active device and may be suited for rear or front projection. The OAD may have pixel memory, which would retain a projected image for a predetermined amount of time. This has the positive effect of allowing the light (103) of a projected image to be directed in other directions while simultaneously maintaining the brightness of each projected image. OAD's may function in a variety of positions and may be disposed according to the specification of the user.
Exemplary Implementation and Operation
Presently, there are a number of methods that may be used to perform 360-degree image captures. According to one embodiment, the panoramas are collected by taking wide angle shots and stitching them together. According to other embodiments, images are morphed from a single capture. In yet a third embodiment, panoramas are collected by attaching a semi-spherical mirror to a camera attachment. According to this embodiment, the camera collects a 360-degree image which may then be morphed using vendor software into computer content that then allows one to view 360-degrees of images in a continuous strip of images. While traditional display methods for the above-mentioned 360-degree image captures include morphing and other image manipulation methods, the present system and method allow for the projection of 360-degree images without the inclusion of morphing and other manipulation methods.
As shown in
Once the image data containing signal is received in the present image-projection system (step 300), the signal may optionally be analyzed (step 310). According to one exemplary embodiment, the image data containing signal-includes header information, a file extension, or a menu selection indicating the type of device used to collect the image containing data. Identifying the type of device used is significant to the present system and method because it allows the present system and method to closely reproduce the image-projection path and re-project the image back along the same optical paths using the same type of mirror or lens. According to this exemplary embodiment, if the same or similar image-projection path is used for the re-projection of the image, no morphing is needed. According to one exemplary embodiment, the device used to collect the image containing data is identified by the image projection system (step 310) through analyzing a number of Exchangeable Image File (EXIF) extensions associated with a JPEG (Joint Photographic Experts Group) image. According to this exemplary embodiment, EXIF extensions include a number of fields that provide a receiving device with information including a name and a number that identify the image input equipment used to collect the image. An identifier may be included in one field of the EXIF extensions to indicate to the receiving device the image-projection path used for the collection of the image. Once identified, the same or a similar image-projection path may be used for the projection of the image. Similar methods may be incorporated to identify the image projection path used for the collection of moving images.
As the signal is received and analyzed (step 310), a number of optional image manipulations may be performed by the image-projection device or a coupled computing device. According to one exemplary embodiment, upon analyzation of the received signal, a mirror or other reflective surface (102;
The present image-projection system, in contrast to traditional systems, does not require multiple projectors, or pre-morphing software. Any projector (101) with a proper focal length can project and reflect an image off of the mirror (702). Any image captured by taking an image from light reflected by a mirror (702) may thereafter be projected through the same path without pre-morphing. Also, the shape of the mirror (702) may be refined and customized to “fit” the displayed image to the room and correct for focusing incongruence.
Returning again to
As noted above, resolution, contrast, spacing, and other problems may be solved using image pre-morphing techniques. Each image may be warped, skewed, highlighted, darkened, stretched, compressed, or otherwise modified to allow for correct visual display on the display surface (104;
According to one exemplary embodiment, the received analyzed signal may be manipulated to match the targeted display surface (104;
Once the signal containing image data has been analyzed (step 310) and optionally manipulated (step 330), the image-projection device (101;
According to one exemplary embodiment, the source of the projected image, whether electronic, film, or otherwise, may be divided up into two or more sections per displayed frame, having distinct images in each frame. According to this exemplary embodiment, when one frame is projected onto a mirror (102;
In an alternative embodiment, a projection device (101;
In order to accomplish the “time sharing” produced by the projection of an image at various surfaces of a mirror or other reflective device for short periods of time, light from an image-projection device (101;
Once the image is projected onto the mirror (step 340), the projected image is reflected from the surface of the mirror or other reflective surface (step 350) towards a display surface (104;
To enhance the brightness of the image on the display surface (104;
Upon reflecting the image from the surface of the mirror (102;
In some embodiments, the image-projection system may be used in a room with four walls, a ceiling, and a floor. According to one exemplary embodiment, the four walls may serve as the display surfaces (104;
In conclusion, the present image-projection system, in its various embodiments, is capable of projecting multiple individual images onto multiple surfaces simultaneously using a single projector. In doing such, the present system and method is capable of providing an immersive environment for a user. By using a single projector, color and intensity matching, tiling, and other concerns associated with using multiple projectors, are diminished. Additionally, by allowing the user to capture and project an image along the same path that the image was collected, no image pre-morphing is necessary.
The preceding description has been presented only to illustrate and describe embodiments of the present method and system. It is not intended to be exhaustive or to limit the disclosure to any precise form disclosed. Many modifications and variations are possible in light of the above teaching. It is intended that the scope of the invention be defined by the following claims.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US3107577||Nov 21, 1960||Oct 22, 1963||Walt Disney Prod||Panoramic motion picture projection apparatus|
|US4357081||Jan 29, 1980||Nov 2, 1982||Nederlandse Centrale Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek||Projector for the projection of a panoramic image and camera for the manufacture of films for a projector of this kind|
|US4395093||May 21, 1981||Jul 26, 1983||The United States Of America As Represented By The Secretary Of The Navy||Lens system for panoramic imagery|
|US4566763||Jan 30, 1984||Jan 28, 1986||Budapesti Muszaki Egyetem||Panoramic imaging block for three-dimensional space|
|US4991955||Apr 6, 1990||Feb 12, 1991||Todd-Ao Corporation||Circular projection and display system using segmented trapezoidal screens|
|US5130794||Mar 29, 1990||Jul 14, 1992||Ritchey Kurtis J||Panoramic display system|
|US5264881||Jun 3, 1992||Nov 23, 1993||Hughes Training, Inc.||Split static surround display system|
|US5539483||Jun 30, 1995||Jul 23, 1996||At&T Corp.||Panoramic projection apparatus|
|US5563650||Nov 24, 1993||Oct 8, 1996||Geeris Holding Nederland B.V.||Method and device for producing panoramic images, and a method and device for consulting panoramic images|
|US5627675||May 13, 1995||May 6, 1997||Boeing North American Inc.||Optics assembly for observing a panoramic scene|
|US5920337||Dec 4, 1996||Jul 6, 1999||Siemens Corporate Research, Inc.||Omnidirectional visual image detector and processor|
|US6002430||May 27, 1997||Dec 14, 1999||Interactive Pictures Corporation||Method and apparatus for simultaneous capture of a spherical image|
|US6043837||May 8, 1997||Mar 28, 2000||Be Here Corporation||Method and apparatus for electronically distributing images from a panoptic camera system|
|US6118474||Dec 5, 1997||Sep 12, 2000||The Trustees Of Columbia University In The City Of New York||Omnidirectional imaging apparatus|
|US6141034||Dec 15, 1995||Oct 31, 2000||Immersive Media Co.||Immersive imaging method and apparatus|
|US6152739||Nov 20, 1998||Nov 28, 2000||Mcdonnell Douglas Corporation||Visual display system for producing a continuous virtual image|
|US6157018||Jun 29, 1998||Dec 5, 2000||Ishiguro; Hiroshi||Omni directional vision photograph device|
|US6337708||Apr 21, 2000||Jan 8, 2002||Be Here Corporation||Method and apparatus for electronically distributing motion panoramic images|
|US6341044||Oct 19, 1998||Jan 22, 2002||Be Here Corporation||Panoramic imaging arrangement|
|US6356297||Jan 15, 1998||Mar 12, 2002||International Business Machines Corporation||Method and apparatus for displaying panoramas with streaming video|
|US6409351 *||Feb 12, 2001||Jun 25, 2002||Thomas R. Ligon||Spherical image projection system using a convex reflecting image dispersing element|
|US6480229||Jul 17, 2000||Nov 12, 2002||Be Here Corporation||Panoramic camera|
|US6525725 *||Mar 15, 2000||Feb 25, 2003||Sun Microsystems, Inc.||Morphing decompression in a graphics system|
|US6563529||Oct 8, 1999||May 13, 2003||Jerry Jongerius||Interactive system for displaying detailed view and direction in panoramic images|
|US6644816 *||Jun 24, 1999||Nov 11, 2003||Evolution Technology N.V.||Display device having a cylindrical projection surface such that an image projected onto the inside is visible on the outside|
|US6802614 *||Nov 27, 2002||Oct 12, 2004||Robert C. Haldiman||System, method and apparatus for ambient video projection|
|US6809887 *||Jun 13, 2003||Oct 26, 2004||Vision Technologies, Inc||Apparatus and method for acquiring uniform-resolution panoramic images|
|US6939025 *||Jun 9, 2003||Sep 6, 2005||Delta Electronics, Inc.||Light consolidating system|
|US6941026 *||Jun 13, 2000||Sep 6, 2005||Cognex Corporation||Method and apparatus using intensity gradients for visual identification of 2D matrix symbols|
|US20010056574||Jun 25, 2001||Dec 27, 2001||Richards Angus Duncan||VTV system|
|US20020149752 *||Apr 12, 2002||Oct 17, 2002||Luc Courchesne||Panoramic and horizontally immersive image display system and method|
|US20030068068||Sep 28, 2001||Apr 10, 2003||Nam-Deuk Kim||Content based digital watermarking using wavelet based directionality measures|
|US20030095338||Oct 28, 2002||May 22, 2003||Sanjiv Singh||System and method for panoramic imaging|
|DE19500693A1 *||Jan 12, 1995||Jul 18, 1996||Bke Bildtechnik Inh Ernst Stec||Advertising or information display system|
|JPH10142553A||Title not available|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7352415 *||Mar 18, 2005||Apr 1, 2008||Geronimi Heather A||Electronic image display systems|
|US7422332 *||May 12, 2005||Sep 9, 2008||Sony Corporation||Wall structure|
|US7604354 *||May 10, 2006||Oct 20, 2009||Ligon Thomas R||Three-dimensional projection apparatus using coaxial optical alignment|
|US7701517||Mar 31, 2008||Apr 20, 2010||Dual Image Systems, Llc||Electronic image display systems|
|US8126286 *||Mar 19, 2009||Feb 28, 2012||Seiko Epson Corporation||Method for correcting distortion of image projected by projector, and projector|
|US8256904 *||May 23, 2008||Sep 4, 2012||Disney Enterprises, Inc.||Rear projected expressive head|
|US8272752 *||Aug 8, 2008||Sep 25, 2012||Universite Clermont 1||Panoramic projection device, and method implemented by this device|
|US8517543||Jul 23, 2012||Aug 27, 2013||Disney Enterprises, Inc.||Rear projected expressive head|
|US8562145 *||Jun 22, 2011||Oct 22, 2013||3M Innovative Properties Company||Display system and method for projection onto non-planar surfaces|
|US8593578||Feb 22, 2010||Nov 26, 2013||Heather A. Geronimi||Electronic image display systems|
|US20050219473 *||Mar 22, 2005||Oct 6, 2005||Yoshiyuki Moriyama||Advertising device|
|US20050264768 *||May 12, 2005||Dec 1, 2005||Tetsujiro Kondo||Wall structure|
|US20090245682 *||Mar 19, 2009||Oct 1, 2009||Seiko Epson Corporation||Method for correcting distortion of image projected by projector, and projector|
|US20100157258 *||Dec 4, 2009||Jun 24, 2010||Shen-Huei Wang||Projection display system|
|US20110211175 *||Aug 8, 2008||Sep 1, 2011||Robert Andre ,Marcel STEHLE||Panoramic projection device, and method implemented by this device|
|US20120327297 *||Dec 27, 2012||Roberts Ralph R||Display system and method for projection onto non-planar surfaces|
|US20140092366 *||Sep 28, 2012||Apr 3, 2014||Young Optics Inc.||Multi-projection system and display system using the same|
|US20140218695 *||Feb 1, 2013||Aug 7, 2014||3M Innovative Properties Company||Orthogonally disposed projection surfaces|
|U.S. Classification||353/99, 353/69, 348/E05.137, 348/36, 352/69, 359/834, 353/122, 359/449, 348/E09.025, 348/38, 348/840, 353/30, 353/37, 353/94, 359/460|
|International Classification||G03B21/14, G03B37/00, G03B21/26, H04N5/74, G03B21/56, G03B37/04, G09F19/18, G03B21/28, H04N9/31|
|Cooperative Classification||H04N5/74, G03B21/28, G03B37/04, G09F19/18, H04N9/31|
|European Classification||G03B37/04, H04N9/31, G03B21/28, G09F19/18, H04N5/74|
|Nov 4, 2003||AS||Assignment|
Owner name: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P., TEXAS
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MAY, GREGORY J.;REEL/FRAME:014686/0809
Effective date: 20031031
|Apr 12, 2010||FPAY||Fee payment|
Year of fee payment: 4
|May 23, 2014||REMI||Maintenance fee reminder mailed|
|Oct 10, 2014||LAPS||Lapse for failure to pay maintenance fees|
|Dec 2, 2014||FP||Expired due to failure to pay maintenance fee|
Effective date: 20141010