WO2012166593A3 - System and method for creating a navigable, panoramic three-dimensional virtual reality environment having ultra-wide field of view - Google Patents

System and method for creating a navigable, panoramic three-dimensional virtual reality environment having ultra-wide field of view Download PDF

Info

Publication number
WO2012166593A3
WO2012166593A3 PCT/US2012/039572 US2012039572W WO2012166593A3 WO 2012166593 A3 WO2012166593 A3 WO 2012166593A3 US 2012039572 W US2012039572 W US 2012039572W WO 2012166593 A3 WO2012166593 A3 WO 2012166593A3
Authority
WO
WIPO (PCT)
Prior art keywords
view
user
field
dimensional virtual
navigable
Prior art date
Application number
PCT/US2012/039572
Other languages
French (fr)
Other versions
WO2012166593A2 (en
Inventor
Thomas Seidl
Ron IGRA
Original Assignee
Thomas Seidl
Igra Ron
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomas Seidl, Igra Ron filed Critical Thomas Seidl
Publication of WO2012166593A2 publication Critical patent/WO2012166593A2/en
Publication of WO2012166593A3 publication Critical patent/WO2012166593A3/en
Priority to US14/090,132 priority Critical patent/US9007430B2/en
Priority to US14/685,234 priority patent/US9883174B2/en
Priority to US15/849,885 priority patent/US20180309982A1/en
Priority to US16/653,329 priority patent/US20200288113A1/en
Priority to US17/159,026 priority patent/US11528468B2/en
Priority to US17/985,225 priority patent/US20230328220A1/en

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image
    • G06T3/40—Scaling the whole image or part thereof
    • G06T3/4038—Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

The present invention relates to a system and method for capturing video of a real-world scene over a field of view that may exceed the field of view of a user, manipulating the captured video, and then stereoscopically displaying the manipulated image to the user in a head mounted display to create a virtual environment having length, width, and depth in the image. By capturing and manipulating video for a field of view that exceeds the field of view of the user, the system and method can quickly respond to movement by the user to update the display allowing the user to look and pan around, i.e., navigate, inside the three- dimensional virtual environment.
PCT/US2012/039572 2011-05-27 2012-05-25 System and method for creating a navigable, panoramic three-dimensional virtual reality environment having ultra-wide field of view WO2012166593A2 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US14/090,132 US9007430B2 (en) 2011-05-27 2013-11-26 System and method for creating a navigable, three-dimensional virtual reality environment having ultra-wide field of view
US14/685,234 US9883174B2 (en) 2011-05-27 2015-04-13 System and method for creating a navigable, three-dimensional virtual reality environment having ultra-wide field of view
US15/849,885 US20180309982A1 (en) 2011-05-27 2017-12-21 System and method for creating a navigable, three-dimensional virtual reality environment having ultra-wide field of view
US16/653,329 US20200288113A1 (en) 2011-05-27 2019-10-15 System and method for creating a navigable, three-dimensional virtual reality environment having ultra-wide field of view
US17/159,026 US11528468B2 (en) 2011-05-27 2021-01-26 System and method for creating a navigable, three-dimensional virtual reality environment having ultra-wide field of view
US17/985,225 US20230328220A1 (en) 2011-05-27 2022-11-11 System and method for creating a navigable, three-dimensional virtual reality environment having ultra-wide field of view

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201161490656P 2011-05-27 2011-05-27
US61/490,656 2011-05-27

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/090,132 Continuation US9007430B2 (en) 2011-05-27 2013-11-26 System and method for creating a navigable, three-dimensional virtual reality environment having ultra-wide field of view

Publications (2)

Publication Number Publication Date
WO2012166593A2 WO2012166593A2 (en) 2012-12-06
WO2012166593A3 true WO2012166593A3 (en) 2013-04-04

Family

ID=47260214

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2012/039572 WO2012166593A2 (en) 2011-05-27 2012-05-25 System and method for creating a navigable, panoramic three-dimensional virtual reality environment having ultra-wide field of view

Country Status (1)

Country Link
WO (1) WO2012166593A2 (en)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB201305402D0 (en) * 2013-03-25 2013-05-08 Sony Comp Entertainment Europe Head mountable display
GB201310367D0 (en) 2013-06-11 2013-07-24 Sony Comp Entertainment Europe Head-mountable apparatus and systems
NL2012462B1 (en) 2014-03-18 2015-12-15 Avinash Jayanth Changa Anand Encoding and decoding of three-dimensional image data.
GB2526263B (en) * 2014-05-08 2019-02-06 Sony Interactive Entertainment Europe Ltd Image capture method and apparatus
US9773350B1 (en) 2014-09-16 2017-09-26 SilVR Thread, Inc. Systems and methods for greater than 360 degree capture for virtual reality
GB2534921B (en) * 2015-02-06 2021-11-17 Sony Interactive Entertainment Inc Head-mountable display system
US9897806B2 (en) * 2015-02-10 2018-02-20 Dreamworks Animation L.L.C. Generation of three-dimensional imagery to supplement existing content
US9721385B2 (en) 2015-02-10 2017-08-01 Dreamworks Animation Llc Generation of three-dimensional imagery from a two-dimensional image using a depth map
US11663937B2 (en) 2016-02-22 2023-05-30 Real View Imaging Ltd. Pupil tracking in an image display system
WO2017145155A1 (en) 2016-02-22 2017-08-31 Real View Imaging Ltd. A method and system for displaying holographic images within a real object
WO2017145158A1 (en) 2016-02-22 2017-08-31 Real View Imaging Ltd. Zero order blocking and diverging for holographic imaging
WO2017145154A1 (en) 2016-02-22 2017-08-31 Real View Imaging Ltd. Wide field of view hybrid holographic display
CN107844190B (en) * 2016-09-20 2020-11-06 腾讯科技（深圳）有限公司 Image display method and device based on virtual reality VR equipment
CN106899841A (en) * 2017-02-13 2017-06-27 广东欧珀移动通信有限公司 The display methods of picture, device and computer equipment
CN109300182B (en) * 2017-07-25 2023-08-01 中国移动通信有限公司研究院 Panoramic image data processing method, processing device and storage medium
JP2020521348A (en) * 2017-10-24 2020-07-16 エルジー エレクトロニクス インコーポレイティド Method and apparatus for transmitting and receiving 360 degree video containing fisheye video information
CN115639976B (en) * 2022-10-28 2024-01-30 深圳市数聚能源科技有限公司 Multi-mode multi-angle synchronous display method and system for virtual reality content

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090009522A1 (en) * 2002-01-15 2009-01-08 Canon Kabushiki Kaisha Information processing apparatus and method
US20100259619A1 (en) * 2009-04-10 2010-10-14 Nicholson Timothy J Hmd with elevated camera
JP2010256534A (en) * 2009-04-23 2010-11-11 Fujifilm Corp Head-mounted display for omnidirectional image display
US20110112934A1 (en) * 2008-06-10 2011-05-12 Junichi Ishihara Sensory three-dimensional virtual real space system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090009522A1 (en) * 2002-01-15 2009-01-08 Canon Kabushiki Kaisha Information processing apparatus and method
US20110112934A1 (en) * 2008-06-10 2011-05-12 Junichi Ishihara Sensory three-dimensional virtual real space system
US20100259619A1 (en) * 2009-04-10 2010-10-14 Nicholson Timothy J Hmd with elevated camera
JP2010256534A (en) * 2009-04-23 2010-11-11 Fujifilm Corp Head-mounted display for omnidirectional image display

Also Published As

Publication number Publication date
WO2012166593A2 (en) 2012-12-06

Similar Documents

Publication Publication Date Title
WO2012166593A3 (en) System and method for creating a navigable, panoramic three-dimensional virtual reality environment having ultra-wide field of view
EP2395763A3 (en) Storage medium having stored therein stereoscopic image display program, stereoscopic image display device, stereoscopic image display system, and stereoscopic image display method
EP3432780A4 (en) Virtual reality or augmented reality visualization of 3d medical images
EP3262464A4 (en) Lidar stereo fusion live action 3d model virtual reality video
EP3855288C0 (en) Spatial relationships for integration of visual images of physical environment into virtual reality
EP3665653A4 (en) Techniques for rendering three-dimensional animated graphics from video
GB2561746B (en) Video sensor fusion and model based virtual and augmented reality systems and methods
EP4295801A3 (en) Virtual reality surgical device
EP3292431A4 (en) Separated pupil optical systems for virtual and augmented reality and methods for displaying images using same
WO2012082807A3 (en) Optimized focal area for augmented reality displays
WO2016154123A3 (en) Virtual 3d methods, systems and software
WO2013169601A3 (en) Method to generate virtual display surfaces from video imagery of road based scenery
EP3007038A3 (en) Interaction with three-dimensional video
WO2015033253A3 (en) Generating a 3d interactive immersive experience from a 2d static image
EP2469871A3 (en) Image display device, method and program
EP3096675A4 (en) Method and system for eliminating image motion blur in a multiple viewing elements endoscope
EP2493202A3 (en) Display control program, display control apparatus, display control system, and display control method
WO2012018485A3 (en) 3-d model view manipulation apparatus
WO2014160983A3 (en) Compact multi-viewing element endoscope system
WO2017184251A3 (en) Selecting portions of vehicle-captured video to use for display
WO2011162974A3 (en) Natural user input for driving interactive stories
WO2011060561A3 (en) Transparent autostereoscopic image display apparatus and method
IN2015DN02252A (en)
WO2014055908A3 (en) Methods and systems for establishing parameters, playback, and artifact removal three-dimensional imaging
EP3593530A4 (en) Method to control a virtual image in a display

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12792953

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 07/04/2014)

122 Ep: pct application non-entry in european phase

Ref document number: 12792953

Country of ref document: EP

Kind code of ref document: A2