WO2014043196A1 - Ergonomic head mounted display device and optical system - Google Patents
Ergonomic head mounted display device and optical system Download PDFInfo
- Publication number
- WO2014043196A1 WO2014043196A1 PCT/US2013/059207 US2013059207W WO2014043196A1 WO 2014043196 A1 WO2014043196 A1 WO 2014043196A1 US 2013059207 W US2013059207 W US 2013059207W WO 2014043196 A1 WO2014043196 A1 WO 2014043196A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- optical waveguide
- waveguide prism
- major surface
- image display
- display system
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0025—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/011—Head-up displays characterised by optical features comprising device for correcting geometrical aberrations, distortion
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0123—Head-up displays characterised by optical features comprising devices increasing the field of view
Definitions
- the present application relates generally to an optical see-through head-mounted display (OST-HMD) device, and more particularly, to
- Head-mounted displays have long been proven invaluable for many applications, spanning the fields of scientific visualization, medicine and military training, engineering design and prototyping, tele-manipulation and tele-presence, and personal entertainment systems.
- optical see-through HMDs are one of the basic approaches to combining computer-generated virtual scene with the views of a real-world scene.
- an OST-HMD optically overlays computer-generated images onto the real-world view while maintaining a direct, minimally-degraded view of the real world.
- An OST-HMD has a great potential for creating a mobile display solution that offers much more attractive image quality and screen size than other popular mobile platforms such as smart phones and PDAs.
- This application concerns an ergonomic optical see-through head mounted display (OST-HMD) device with an eyeglass-form appearance and freeform optical systems for use as an optical viewing device in such display devices.
- the optical viewing device in an OST-HMD typically provides an optical path for viewing a displayed virtual image and a see-through path for directly viewing a real-world scene.
- the virtual image path may include a miniature image display unit to supply display content and an ergonomically- shaped display viewing optics through which a user views a magnified image of the displayed content.
- the display viewing optics includes a light guiding device (referred to hereafter as a freeform waveguide prism) containing multiple freeform refractive and reflective surfaces.
- the display viewing optics may also include additional coupling optics to properly inject light from the image display device into the waveguide prism.
- the location and shape of the freeform surfaces and the coupling optics are sized, dimensioned, positioned and/or oriented such that a viewer is able to see a clear, magnified image of the displayed content.
- the see-through path of the head-mounted display device is provided by the waveguide prism and a freeform see-through compensation lens positioned ⁇ e.g., attached to) outwardly of an exterior surface of the prism.
- the see-through compensation lens contains multiple freeform refractive surfaces, and enables proper viewing of the surrounding environment across a very wide see-through field of view.
- the waveguide prism and the see-through compensation lens are sized, dimensioned, positioned and/or oriented to ergonomically fit with the ergonomic factors of the human heads enabling a wrap-around design of a lightweight, compact, and see-through display system which has an eyeglass-form appearance, wide see-through field of view, and superior optical performance.
- freeform optical systems for use as an optical viewing device in an ergonomic head mounted display device are described herein. At least some of the freeform optical systems described herein are optimized to provide ergonomically shaped viewing optics that fit with the ergonomic factors of the human head, allowing them to be wrapped around a human face and present an eyeglass-like appearance instead of helmet-like appearance in prior HMD designs. Various embodiments also offer a see- through capability, allowing a user to view the surrounding environment through the viewing optics, as well as the displayed content on an image display device. At least some embodiments offer a see-through FOV that may be considerably larger than the FOV of the virtual view.
- the virtual image path of the OST-HMD device may include a miniature image display unit for supplying display content and an
- the display viewing optics may include a freeform waveguide prism containing or having multiple freeform refractive and reflective surfaces.
- the display viewing optics may also include additional coupling optics.
- the waveguide prism serves as a near-eye viewing optic that magnifies the image on a miniature image display device. Light rays emanating from the image display unit are injected into the waveguide prism via the first refractive surface of the prism. The rays may be injected into the prism directly from the display device or through one or more coupling lenses.
- the injected rays propagate through the waveguide prism via multiple reflections (typically 3 or more) and are then coupled out of the prism via the second refractive surface of the prism.
- the outgoing rays continue propagating and reach the exit pupil of the system.
- the exit pupil may be the location at which a user places her/his eye to view the virtual content.
- TIR Total Internal Reflection
- a semi-transparent coating is applied on these surfaces.
- the semi-transparent coating ensures that sufficient light from the miniature display unit reaches the exit pupil to produce a bright image, while facilitating the optical see-through capability.
- a high-reflection mirror coating can be applied on these surfaces to minimize light loss.
- the miniature image display unit can be any type of self-emissive or illuminated pixel arrays that can serve as an image source, including, but not limited to, a liquid crystal on silicon (LCoS) display device, a liquid crystal display (LCD) panel, an organic light emitting display (OLED), Ferroelectric liquid crystal on silicon (FLCoS) device, digital mirror device (DMD), or a micro- projector built upon these aforementioned or other types of micro-display devices.
- LCD liquid crystal on silicon
- OLED organic light emitting display
- FLCoS Ferroelectric liquid crystal on silicon
- DMD digital mirror device
- the see-through path of the head- mounted display device is formed at least in part by the freeform waveguide prism and a freeform see-through compensation lens.
- the compensation lens is positioned ⁇ e.g., attached to) outwardly of the physical outer surface of the waveguide prism in order to counteract or accommodate for ray shift and/or distortion caused by the waveguide prism and to maintain a clear see-through view of a real-world scene.
- the compensation lens may include multiple (typically 2 or more) freeform refractive surfaces, enables proper viewing of the surrounding environment across a very wide field of view.
- the surfaces of the compensation lens may be optimized to minimize any shift and/or distortion of rays from a real-world scene when the lens is combined with the waveguide prism. If the reflection on the attached surfaces of the waveguide prism is to satisfy a TIR condition in the virtual image display path, it is necessary to maintain a small gap ⁇ e.g., air gap) between the waveguide prism and the compensation lens.
- Various embodiments utilize multiple reflections to extend the optical path length, so that a width of the waveguide prism closely matches with a width of an average human head ⁇ e.g., interpupillary distance).
- the long optical path facilitates the ergonomic design of the waveguide prism, as well as maintaining a large see-through FOV.
- the long optical path of the prism also allows placement of the image display unit to a side of the display frame, reducing a front weight of the HMD system and improving ergonomic fit of the system.
- a shape of the waveguide prism, and shape of the optical viewing device as a whole can be designed to approximate the natural curve of the human head for optimal ergonomic fit.
- the prism shape in some embodiments is curved to approximate a curvature of a pair of 8-base curve eyeglasses.
- the prism shape in some other embodiments approximately follows the form factor of a pair of 4-base curve eyeglasses.
- the overall thickness of the waveguide prism and the compensation lens is deliberately controlled to achieve a thin optical or optics profile (typically less than 30mm). Overall, the deliberately controlled waveguide prism shapes, long optical path, and optics thickness enable a wraparound design of optical see-through HMDs that offers ergonomic fit with the human head and attractive eyeglass-like appearance.
- At least some embodiments provide a very large see-through field of view, typically much larger than the FOV of the virtual display.
- This capability is enabled by several mechanisms. For instance, moving the image display device may be located or positioned to a side (e.g., left side, right side) of the head to extend the clear optical aperture of the waveguide prism. Also for instance, the freeform surfaces on the waveguide prism may be deliberately controlled. Additionally, or alternatively, a compensation lens may be employed to correct ray shifts and/or distortions and ensure high see-through
- the see- through FOV extends as large as 120-degrees in the horizontal direction and 80-degrees in the vertical direction.
- the see- through FOV can be extended to match the field of view of human eyes.
- the rays from the same point on the image display device will cross at least once inside the waveguide prism. Consequently, an intermediate image of the virtual display will be formed inside the waveguide prism. Such will be true even though the ray cross point may not be well formed and the cross points for different image points of the microdisplay usually do not form an image inside the waveguide prism.
- adjustable focusing optics to adjust a focal plane of the system. The adjustable focusing optics enable a focus of the HMD viewing system to be changed according to application needs.
- the focus may be selectively adjusted to a close range when the system is used for reading books.
- the focus may be selectively adjusted to an intermediate range when the system is used for watching movies.
- the focus may be selectively adjusted to a far distance when the system is used for guiding a driver of a vehicle.
- the adjustable focusing optics can take the form of, for example, a liquid lens or the like which allows adjustment or change of the focal plane in real time.
- At least some embodiments create multiple focal planes in sequence by adjusting focus in a very fast speed, which adds the capability of creating multiple focal planes in the system.
- content can be rendered in such a way that the system may operate substantially free of convergence and accommodation conflict issues.
- An image display system may be summarized as including a freeform optical waveguide prism having a first major surface and a second major surface, the first major surface of the optical waveguide prism which in use is positioned to at least one of receive actively projected images into the optical waveguide prism from an active image source or emit the actively projected images out of the optical waveguide prism and the second major surface of the optical waveguide prism which in use is positioned to receive images of a real-world ambient environment into the optical waveguide prism, which real-world ambient environment is external to the image display system, at least some portions of the first and the second major surfaces of the optical waveguide prism being refractive surfaces that internally propagate light entering the optical waveguide prism at angles less than a critical angle along at least a portion of a length of the optical waveguide prism; and a freeform compensation lens having a first major surface and a second major surface, the first major surface of the compensation lens having a shape that at least approximately matches a shape of the second major surface of the optical waveguide prism, the freeform compensation
- the refractive surfaces may internally propagate light entering the optical waveguide prism at angles less than the critical angle along at least the portion of the length of the optical waveguide prism via total internal reflection. At least a portion of at least one of the first or the second major surfaces of the optical waveguide prism may bear a semi-transparent, partially reflective material.
- the optical waveguide prism may have a peripheral edge extending between the first and the second major surfaces of the optical waveguide prism and which may retain at least a portion of light within the optical waveguide prism.
- the gap between the first major surface of the compensation lens and the second major surface of the optical waveguide prism may be a small gap.
- the gap between the first major surface of the compensation lens and the second major surface of the optical waveguide prism may have a width that increases from at least proximate an entry location at which actively projected images enter into the optical waveguide prism to at least proximate an exit location at which exits the actively projected images exit the optical waveguide prism.
- the optical waveguide prism and the compensation lens may focus images of the real-world ambient environment to a foci that is coincident with actively projected images which exit the optical waveguide prism via an exit location on the first major surface of the optical waveguide prism.
- the exit location on the first major surface of the optical waveguide prism may be spaced along a length of the optical waveguide prism from an entry location on the first major surface of the optical waveguide prism at which actively projected images enter into the optical waveguide prism.
- the compensation lens may compensate for ray shift and distortion of the images of the real-world ambient environment caused by the optical waveguide prism. Rays of light forming the actively projected images may cross and form an intermediate image inside the optical waveguide prism.
- the image display system may further include an image display unit positioned and oriented to provide images into the optical waveguide prism.
- the image display system may further include at least one coupling lens that guides light from the image display unit into the optical waveguide prism and corrects for optical aberrations.
- the image display unit may be at least one of a self-emissive pixel array or an illuminated pixel array.
- the image display unit may be selected from the group consisting of: a liquid crystal on silicon (LCoS) display device, a liquid crystal display (LCD) panel, an organic light emitting display (OLED), ferroelectric liquid crystal on silicon (LCoS device, digital mirror device (DMD), and a micro-projector.
- the image display system may further include a matching cement received in the gap, securely coupling the compensating lens to the optical waveguide prism.
- An image display system may be summarized as including a freeform optical waveguide prism of a material having an index greater than one, a first major surface, a second major surface, and a peripheral edge that extends between a perimeter of the first major surface and a perimeter of the second major surface of the optical waveguide prism, the optical waveguide prism having an entry location on the first major surface of the optical waveguide prism at which actively projected images at least than a critical angle enter into the optical waveguide prism and an exit location on the first major surface of the optical waveguide prism at which the actively projected images exit the optical waveguide prism after a plurality of internal reflections along an optical path within the optical waveguide prism, the exit location is spaced along a length of the optical waveguide prism from the entry location.
- At least some portions of the first and the second major surfaces of the optical waveguide prism may be refractive surfaces that internally propagate light entering the optical waveguide prism at angles less than a critical angle along at least a portion of a length of the optical waveguide prism via total internal reflection. At least a portion of at least one of the first or the second major surfaces of the optical waveguide prism may bear a semi- transparent, partially reflective material.
- the first major surface of the optical waveguide prism may be positioned to receive actively projected images into the optical waveguide prism from an active image source and the second major surface of the optical waveguide prism may be positioned to receive images of a real-world ambient environment into the optical waveguide prism, which real- world ambient environment is external to the image display system.
- the image display system may further include a freeform compensation lens having a first major surface and a second major surface, the first major surface of the compensation lens having a shape that at least approximately matches a shape of the second major surface of the optical waveguide prism, the freeform compensation lens positioned relatively outwardly of the second major surface of the optical waveguide prism toward the real-world ambient environment to form a gap between the first major surface of the compensation lens and the second major surface of the optical waveguide prism.
- a shape, an optical path length, and a thickness of the optical waveguide prism may be optimized for a wrapped-around design that ergonomic fits a human head.
- a width of the optical waveguide prism may at least approximately fit a width of an average human head.
- the first major surface of the optical waveguide prism may be curved about an axis.
- Each point on the second major surface of the optical waveguide prism may be no greater than 30mm of a corresponding point on the first major surface of the optical waveguide prism.
- Each point on the second major surface of the optical waveguide prism may be no greater than 12mm of a corresponding point on the first major surface of the optical waveguide prism.
- the second major surface of the optical waveguide prism may include a plurality of surface segments, each surface segment having a unique set of parameters.
- the image display system may further include an image display unit positioned and oriented to provide images into the optical waveguide prism; and at least one adjustable coupling lens that guides light from the image display unit into the optical waveguide prism and corrects for optical
- a freeform compensation lens for use in an image display system along with a freeform optical waveguide prism having a first major surface and a second major surface may be summarized as including a first major surface; a second major surface; and an interior space between the first and the second major surfaces of the compensation lens comprising a refractive medium having an index greater than one.
- the compensation lens may be physically coupled to the optical waveguide prism spaced relatively outwardly of the second major surface of the optical waveguide prism toward a real-world ambient environment with a gap between the first major surface of the compensation lens and the second major surface of the optical waveguide prism.
- compensation lens may have a shape that approximately matches a shape of the second major surface of the optical waveguide prism.
- Each point on the first major surface of the optical waveguide prism may be no greater than 30mm of a corresponding point on the second major surface of the optical waveguide prism.
- Each point on the first major surface of the optical waveguide prism may be no greater than 30mm of a corresponding point on the second major surface of the optical waveguide prism.
- waveguide prism may be no greater than 12mm of a corresponding point on the second major surface of the optical waveguide prism.
- Figure 1 is a schematic diagram of an optical system, for example an image display system, according to at least one illustrated embodiment of the present invention.
- Figure 2 is a schematic diagram of a portion of the optical system of Figure 1 , showing a 3-reflection embodiment of an optical waveguide prism, which approximates an 8-base curve wraparound appearance, according to at least one illustrated embodiment.
- inventions generally relate to ergonomically designed freeform optical systems for use as an optical viewing device in optical see-through HMDs with an eyeglass-form appearance and a wide see- through field of view (FOV).
- Figure 1 shows an optical system in the form of an image display system which projects displayed virtual images into the user's eye pupil through a freeform optical waveguide prism while allowing the user to see displayed or projected content overlaid upon a real world scene.
- the display system may include an image display unit 105.
- the image display unit 105 may take the form of a miniature image display unit, and serves as an image source, projecting light into a freeform optical waveguide prism 100.
- the display system may optionally include a lens group 1 10.
- the lens group 1 10 includes one or more lenses that guide light from the display unit 105 into the freeform optical waveguide prism 100 and correct for optical aberrations.
- the freeform optical waveguide prism 100 may be transparent, and as described herein, accepts the light from the display unit 105 and propagates the light until the image is projected into the user's eye pupil.
- the optical waveguide prism 100 also allows the light from a real-world scene to pass through and enter the user's eye pupil.
- the optical waveguide prism 100 has a physical inner or first major surface 1 15, physical peripheral edge or surface 120 and physical outer or second major surface 125. At least some portions of the first and/or the second major surfaces 1 15, 125 are refractive, for example a first refractive surface portion 130, and a second refractive surface portion 135. At least some portions of the first and/or the second major surfaces 1 15, 125 are reflective surfaces.
- the display system may include a freeform compensation lens
- the freeform compensation lens 160 is positioned outwardly toward an ambient environment with respect to the optical waveguide prism 100.
- the compensation lens 160 may be physically coupled to the optical waveguide prism 100, for example, secured to the physical outer or second major surface 125 of the optical waveguide prism 100.
- compensation lens 160 corrects for optical distortion caused by viewing the real world through the optical waveguide prism.
- An inner physical or first major surface 165 of the compensation lens 160 has a shape which at least approximately matches a shape of the outer physical or second major surface 125 of the waveguide prism 100.
- the inner physical or first major surface 165 of the compensation lens 160 is spaced from the outer physical or second major surface 125 of the waveguide prism 100 to define a small gap 195 between the waveguide 100 and the compensation lens 160, at least on surfaces where the TIR criterion is satisfied for the outer physical or second major surface 125 of the optical waveguide prism 100.
- the compensation lens 160 is designed to compensate for the effect of ray shift and distortion caused by the optical waveguide prism 100 so that the user maintains a clear see- through field of view 190.
- the image display unit 105 can be any type of self-emissive or illuminated pixel arrays that can serve as an image source.
- the image display unit may take the form of, for example but not limited to, a liquid crystal on silicon (LCoS) display device, a liquid crystal display (LCD) panel, an organic light emitting display (OLED), ferroelectric liquid crystal on silicon (LCoS device, digital mirror device (DMD), or a micro-projector built upon these aforementioned or other types of micro-display devices.
- the image display unit 105 transmits light 140 into the optional coupling lens 1 10 followed by the optical waveguide prism 100 or into the optical waveguide prism 100 directly, through a first refractive surface 130.
- the light 140 follows an optical path 145 along a length of the optical waveguide prism 100, that comprises a plurality of reflections from the first refractive surface 130 to the second refractive surface 135.
- the rays of the light 140 following the optical path 145 along the length of the optical waveguide prism may cross and form an intermediate image 155 inside the optical waveguide prism 100.
- the light 140 subsequently passes through the second refractive surface 135, beyond which where the user places his or her pupil 150 to view the image.
- the light from the real-world scene 198 passes through the compensation lens 160 and the optical waveguide prism 100 before reaching the pupil 150.
- the device may advantageously employ an ergonomically shaped freeform optical waveguide prism 100, which enables an image to be projected into one refractive input surface of the prism, which is then reflected and refracted until the image reaches the user's eye.
- the shape, optical path length, and thickness of the optical waveguide prism 100 are deliberately optimized, enabling a wrapped-around design of optical see-through HMDs that offer ergonomic fit with the human head and attractive eyeglass-like
- the freeform optical waveguide prism comprises at least three physical surfaces each of which contains a plurality of reflective and refractive optical surfaces disposed upon the physical surfaces.
- the interior space of the physical surfaces is filled by a refractive medium having an index (n) greater than 1 .
- the physical and optical surfaces may include one or more of: a physical inner or first major surface 1 15, physical outer or second major surface 125, physical edge surface 120.
- the physical inner or first major surface 1 15 and/or physical outer or second major surface 125 may include a refractive input surface portion 130, a refractive output surface portion 135, and/or plurality of reflective surface portions.
- the physical inner or first major surface 1 15 is disposed inwardly, towards the eyeball of the user or foci point of the device.
- the physical inner or first major surface 1 15 includes a plurality of reflective and refractive surface portions appropriate to propagating an image to the eyeball of the user via internal reflection in the optical waveguide prism 100.
- the optical waveguide prism 100 is constrained to fit the ergonomic factors of the human head.
- the physical outer or second major surface 125 is disposed outwardly, towards an external scene or real world ambient environment.
- the physical outer or second major surface 125 includes a plurality of reflective surface portions appropriate to reflecting an image to the eyeball of the user.
- the physical outer or second major surface 125 is within typically 30mm of the inner or first major surface 1 15 at all points.
- the physical outer or second major surface 125 includes at least one refractive surface that allows light from the external scene or real world ambient environment to pass through the optical waveguide prism 100 and reach the eyeball of the user.
- the physical edge surface 120 may potentially contain a refractive surface.
- the refractive surface may, for example, allow light from an image display unit to enter the waveguide.
- the refractive input surface portion 130 is disposed on or constitute one of the physical surfaces.
- the refractive input surface portion 130 may allow light from an image display unit to enter the waveguide.
- the refractive output surface portion 135 allows light to exit the optical waveguide prism 100.
- the refractive output surface portion 135 is disposed upon or constitute the physical inner or first major surface, near the pupil of the user.
- the refractive surface portion may, or may not, be covered by a semi-transparent coating.
- the plurality of reflective surface portions are disposed upon or constitute the physical inner or first major surface and outer or second major surface. Each reflection is produced by either satisfying the TIR condition, or by the application of a semi-transparent, partially reflective coating to at least a portion of a surface of the optical waveguide prism 100.
- the light 140 from an image display unit 105 enters the optical waveguide prism 100, through a first refractive surface 130.
- the light 140 follows an optical path 145 along a length of the optical waveguide prism 100.
- the optical path 145 includes a plurality of reflections, upon the plurality of reflective surface portions, for example from the first refractive surface portion 130 to the second refractive surface portion 135.
- each reflection is produced either by satisfying conditions of Total Internal Reflection, or by the application of a semi-transparent coating to the surface.
- the light 140 passes through the second refractive surface portion135, beyond which where the user places his or her pupil 150 to view the image.
- the inner or first major surface 1 15 and the outer or second major surface 125 of the optical waveguide prism 100 is appropriately designed to produce a plurality of reflections that guide light towards the user's pupil without distorting the image.
- the plurality of reflections extends the optical path length so that the width of the optical waveguide prism 100 closely fits with a width of an average human head.
- the relatively long optical path length enables the design of the optical waveguide prism into an ergonomic shape.
- waveguide 100 further allows locating or positioning the image display unit 105 to a side of the display frame. Such may advantageously reduce a front weight of the HMD system and improve the ergonomic fit of the resulting system.
- the inner or first major surface 1 15 is constrained to approximate a pre-designated curved surface for the desired eyeglass form factor.
- the outer or second major surface 125 is further constrained to achieve a thin profile with a thickness of typically no more than 30mm between the inner or first major surface 1 15 and outer or second major surface 125.
- an overall thickness between the inner or first major surface 1 15 and outer or second major surface 125 was constrained to be no more than 12mm.
- the parameters of the inner or first major surface 1 15 and the outer or second major surface 125 of the optical waveguide prism 100 are hence optimized, the image to be projected having minimal distortion at an exit point or location of the optical waveguide prism 100.
- the inner or first major surface 1 15 of the optical waveguide prism 100 may contain multiple surface segments; each surface segment described by one unique set of parameters.
- the outer or second major surface 125 of the optical waveguide prism 100 may contain multiple surface segments; each surface segment described by one unique set of parameters.
- a coupling lens 1 10 may be added between the miniature image display unit 105 and the first refractive surface portion 130 of the optical waveguide prism 100, facilitating transmission of the light from the display unit 105 into the optical waveguide prism 100.
- the coupling lens 1 10 may, for example, be used to correct for optical aberrations of the optical waveguide prism 100.
- the freeform see-through compensation lens 160 may be physically attached to the optical waveguide prism 100.
- the compensation lens 160 is designed to counteract the ray shift and distortion caused by the optical waveguide prism 100, enabling a clear see-through view of a real-world scene across a wide field of view.
- the freeform compensation lens 160 includes multiple (typically 2 or more) freeform refractive surfaces.
- An interior space between the refractive surfaces of the compensation lens 160 is filled by a refractive medium having an index (n) greater than 1 .
- the optical surfaces of the compensation lens 160 may include: a refractive inner or first major surface 165 and a refractive outer or second major surface 170.
- the refractive outer or second major surface 170 is disposed outwardly, towards the external scene.
- the refractive outer or second major surface 170 allows light 198 from the external scene to enter the compensation lens 160.
- the refractive outer or second major surface 170 is typically a continuous, single refractive surface.
- the refractive outer or second major surface 170 is within typically 30mm of the physical inner surface 1 15 of the optical waveguide prism 100 at all points.
- the refractive inner or first major surface 165 is disposed towards the outer or second major surface 125 of the optical waveguide prism 100.
- the refractive inner or first major surface 165 allows light to exit the compensation lens 160, and enter into the optical waveguide prism 100.
- the refractive inner or first major surface 165 may include a plurality of refractive surface portions.
- the refractive inner or first major surface 165 is typically constrained to approximate or match a shape of the outer or second major surface 125 of the optical waveguide prism 100.
- light from the real-world scene 198 is in turn refracted through the refractive outer surface 170 and the refractive inner surface 165 of compensation lens 160, the physical outer surface 125 and the physical inner surface 1 15 of the optical waveguide prism 100, before reaching the pupil 150.
- the compensation lens 160 and the optical waveguide prism 100 are deliberately optimized together to enable proper viewing of the surrounding environment across a very wide field of view 190.
- the inner surface 165 and outer surface 170 of the compensation lens 160 are optimized to minimize the shift and distortion introduced to the rays from a real-world scene when the compensation lens 160 is combined with the waveguide prism 100.
- the inner surface 165 of the compensation lens 160 could be an exact duplicate of the outer surface 125 of the waveguide prism 100 with a small off-set along the z axis.
- the index matching glue can fill in what would otherwise be the air gap 195, to cement the compensation lens 160 with the waveguide prism 100.
- the inner surface 165 of the compensation lens 160 can also be redesigned along with the outer surface 170 of the compensation lens 160 for better see-through performance.
- the gap 195 between the optical waveguide prism 100 and the compensation lens 160 may be constrained to be less than 6mm at any points along the surfaces.
- the outer surface 170 is further constrained to limit an overall thickness of the optical waveguide prism 100 and the
- compensation lens 160 to be typically no more than 30mm. In at least some embodiments, the overall thickness of the optical waveguide prism 100 and compensation lens 160 is constrained to be no more than 15mm. Both the inner surface 165 and the outer surface 170 of the compensation lens 160 should be sufficiently large for the designated see-through FOV 190.
- the shape and the thickness of the compensation lens 160 are deliberately optimized, enabling a wrapped-around design of optical see-through HMDs that offer ergonomic fit with the human head and attractive eyeglass-like
- the inner and outer surfaces of the compensation lens 160 and waveguide prism 100 are sufficiently large to enable a wide see-through field of view 190 as large as the visual field of the human eye, for example, relative to the center of the field of view, up to 90° on the temple side and 60° on the nasal side in the horizontal direction, and up to 60° superiorly and inferiorly in the vertical direction.
- the freeform surfaces on the optical waveguide prism 100 and compensation lens 160 are optimized to correct ray shifts and distortions to ensure high see-through performance across a large FOV.
- All the above mentioned surfaces are free-form surfaces, including, but not limited to, spherical, aspheric, anamorphic aspheric, XYP polynomial or any other types of mathematical prescriptions, which is
- the teachings herein may advantageously provide freeform optical systems for use as an optical viewing device in optical see-through HMDs, achieving an eyeglass-form appearance and a wide see-through field of view (FOV).
- designing the waveguide prism may include optimizing the parameters of each individual surface to minimize proper optical error function, for example, wavefront error or system modulation transfer functions (MTF).
- MTF system modulation transfer functions
- the optical waveguide prism 100 illustrated in Figure 1 contains multiple freeform surfaces which offer more design freedom than that of the traditional rotationally symmetric optical surfaces. Therefore, the freeform design approach allows the design of optical viewing devices with better optical performance and ergonomic fit. Such may be achieved while using fewer surfaces as compared with optical viewing devices of the similar specifications that use the traditional rotationally symmetric optical surfaces. However, proper constraints must be applied on all of the surfaces in order to have a valid design of the optical waveguide prism, while maintaining a desired form factor and providing a large see-through FOV.
- Figure 2 shows a 3-reflection embodiment of the optical waveguide prism 200, according to one illustrated embodiment with an 8-base curve wraparound appearance.
- This embodiment can be used to implement an HMD system with an 8-base curve wraparound form factor.
- an inner physical or first major surface 215 and the outer physical or second major surface 225 of the optical waveguide prism 200 are two continuous, smooth surfaces, each of which are described by a set of freeform surface parameters.
- a refractive surface portion 230 of the optical waveguide prism 200 is not a part of the inner surface 215, and is described by a different set of surface parameters.
- a micro-display panel 205 can be either a reflective type micro-display (e.g., LCoS, FLCoS, or DMD panels) or a transmissive type micro-display (e.g., LCD panel) or a self-emissive type micro-display (e.g., OLED panel).
- a reflective type micro-display panel e.g., LCoS, FLCoS, or DMD panels
- a transmissive type micro-display e.g., LCD panel
- a self-emissive type micro-display e.g., OLED panel
- a coupling lens 210 is used to help correct optical aberrations and improve image qualities.
- the ray bundles 240a, 240b and 240c originated from three different pixels on the micro-display 205 enter the optical waveguide prism 200 through the refractive surface 230, are reflected three times by the inner surfaces 215 and the outer surface 225, and are then transmitted through the refractive surface 235 to reach the exit pupil 250.
- the reflections R1 and R2 satisfy the TIR condition and the reflection R3 on the outer surface 225 does not satisfy the TIR condition.
- a semi-transparent coating is applied on at least a corresponding portion of the outer surface 225.
- a dielectric coating is preferred. Inside the optical waveguide prism 200, the ray bundles 240a, 240b and 240c are refocused and form intermediate images 255a, 255b and 255c, respectively.
- the coupling lens 1 10 in Figure 1 is replaced with a liquid lens or a lens group containing a liquid lens.
- the coupling lens can be replaced by a liquid lens or a group of lens containing a liquid lens to adjust the focusing.
Abstract
Description
Claims
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA2884663A CA2884663A1 (en) | 2012-09-11 | 2013-09-11 | Ergonomic head mounted display device and optical system |
EP13836713.1A EP2895910A4 (en) | 2012-09-11 | 2013-09-11 | Ergonomic head mounted display device and optical system |
CN201380058207.8A CN104813218A (en) | 2012-09-11 | 2013-09-11 | Ergonomic head mounted display device and optical system |
KR1020157009177A KR20150054967A (en) | 2012-09-11 | 2013-09-11 | Ergonomic head mounted display device and optical system |
AU2013315607A AU2013315607A1 (en) | 2012-09-11 | 2013-09-11 | Ergonomic head mounted display device and optical system |
JP2015531334A JP2015534108A (en) | 2012-09-11 | 2013-09-11 | Ergonomic head mounted display device and optical system |
IL237667A IL237667A0 (en) | 2012-09-11 | 2015-03-11 | Ergonomic head mounted display device and optical system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261699565P | 2012-09-11 | 2012-09-11 | |
US61/699,565 | 2012-09-11 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014043196A1 true WO2014043196A1 (en) | 2014-03-20 |
Family
ID=50233044
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2013/059207 WO2014043196A1 (en) | 2012-09-11 | 2013-09-11 | Ergonomic head mounted display device and optical system |
Country Status (9)
Country | Link |
---|---|
US (1) | US9740006B2 (en) |
EP (1) | EP2895910A4 (en) |
JP (1) | JP2015534108A (en) |
KR (1) | KR20150054967A (en) |
CN (1) | CN104813218A (en) |
AU (1) | AU2013315607A1 (en) |
CA (1) | CA2884663A1 (en) |
IL (1) | IL237667A0 (en) |
WO (1) | WO2014043196A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016203212A2 (en) | 2015-06-15 | 2016-12-22 | The Technology Partnership Plc | Optical system |
US11480861B2 (en) | 2017-03-21 | 2022-10-25 | Magic Leap, Inc. | Low-profile beam splitter |
US11567320B2 (en) | 2017-03-21 | 2023-01-31 | Magic Leap, Inc. | Methods, devices, and systems for illuminating spatial light modulators |
Families Citing this family (326)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2468997A (en) | 2008-01-22 | 2010-09-29 | Univ Arizona State | Head-mounted projection display using reflective microdisplays |
WO2010123934A1 (en) | 2009-04-20 | 2010-10-28 | The Arizona Board Of Regents On Behalf Of The University Of Arizona | Optical see-through free-form head-mounted display |
US20110075257A1 (en) | 2009-09-14 | 2011-03-31 | The Arizona Board Of Regents On Behalf Of The University Of Arizona | 3-Dimensional electro-optical see-through displays |
CN102782562B (en) | 2010-04-30 | 2015-07-22 | 北京理工大学 | Wide angle and high resolution tiled head-mounted display device |
AU2011348122A1 (en) * | 2010-12-24 | 2013-07-11 | Magic Leap Inc. | An ergonomic head mounted display device and optical system |
US10156722B2 (en) * | 2010-12-24 | 2018-12-18 | Magic Leap, Inc. | Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality |
CN206649211U (en) * | 2017-02-24 | 2017-11-17 | 北京耐德佳显示技术有限公司 | A kind of nearly eye display device using Waveguide mode optical element |
US9720232B2 (en) | 2012-01-24 | 2017-08-01 | The Arizona Board Of Regents On Behalf Of The University Of Arizona | Compact eye-tracked head-mounted display |
US9345402B2 (en) | 2012-09-11 | 2016-05-24 | Augmented Vision, Inc. | Compact eye imaging and eye tracking apparatus |
WO2014062912A1 (en) | 2012-10-18 | 2014-04-24 | The Arizona Board Of Regents On Behalf Of The University Of Arizona | Stereoscopic displays with addressable focus cues |
US20140168260A1 (en) * | 2012-12-13 | 2014-06-19 | Paul M. O'Brien | Waveguide spacers within an ned device |
US10228561B2 (en) * | 2013-06-25 | 2019-03-12 | Microsoft Technology Licensing, Llc | Eye-tracking system using a freeform prism and gaze-detection light |
US9625723B2 (en) * | 2013-06-25 | 2017-04-18 | Microsoft Technology Licensing, Llc | Eye-tracking system using a freeform prism |
US9915826B2 (en) | 2013-11-27 | 2018-03-13 | Magic Leap, Inc. | Virtual and augmented reality systems and methods having improved diffractive grating structures |
US9857591B2 (en) | 2014-05-30 | 2018-01-02 | Magic Leap, Inc. | Methods and system for creating focal planes in virtual and augmented reality |
KR102177133B1 (en) | 2014-01-31 | 2020-11-10 | 매직 립, 인코포레이티드 | Multi-focal display system and method |
EP4099274B1 (en) | 2014-01-31 | 2024-03-06 | Magic Leap, Inc. | Multi-focal display system and method |
IL247588B2 (en) | 2014-03-05 | 2023-12-01 | Univ Arizona | Wearable 3D Augmented Reality Display with Variable Focus and/or Object Recognition |
US11138793B2 (en) | 2014-03-14 | 2021-10-05 | Magic Leap, Inc. | Multi-depth plane display system with reduced switching between depth planes |
US10430985B2 (en) | 2014-03-14 | 2019-10-01 | Magic Leap, Inc. | Augmented reality systems and methods utilizing reflections |
TW201537219A (en) * | 2014-03-21 | 2015-10-01 | Quanta Comp Inc | Head mounted display |
DE102014207500B3 (en) * | 2014-04-17 | 2015-05-07 | Carl Zeiss Ag | Spectacle lens for a display device that can be placed on the head of a user and forms an image |
US9915823B1 (en) | 2014-05-06 | 2018-03-13 | Google Llc | Lightguide optical combiner for head wearable display |
WO2015184409A1 (en) * | 2014-05-30 | 2015-12-03 | Magic Leap, Inc. | Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality |
EP3149528B1 (en) | 2014-05-30 | 2023-06-07 | Magic Leap, Inc. | Methods and system for creating focal planes in virtual and augmented reality |
KR20150137723A (en) * | 2014-05-30 | 2015-12-09 | 엘지이노텍 주식회사 | Head-Up display |
US9298010B2 (en) | 2014-08-08 | 2016-03-29 | Marissa J. Sundquist | Wearable optical display with audio functionality |
KR20240005987A (en) | 2014-09-29 | 2024-01-12 | 매직 립, 인코포레이티드 | Architectures and methods for outputting different wavelength light out of waveguides |
US20160097929A1 (en) * | 2014-10-01 | 2016-04-07 | Dawson Yee | See-through display optic structure |
WO2016118918A1 (en) | 2015-01-22 | 2016-07-28 | Magic Leap, Inc. | Methods and system for creating focal planes using an alvarez lens |
KR20220066994A (en) | 2015-01-26 | 2022-05-24 | 매직 립, 인코포레이티드 | Virtual and augmented reality systems and methods having improved diffractive grating structures |
US10176961B2 (en) | 2015-02-09 | 2019-01-08 | The Arizona Board Of Regents On Behalf Of The University Of Arizona | Small portable night vision system |
NZ773822A (en) | 2015-03-16 | 2022-07-29 | Magic Leap Inc | Methods and systems for diagnosing and treating health ailments |
NZ738352A (en) | 2015-06-15 | 2019-07-26 | Magic Leap Inc | Method of manufacturing a liquid crystal device |
US10149958B1 (en) | 2015-07-17 | 2018-12-11 | Bao Tran | Systems and methods for computer assisted operation |
US10685488B1 (en) | 2015-07-17 | 2020-06-16 | Naveen Kumar | Systems and methods for computer assisted operation |
US10492981B1 (en) | 2015-07-17 | 2019-12-03 | Bao Tran | Systems and methods for computer assisted operation |
US10176642B2 (en) | 2015-07-17 | 2019-01-08 | Bao Tran | Systems and methods for computer assisted operation |
US10335572B1 (en) | 2015-07-17 | 2019-07-02 | Naveen Kumar | Systems and methods for computer assisted operation |
CN109407835B (en) | 2015-08-18 | 2023-01-13 | 奇跃公司 | Virtual and augmented reality systems and methods |
US10576081B2 (en) * | 2015-08-20 | 2020-03-03 | Apple Inc. | Self-emissive display with switchable retarder for high contrast |
EP3337383A4 (en) | 2015-08-21 | 2019-04-03 | Magic Leap, Inc. | Eyelid shape estimation |
AU2016310451B2 (en) | 2015-08-21 | 2021-04-22 | Magic Leap, Inc. | Eyelid shape estimation using eye pose measurement |
CA2996925C (en) | 2015-09-05 | 2022-06-28 | Leia Inc. | Light concentrating backlight and near-eye display system using same |
AU2016324039B2 (en) | 2015-09-16 | 2021-09-30 | Magic Leap, Inc. | Head pose mixing of audio files |
CA3170692A1 (en) | 2015-09-23 | 2017-03-30 | Magic Leap, Inc. | Eye imaging with an off-axis imager |
KR102348588B1 (en) | 2015-10-16 | 2022-01-07 | 레이아 인코포레이티드 | Multibeam diffraction grating-based near-eye display |
WO2017066296A1 (en) | 2015-10-16 | 2017-04-20 | Magic Leap, Inc. | Eye pose identification using eye features |
KR102641655B1 (en) | 2015-10-20 | 2024-02-27 | 매직 립, 인코포레이티드 | Select virtual objects in 3D space |
TWI578022B (en) * | 2015-10-23 | 2017-04-11 | 中強光電股份有限公司 | Head-mounted displays |
CN113358045A (en) | 2015-11-04 | 2021-09-07 | 奇跃公司 | Light field display metrics |
US11231544B2 (en) | 2015-11-06 | 2022-01-25 | Magic Leap, Inc. | Metasurfaces for redirecting light and methods for fabricating |
JPWO2017109857A1 (en) * | 2015-12-22 | 2018-10-11 | オリンパス株式会社 | Eyepiece projection optical device |
KR20230134159A (en) | 2016-01-07 | 2023-09-20 | 매직 립, 인코포레이티드 | Virtual and augmented reality systems and methods having unequal numbers of component color images distributed across depth planes |
IL301884A (en) | 2016-01-19 | 2023-06-01 | Magic Leap Inc | Augmented reality systems and methods utilizing reflections |
CA3011637A1 (en) | 2016-01-19 | 2017-07-27 | Magic Leap, Inc. | Eye image collection, selection, and combination |
EP3971874A1 (en) | 2016-01-29 | 2022-03-23 | Magic Leap, Inc. | Display for three-dimensional image |
CA3007627C (en) | 2016-01-30 | 2021-05-25 | Leia Inc. | Privacy display and dual-mode privacy display system |
US10567745B2 (en) | 2016-02-12 | 2020-02-18 | The Void, LLC | Head mount display with automatic inter-pupillary distance adjustment |
AU2017224004B2 (en) | 2016-02-24 | 2021-10-28 | Magic Leap, Inc. | Polarizing beam splitter with low light leakage |
AU2017223716B2 (en) | 2016-02-24 | 2021-11-18 | Magic Leap, Inc. | Low profile interconnect for light emitter |
WO2017147534A1 (en) | 2016-02-26 | 2017-08-31 | Magic Leap, Inc. | Display system having a plurality of light pipes for a plurality of light emitters |
KR20180114193A (en) | 2016-02-26 | 2018-10-17 | 매직 립, 인코포레이티드 | Optical output system with reflector and lens for very spatially uniform light output |
JP6978423B2 (en) | 2016-03-01 | 2021-12-08 | マジック リープ, インコーポレイテッドMagic Leap, Inc. | Reflection switching device for inputting different wavelengths of light into a waveguide |
JP7190903B2 (en) | 2016-03-04 | 2022-12-16 | マジック リープ, インコーポレイテッド | Current drain reduction in AR/VR display systems |
CN114399831A (en) | 2016-03-07 | 2022-04-26 | 奇跃公司 | Blue light modulation for biosafety |
US20170262020A1 (en) * | 2016-03-10 | 2017-09-14 | The Void Llc | Head Mount Display with Near-Eye Projection for Virtual Reality System |
DE102016105060B3 (en) * | 2016-03-18 | 2017-07-06 | Carl Zeiss Smart Optics Gmbh | Spectacle lens for imaging optics, imaging optics and data glasses |
CA3017795A1 (en) | 2016-03-22 | 2017-09-28 | Magic Leap, Inc. | Head mounted display system configured to exchange biometric information |
IL311155A (en) | 2016-03-25 | 2024-04-01 | Magic Leap Inc | Virtual and augmented reality systems and methods |
CA3018758A1 (en) | 2016-03-31 | 2017-10-05 | Magic Leap, Inc. | Interactions with 3d virtual objects using poses and multiple-dof controllers |
US11067797B2 (en) | 2016-04-07 | 2021-07-20 | Magic Leap, Inc. | Systems and methods for augmented reality |
EP3440497B1 (en) | 2016-04-08 | 2023-08-16 | Magic Leap, Inc. | Augmented reality systems and methods with variable focus lens elements |
IL298181B1 (en) | 2016-04-21 | 2024-04-01 | Magic Leap Inc | Visual aura around field of view |
US10261162B2 (en) | 2016-04-26 | 2019-04-16 | Magic Leap, Inc. | Electromagnetic tracking with augmented reality systems |
US10046229B2 (en) | 2016-05-02 | 2018-08-14 | Bao Tran | Smart device |
JP6961619B2 (en) | 2016-05-06 | 2021-11-05 | マジック リープ, インコーポレイテッドMagic Leap, Inc. | Meta-surface with asymmetric lattice for redirecting light and manufacturing method |
IL310060A (en) | 2016-05-09 | 2024-03-01 | Magic Leap Inc | Augmented reality systems and methods for user health analysis |
EP3455661B1 (en) | 2016-05-12 | 2023-04-26 | Magic Leap, Inc. | Distributed light manipulation over imaging waveguide |
EP4060462A1 (en) | 2016-05-20 | 2022-09-21 | Magic Leap, Inc. | Contextual awareness of user interface menus |
EP4350647A3 (en) | 2016-06-03 | 2024-04-24 | Magic Leap, Inc. | Augmented reality identity verification |
US10353202B2 (en) | 2016-06-09 | 2019-07-16 | Microsoft Technology Licensing, Llc | Wrapped waveguide with large field of view |
EP3469251B1 (en) | 2016-06-10 | 2021-07-07 | Magic Leap, Inc. | Integrating point source for texture projecting bulb |
US10332315B2 (en) | 2016-06-20 | 2019-06-25 | Magic Leap, Inc. | Augmented reality display system for evaluation and modification of neurological conditions, including visual processing and perception conditions |
CN109643373B (en) | 2016-06-30 | 2023-06-27 | 奇跃公司 | Estimating pose in 3D space |
CN109661194B (en) | 2016-07-14 | 2022-02-25 | 奇跃公司 | Iris boundary estimation using corneal curvature |
KR102648770B1 (en) | 2016-07-14 | 2024-03-15 | 매직 립, 인코포레이티드 | Deep neural network for iris identification |
CN109791295A (en) | 2016-07-25 | 2019-05-21 | 奇跃公司 | Use enhancing and the imaging of virtual reality glasses modification, display and visualization |
WO2018022521A1 (en) | 2016-07-25 | 2018-02-01 | Magic Leap, Inc. | Light field processor system |
EP4138339A1 (en) | 2016-07-29 | 2023-02-22 | Magic Leap, Inc. | Secure exchange of cryptographically signed records |
WO2018031621A1 (en) | 2016-08-11 | 2018-02-15 | Magic Leap, Inc. | Automatic placement of a virtual object in a three-dimensional space |
US10607609B2 (en) | 2016-08-12 | 2020-03-31 | Magic Leap, Inc. | Word flow annotation |
CA3034713A1 (en) * | 2016-08-12 | 2018-02-15 | Esight Corp. | Large exit pupil wearable near-to-eye vision systems exploiting freeform eyepieces |
US10732414B2 (en) | 2016-08-17 | 2020-08-04 | Microsoft Technology Licensing, Llc | Scanning in optical systems |
KR102529137B1 (en) | 2016-08-22 | 2023-05-03 | 매직 립, 인코포레이티드 | Augmented reality display device with deep learning sensors |
AU2017316667B2 (en) | 2016-08-22 | 2022-01-27 | Magic Leap, Inc. | Multi-layer diffractive eyepiece |
IL265120B2 (en) | 2016-09-13 | 2023-12-01 | Magic Leap Inc | Sensory eyewear |
CN109863435B (en) | 2016-09-21 | 2021-03-09 | 奇跃公司 | System and method for optical system with exit pupil expander |
CA3037725A1 (en) | 2016-09-22 | 2018-03-29 | Magic Leap, Inc. | Augmented reality spectroscopy |
KR102357876B1 (en) | 2016-09-26 | 2022-01-28 | 매직 립, 인코포레이티드 | Calibration of Magnetic and Optical Sensors in Virtual Reality or Augmented Reality Display Systems |
IL265520B2 (en) | 2016-09-28 | 2023-09-01 | Magic Leap Inc | Face model capture by a wearable device |
RU2016138608A (en) | 2016-09-29 | 2018-03-30 | Мэджик Лип, Инк. | NEURAL NETWORK FOR SEGMENTING THE EYE IMAGE AND ASSESSING THE QUALITY OF THE IMAGE |
IL293688B2 (en) | 2016-10-04 | 2024-02-01 | Magic Leap Inc | Efficient data layouts for convolutional neural networks |
US10573042B2 (en) | 2016-10-05 | 2020-02-25 | Magic Leap, Inc. | Periocular test for mixed reality calibration |
WO2018075968A1 (en) | 2016-10-21 | 2018-04-26 | Magic Leap, Inc. | System and method for presenting image content on multiple depth planes by providing multiple intra-pupil parallax views |
US10223952B2 (en) | 2016-10-26 | 2019-03-05 | Microsoft Technology Licensing, Llc | Curved edge display with controlled distortion |
US10185064B2 (en) | 2016-10-26 | 2019-01-22 | Microsoft Technology Licensing, Llc | Curved edge display with controlled luminance |
US11435572B2 (en) | 2016-10-28 | 2022-09-06 | Magic Leap, Inc. | Method and system for large field of view display with scanning reflector |
CN110114710B (en) * | 2016-10-31 | 2020-11-27 | 德遁公司 | Optical system for femto projector |
US10553139B2 (en) | 2016-11-10 | 2020-02-04 | Microsoft Technology Licensing, Llc | Enhanced imaging system for linear micro-displays |
US10565790B2 (en) | 2016-11-11 | 2020-02-18 | Magic Leap, Inc. | Periocular and audio synthesis of a full face image |
US10621747B2 (en) | 2016-11-15 | 2020-04-14 | Magic Leap, Inc. | Deep learning system for cuboid detection |
KR102639203B1 (en) | 2016-11-16 | 2024-02-20 | 매직 립, 인코포레이티드 | Thermal management systems for wearable components |
KR20190082303A (en) | 2016-11-18 | 2019-07-09 | 매직 립, 인코포레이티드 | Waveguide Optical Multiplexer Using Crossed Gratings |
KR102506485B1 (en) | 2016-11-18 | 2023-03-03 | 매직 립, 인코포레이티드 | Multilayer Liquid Crystal Diffraction Gratings for Redirecting Light in Wide Incidence Angle Ranges |
US11067860B2 (en) | 2016-11-18 | 2021-07-20 | Magic Leap, Inc. | Liquid crystal diffractive devices with nano-scale pattern and methods of manufacturing the same |
IL310194A (en) | 2016-11-18 | 2024-03-01 | Magic Leap Inc | Spatially variable liquid crystal diffraction gratings |
KR102531542B1 (en) | 2016-12-05 | 2023-05-10 | 매직 립, 인코포레이티드 | Virual user input controls in a mixed reality environment |
US10531220B2 (en) | 2016-12-05 | 2020-01-07 | Magic Leap, Inc. | Distributed audio capturing techniques for virtual reality (VR), augmented reality (AR), and mixed reality (MR) systems |
KR102298018B1 (en) | 2016-12-08 | 2021-09-02 | 매직 립, 인코포레이티드 | Diffraction devices based on cholesteric liquid crystals |
AU2017377915B2 (en) | 2016-12-13 | 2022-12-15 | Magic Leap. Inc. | Augmented and virtual reality eyewear, systems, and methods for delivering polarized light and determining glucose levels |
EP3555865A4 (en) | 2016-12-13 | 2020-07-08 | Magic Leap, Inc. | 3d object rendering using detected features |
CN106707510A (en) * | 2016-12-14 | 2017-05-24 | 浙江舜通智能科技有限公司 | Contact lens type optical system and head-mounted display equipped with same |
JP7164525B2 (en) | 2016-12-14 | 2022-11-01 | マジック リープ, インコーポレイテッド | Liquid crystal patterning using soft imprint replication of surface-matched patterns |
IL308598A (en) | 2016-12-22 | 2024-01-01 | Magic Leap Inc | Systems and methods for manipulating light from ambient light sources |
US10371896B2 (en) | 2016-12-22 | 2019-08-06 | Magic Leap, Inc. | Color separation in planar waveguides using dichroic filters |
US10746999B2 (en) | 2016-12-28 | 2020-08-18 | Magic Leap, Inc. | Dual depth exit pupil expander |
CN110419018B (en) | 2016-12-29 | 2023-08-04 | 奇跃公司 | Automatic control of wearable display device based on external conditions |
CN115145023B (en) | 2016-12-31 | 2024-02-09 | 鲁姆斯有限公司 | Device for deriving gaze direction of human eyes |
US10442727B2 (en) | 2017-01-05 | 2019-10-15 | Magic Leap, Inc. | Patterning of high refractive index glasses by plasma etching |
KR20230053724A (en) | 2017-01-23 | 2023-04-21 | 매직 립, 인코포레이티드 | Eyepiece for virtual, augmented, or mixed reality systems |
US10841724B1 (en) | 2017-01-24 | 2020-11-17 | Ha Tran | Enhanced hearing system |
CN116540330A (en) | 2017-01-27 | 2023-08-04 | 奇跃公司 | Antireflective coating for supersurfaces |
KR20230106742A (en) | 2017-01-27 | 2023-07-13 | 매직 립, 인코포레이티드 | Diffraction gratings formed by metasurfaces having differently oriented nanobeams |
WO2018138714A1 (en) * | 2017-01-28 | 2018-08-02 | Lumus Ltd. | Augmented reality imaging system |
US11347054B2 (en) | 2017-02-16 | 2022-05-31 | Magic Leap, Inc. | Systems and methods for augmented reality |
IL301881B1 (en) | 2017-02-23 | 2024-04-01 | Magic Leap Inc | Display system with variable power reflector |
IL269042B1 (en) * | 2017-03-09 | 2024-02-01 | Univ Arizona | Head-Mounted Light Field Display with Integral Imaging and Relay Optics |
AU2018231087A1 (en) * | 2017-03-09 | 2019-09-26 | Arizona Board Of Regents On Behalf Of The University Of Arizona | Freeform prism and head-mounted display with increased field of view |
IL268586B2 (en) | 2017-03-14 | 2023-09-01 | Magic Leap Inc | Waveguides with light absorbing films and processes for forming the same |
US10657376B2 (en) | 2017-03-17 | 2020-05-19 | Magic Leap, Inc. | Room layout estimation methods and techniques |
IL303471B1 (en) | 2017-03-21 | 2024-04-01 | Magic Leap Inc | Eye-imaging apparatus using diffractive optical elements |
CN110431841B (en) | 2017-03-21 | 2021-08-17 | 奇跃公司 | Depth sensing techniques for virtual, augmented and mixed reality systems |
AU2018237168A1 (en) | 2017-03-21 | 2019-10-10 | Magic Leap, Inc. | Display system with spatial light modulator illumination for divided pupils |
CN110462487B (en) | 2017-03-21 | 2022-07-01 | 奇跃公司 | Stacked waveguides with different diffraction gratings for combined fields of view |
JP7096836B2 (en) | 2017-03-22 | 2022-07-06 | マジック リープ, インコーポレイテッド | Depth-based foveal rendering for display systems |
EP3602583A4 (en) * | 2017-03-22 | 2020-07-29 | Magic Leap, Inc. | Dynamic field of view variable focus display system |
KR102629577B1 (en) | 2017-04-18 | 2024-01-24 | 매직 립, 인코포레이티드 | Waveguides having reflective layers formed by reflective flowable materials |
CA3059234A1 (en) | 2017-04-19 | 2018-10-25 | Magic Leap, Inc. | Multimodal task execution and text editing for a wearable system |
CA3059209A1 (en) | 2017-04-27 | 2018-11-01 | Magic Leap, Inc. | Light-emitting user input device |
CN117891335A (en) | 2017-05-19 | 2024-04-16 | 奇跃公司 | Keyboard for virtual, augmented and mixed reality display systems |
US10955662B2 (en) | 2017-05-22 | 2021-03-23 | Magic Leap, Inc. | Pairing with companion device |
WO2018222618A1 (en) | 2017-05-30 | 2018-12-06 | Magic Leap, Inc. | Power supply assembly with fan assembly for electronic device |
CA3065131A1 (en) | 2017-05-31 | 2018-12-06 | Magic Leap, Inc. | Eye tracking calibration techniques |
JP7270558B2 (en) | 2017-06-12 | 2023-05-10 | マジック リープ, インコーポレイテッド | Augmented reality display with multi-element adaptive lens for changing depth plane |
US10338400B2 (en) | 2017-07-03 | 2019-07-02 | Holovisions LLC | Augmented reality eyewear with VAPE or wear technology |
US10859834B2 (en) | 2017-07-03 | 2020-12-08 | Holovisions | Space-efficient optical structures for wide field-of-view augmented reality (AR) eyewear |
US10521658B2 (en) * | 2017-07-07 | 2019-12-31 | Facebook Technologies, Llc | Embedded eye tracker with dichroic mirror |
US10908680B1 (en) | 2017-07-12 | 2021-02-02 | Magic Leap, Inc. | Pose estimation using electromagnetic tracking |
US10922583B2 (en) | 2017-07-26 | 2021-02-16 | Magic Leap, Inc. | Training a neural network with representations of user interface devices |
IL271963B (en) | 2017-07-28 | 2022-08-01 | Magic Leap Inc | Fan assembly for displaying an image |
US10521661B2 (en) | 2017-09-01 | 2019-12-31 | Magic Leap, Inc. | Detailed eye shape model for robust biometric applications |
US11009662B2 (en) * | 2017-09-05 | 2021-05-18 | Facebook Technologies, Llc | Manufacturing a graded index profile for waveguide display applications |
CN111033524A (en) | 2017-09-20 | 2020-04-17 | 奇跃公司 | Personalized neural network for eye tracking |
US11841481B2 (en) | 2017-09-21 | 2023-12-12 | Magic Leap, Inc. | Augmented reality display with waveguide configured to capture images of eye and/or environment |
AU2018342099A1 (en) | 2017-09-27 | 2020-04-02 | Magic Leap, Inc. | Near eye 3D display with separate phase and amplitude modulators |
CN111465887A (en) | 2017-10-11 | 2020-07-28 | 奇跃公司 | Augmented reality display including eyepiece with transparent emissive display |
IL273991B2 (en) | 2017-10-26 | 2023-11-01 | Magic Leap Inc | Gradient normalization systems and methods for adaptive loss balancing in deep multitask networks |
AU2018354330A1 (en) | 2017-10-26 | 2020-05-14 | Magic Leap, Inc. | Augmented reality display having liquid crystal variable focus element and roll-to-roll method and apparatus for forming the same |
CN111566723A (en) | 2017-10-26 | 2020-08-21 | 奇跃公司 | Broadband adaptive lens assembly for augmented reality displays |
IL310847A (en) | 2017-10-27 | 2024-04-01 | Magic Leap Inc | Virtual reticle for augmented reality systems |
AU2018368279A1 (en) | 2017-11-14 | 2020-05-14 | Magic Leap, Inc. | Meta-learning for multi-task learning for neural networks |
CN207965356U (en) * | 2017-11-14 | 2018-10-12 | 塔普翊海(上海)智能科技有限公司 | A kind of aobvious optical system of the see-through head of nearly eye |
CN111587392A (en) | 2017-12-11 | 2020-08-25 | 奇跃公司 | Waveguide irradiator |
KR102601622B1 (en) | 2017-12-14 | 2023-11-10 | 매직 립, 인코포레이티드 | Contextual rendering of virtual avatars |
CA3084057A1 (en) | 2017-12-15 | 2019-06-20 | Magic Leap, Inc. | Enhanced pose determination for display device |
CN111683584A (en) | 2017-12-15 | 2020-09-18 | 奇跃公司 | Eyepiece for augmented reality display system |
US20190187471A1 (en) * | 2017-12-18 | 2019-06-20 | Flex Ltd. | Dynamically controlled focal plane for optical waveguide-based displays |
EP3735601A4 (en) | 2018-01-04 | 2021-09-08 | Magic Leap, Inc. | Optical elements based on polymeric structures incorporating inorganic materials |
CN111602026B (en) | 2018-01-16 | 2022-09-02 | 太平洋灯光全息图公司 | Three-dimensional display method using electromagnetic field calculation |
US11112863B2 (en) | 2018-01-17 | 2021-09-07 | Magic Leap, Inc. | Eye center of rotation determination, depth plane selection, and render camera positioning in display systems |
WO2019143864A1 (en) | 2018-01-17 | 2019-07-25 | Magic Leap, Inc. | Display systems and methods for determining registration between a display and a user's eyes |
US10540941B2 (en) | 2018-01-30 | 2020-01-21 | Magic Leap, Inc. | Eclipse cursor for mixed reality displays |
US11567627B2 (en) | 2018-01-30 | 2023-01-31 | Magic Leap, Inc. | Eclipse cursor for virtual content in mixed reality displays |
US10735649B2 (en) | 2018-02-22 | 2020-08-04 | Magic Leap, Inc. | Virtual and augmented reality systems and methods using display system control information embedded in image data |
WO2019168673A1 (en) | 2018-02-27 | 2019-09-06 | Magic Leap, Inc. | Matching meshes for virtual avatars |
AU2019228458A1 (en) | 2018-02-28 | 2020-08-06 | Magic Leap, Inc. | Head scan alignment using ocular registration |
AU2019229957A1 (en) | 2018-03-05 | 2020-08-13 | Magic Leap, Inc. | Display system with low-latency pupil tracker |
WO2019173390A1 (en) | 2018-03-07 | 2019-09-12 | Magic Leap, Inc. | Adaptive lens assemblies including polarization-selective lens stacks for augmented reality display |
CN110494792B (en) | 2018-03-07 | 2021-07-09 | 奇跃公司 | Visual tracking of peripheral devices |
US11971549B2 (en) | 2018-03-12 | 2024-04-30 | Magic Leap, Inc. | Very high index eyepiece substrate-based viewing optics assembly architectures |
JP7356995B2 (en) | 2018-03-14 | 2023-10-05 | マジック リープ, インコーポレイテッド | Display system and method for clipping content and increasing viewing comfort |
WO2019177870A1 (en) | 2018-03-15 | 2019-09-19 | Magic Leap, Inc. | Animating virtual avatar facial movements |
JP7344894B2 (en) | 2018-03-16 | 2023-09-14 | マジック リープ, インコーポレイテッド | Facial expressions from eye-tracking cameras |
US11238836B2 (en) | 2018-03-16 | 2022-02-01 | Magic Leap, Inc. | Depth based foveated rendering for display systems |
US11480467B2 (en) | 2018-03-21 | 2022-10-25 | Magic Leap, Inc. | Augmented reality system and method for spectroscopic analysis |
EP3769512A4 (en) | 2018-03-22 | 2021-03-24 | Arizona Board of Regents on Behalf of the University of Arizona | Methods of rendering light field images for integral-imaging-based light field display |
US11886000B2 (en) | 2018-04-02 | 2024-01-30 | Magic Leap, Inc. | Waveguides having integrated spacers, waveguides having edge absorbers, and methods for making the same |
WO2019195174A1 (en) | 2018-04-02 | 2019-10-10 | Magic Leap, Inc. | Waveguides with integrated optical elements and methods of making the same |
EP3776029A4 (en) | 2018-04-02 | 2022-06-29 | Magic Leap, Inc. | Hybrid polymer waveguide and methods for making the same |
WO2019204164A1 (en) | 2018-04-16 | 2019-10-24 | Magic Leap, Inc. | Systems and methods for cross-application authoring, transfer, and evaluation of rigging control systems for virtual characters |
WO2019204765A1 (en) | 2018-04-19 | 2019-10-24 | Magic Leap, Inc. | Systems and methods for operating a display system based on user perceptibility |
WO2019209431A1 (en) | 2018-04-23 | 2019-10-31 | Magic Leap, Inc. | Avatar facial expression representation in multidimensional space |
WO2019212698A1 (en) | 2018-05-01 | 2019-11-07 | Magic Leap, Inc. | Avatar animation using markov decision process policies |
US11308673B2 (en) | 2018-05-03 | 2022-04-19 | Magic Leap, Inc. | Using three-dimensional scans of a physical subject to determine positions and/or orientations of skeletal joints in the rigging for a virtual character |
WO2019226494A1 (en) | 2018-05-21 | 2019-11-28 | Magic Leap, Inc. | Generating textured polygon strip hair from strand-based hair for a virtual character |
EP3797345A4 (en) | 2018-05-22 | 2022-03-09 | Magic Leap, Inc. | Transmodal input fusion for a wearable system |
US10885692B2 (en) | 2018-05-22 | 2021-01-05 | Magic Leap, Inc. | Skeletal systems for animating virtual avatars |
US11210835B2 (en) | 2018-05-22 | 2021-12-28 | Magic Leap, Inc. | Computer generated hair groom transfer tool |
IL259518B2 (en) | 2018-05-22 | 2023-04-01 | Lumus Ltd | Optical system and method for improvement of light field uniformity |
WO2019226865A1 (en) | 2018-05-25 | 2019-11-28 | Magic Leap, Inc. | Compression of dynamic unstructured point clouds |
WO2019236344A1 (en) | 2018-06-07 | 2019-12-12 | Magic Leap, Inc. | Augmented reality scrollbar |
WO2019241575A1 (en) | 2018-06-15 | 2019-12-19 | Magic Leap, Inc. | Wide field-of-view polarization switches with liquid crystal optical elements with pretilt |
CN112567287A (en) | 2018-06-18 | 2021-03-26 | 奇跃公司 | Augmented reality display with frame modulation |
WO2019246044A1 (en) | 2018-06-18 | 2019-12-26 | Magic Leap, Inc. | Head-mounted display systems with power saving functionality |
US11694435B2 (en) | 2018-06-18 | 2023-07-04 | Magic Leap, Inc. | Systems and methods for temporarily disabling user control interfaces during attachment of an electronic device |
WO2020005757A1 (en) | 2018-06-26 | 2020-01-02 | Magic Leap, Inc. | Waypoint creation in map detection |
KR20200002616A (en) | 2018-06-29 | 2020-01-08 | 주식회사 페네시아 | Wearable smart optical system using hologram optical element |
EP3818530A4 (en) | 2018-07-02 | 2022-03-30 | Magic Leap, Inc. | Methods and systems for interpolation of disparate inputs |
JP7407748B2 (en) | 2018-07-05 | 2024-01-04 | マジック リープ, インコーポレイテッド | Waveguide-based illumination for head-mounted display systems |
US11966055B2 (en) | 2018-07-19 | 2024-04-23 | Magic Leap, Inc. | Content interaction driven by eye metrics |
WO2020023303A1 (en) | 2018-07-23 | 2020-01-30 | Magic Leap, Inc. | Coexistence interference avoidance between two different radios operating in the same band |
WO2020023399A1 (en) | 2018-07-23 | 2020-01-30 | Magic Leap, Inc. | Deep predictor recurrent neural network for head pose prediction |
WO2020023404A1 (en) | 2018-07-24 | 2020-01-30 | Magic Leap, Inc. | Flicker mitigation when toggling eyepiece display illumination in augmented reality systems |
CN112689869A (en) | 2018-07-24 | 2021-04-20 | 奇跃公司 | Display system and method for determining registration between a display and an eye of a user |
USD924204S1 (en) | 2018-07-24 | 2021-07-06 | Magic Leap, Inc. | Totem controller having an illumination region |
USD918176S1 (en) | 2018-07-24 | 2021-05-04 | Magic Leap, Inc. | Totem controller having an illumination region |
USD930614S1 (en) | 2018-07-24 | 2021-09-14 | Magic Leap, Inc. | Totem controller having an illumination region |
WO2020023672A1 (en) | 2018-07-24 | 2020-01-30 | Magic Leap, Inc. | Display systems and methods for determining vertical alignment between left and right displays and a user's eyes |
CN112703437A (en) | 2018-07-24 | 2021-04-23 | 奇跃公司 | Diffractive optical element with reduced light loss due to bounce and related systems and methods |
EP3830673A4 (en) | 2018-07-27 | 2022-05-04 | Magic Leap, Inc. | Pose space dimensionality reduction for pose space deformation of a virtual character |
JP2020020858A (en) * | 2018-07-30 | 2020-02-06 | セイコーエプソン株式会社 | Virtual image display device |
EP3830674A4 (en) | 2018-08-03 | 2022-04-20 | Magic Leap, Inc. | Depth plane selection for multi-depth plane display systems by user categorization |
US11141645B2 (en) | 2018-09-11 | 2021-10-12 | Real Shot Inc. | Athletic ball game using smart glasses |
US11103763B2 (en) | 2018-09-11 | 2021-08-31 | Real Shot Inc. | Basketball shooting game using smart glasses |
USD955396S1 (en) | 2018-09-18 | 2022-06-21 | Magic Leap, Inc. | Mobile computing support system having an illumination region |
USD934872S1 (en) | 2018-09-18 | 2021-11-02 | Magic Leap, Inc. | Mobile computing support system having an illumination region |
USD934873S1 (en) | 2018-09-18 | 2021-11-02 | Magic Leap, Inc. | Mobile computing support system having an illumination region |
USD950567S1 (en) | 2018-09-18 | 2022-05-03 | Magic Leap, Inc. | Mobile computing support system having an illumination region |
KR102626922B1 (en) * | 2018-09-21 | 2024-01-18 | 삼성전자주식회사 | See-through type display apparatus including the same |
JP7444861B2 (en) | 2018-09-26 | 2024-03-06 | マジック リープ, インコーポレイテッド | Diffractive optical element with refractive power |
EP3871034A4 (en) | 2018-10-26 | 2022-08-10 | Magic Leap, Inc. | Ambient electromagnetic distortion correction for electromagnetic tracking |
TWM642752U (en) | 2018-11-08 | 2023-06-21 | 以色列商魯姆斯有限公司 | Light-guide display with reflector |
US11893789B2 (en) | 2018-11-15 | 2024-02-06 | Magic Leap, Inc. | Deep neural network pose estimation system |
WO2020106824A1 (en) | 2018-11-20 | 2020-05-28 | Magic Leap, Inc. | Eyepieces for augmented reality display system |
EP3887925A4 (en) | 2018-11-30 | 2022-08-17 | Magic Leap, Inc. | Multi-modal hand location and orientation for avatar movement |
WO2020139755A1 (en) | 2018-12-28 | 2020-07-02 | Magic Leap, Inc. | Virtual and augmented reality display systems with emissive micro-displays |
WO2020139754A1 (en) | 2018-12-28 | 2020-07-02 | Magic Leap, Inc. | Augmented and virtual reality display systems with shared display for left and right eyes |
CN109656025A (en) * | 2019-01-25 | 2019-04-19 | 杭州历历信息科技有限公司 | Projecting optical device of the augmented reality in conjunction with glasses |
US11334154B2 (en) | 2019-01-25 | 2022-05-17 | Magic Leap, Inc. | Eye-tracking using images having different exposure times |
CN113728267A (en) | 2019-02-28 | 2021-11-30 | 奇跃公司 | Display system and method for providing variable adaptation cues using multiple intra-pupil parallax views formed by an array of light emitters |
KR20200111308A (en) * | 2019-03-18 | 2020-09-29 | 삼성디스플레이 주식회사 | Augmented reality providing device |
CN113841006A (en) | 2019-03-20 | 2021-12-24 | 奇跃公司 | System for providing illumination to an eye |
WO2020188487A1 (en) * | 2019-03-20 | 2020-09-24 | Ricoh Company, Ltd. | Virtual image display device |
JP2022529245A (en) | 2019-04-15 | 2022-06-20 | マジック リープ, インコーポレイテッド | Sensor fusion for electromagnetic tracking |
JP7423659B2 (en) | 2019-05-20 | 2024-01-29 | マジック リープ, インコーポレイテッド | Systems and techniques for estimating eye pose |
US20220221710A1 (en) | 2019-05-24 | 2022-07-14 | Magic Leap, Inc. | Variable focus assemblies |
JP7357081B2 (en) | 2019-05-28 | 2023-10-05 | マジック リープ, インコーポレイテッド | Thermal management system for portable electronic devices |
USD962981S1 (en) | 2019-05-29 | 2022-09-06 | Magic Leap, Inc. | Display screen or portion thereof with animated scrollbar graphical user interface |
US11580628B2 (en) | 2019-06-19 | 2023-02-14 | Deere & Company | Apparatus and methods for augmented reality vehicle condition inspection |
US11587315B2 (en) | 2019-06-19 | 2023-02-21 | Deere & Company | Apparatus and methods for augmented reality measuring of equipment |
CN114286962A (en) | 2019-06-20 | 2022-04-05 | 奇跃公司 | Eyepiece for augmented reality display system |
JP7311643B2 (en) | 2019-06-21 | 2023-07-19 | マジック リープ, インコーポレイテッド | Secure authorization through modal windows |
WO2020263866A1 (en) | 2019-06-24 | 2020-12-30 | Magic Leap, Inc. | Waveguides having integral spacers and related systems and methods |
US11029805B2 (en) | 2019-07-10 | 2021-06-08 | Magic Leap, Inc. | Real-time preview of connectable objects in a physically-modeled virtual space |
CN114424147A (en) | 2019-07-16 | 2022-04-29 | 奇跃公司 | Determining eye rotation center using one or more eye tracking cameras |
WO2021016045A1 (en) | 2019-07-19 | 2021-01-28 | Magic Leap, Inc. | Display device having diffraction gratings with reduced polarization sensitivity |
EP3999883A4 (en) | 2019-07-19 | 2023-08-30 | Magic Leap, Inc. | Method of fabricating diffraction gratings |
CN114616210A (en) | 2019-09-11 | 2022-06-10 | 奇跃公司 | Display device with diffraction grating having reduced polarization sensitivity |
US11176757B2 (en) | 2019-10-02 | 2021-11-16 | Magic Leap, Inc. | Mission driven virtual character for user interaction |
US11276246B2 (en) | 2019-10-02 | 2022-03-15 | Magic Leap, Inc. | Color space mapping for intuitive surface normal visualization |
USD982593S1 (en) | 2019-11-08 | 2023-04-04 | Magic Leap, Inc. | Portion of a display screen with animated ray |
WO2021092068A1 (en) | 2019-11-08 | 2021-05-14 | Magic Leap, Inc. | Metasurfaces with light-redirecting structures including multiple materials and methods for fabricating |
US11493989B2 (en) | 2019-11-08 | 2022-11-08 | Magic Leap, Inc. | Modes of user interaction |
US11423624B2 (en) | 2019-11-18 | 2022-08-23 | Magic Leap, Inc. | Mapping and localization of a passable world |
CN114730111A (en) | 2019-11-22 | 2022-07-08 | 奇跃公司 | Method and system for patterning liquid crystal layer |
CN114761859A (en) | 2019-11-26 | 2022-07-15 | 奇跃公司 | Augmented eye tracking for augmented or virtual reality display systems |
JP2023504368A (en) | 2019-12-06 | 2023-02-03 | マジック リープ, インコーポレイテッド | Encoding stereo splash screens in still images |
US11442593B2 (en) | 2019-12-06 | 2022-09-13 | Magic Leap, Inc. | Dynamic browser stage |
USD940748S1 (en) | 2019-12-09 | 2022-01-11 | Magic Leap, Inc. | Portion of a display screen with transitional graphical user interface for guiding graphics |
USD941307S1 (en) | 2019-12-09 | 2022-01-18 | Magic Leap, Inc. | Portion of a display screen with graphical user interface for guiding graphics |
USD940189S1 (en) | 2019-12-09 | 2022-01-04 | Magic Leap, Inc. | Portion of a display screen with transitional graphical user interface for guiding graphics |
USD940749S1 (en) | 2019-12-09 | 2022-01-11 | Magic Leap, Inc. | Portion of a display screen with transitional graphical user interface for guiding graphics |
USD952673S1 (en) | 2019-12-09 | 2022-05-24 | Magic Leap, Inc. | Portion of a display screen with transitional graphical user interface for guiding graphics |
USD941353S1 (en) | 2019-12-09 | 2022-01-18 | Magic Leap, Inc. | Portion of a display screen with transitional graphical user interface for guiding graphics |
US11288876B2 (en) | 2019-12-13 | 2022-03-29 | Magic Leap, Inc. | Enhanced techniques for volumetric stage mapping based on calibration object |
CN114981709A (en) * | 2020-01-22 | 2022-08-30 | 华为技术有限公司 | Virtual image display optical architecture |
WO2021150623A1 (en) | 2020-01-24 | 2021-07-29 | Magic Leap, Inc. | Content movement and interaction using a single controller |
US11340695B2 (en) | 2020-01-24 | 2022-05-24 | Magic Leap, Inc. | Converting a 2D positional input into a 3D point in space |
USD936704S1 (en) | 2020-01-27 | 2021-11-23 | Magic Leap, Inc. | Portion of a display screen with avatar |
CN115023738A (en) | 2020-01-27 | 2022-09-06 | 奇跃公司 | Neutral avatar |
USD948574S1 (en) | 2020-01-27 | 2022-04-12 | Magic Leap, Inc. | Portion of a display screen with a set of avatars |
WO2021154437A1 (en) | 2020-01-27 | 2021-08-05 | Magic Leap, Inc. | Gaze timer based augmentation of functionality of a user input device |
USD948562S1 (en) | 2020-01-27 | 2022-04-12 | Magic Leap, Inc. | Portion of a display screen with avatar |
US11756509B2 (en) | 2020-01-27 | 2023-09-12 | Magic Leap, Inc. | Enhanced state control for anchor-based cross reality applications |
USD949200S1 (en) | 2020-01-27 | 2022-04-19 | Magic Leap, Inc. | Portion of a display screen with a set of avatars |
WO2021154558A1 (en) | 2020-01-27 | 2021-08-05 | Magic Leap, Inc. | Augmented reality map curation |
WO2021155047A1 (en) | 2020-01-31 | 2021-08-05 | Magic Leap, Inc. | Augmented and virtual reality display systems for oculometric assessments |
US11709363B1 (en) | 2020-02-10 | 2023-07-25 | Avegant Corp. | Waveguide illumination of a spatial light modulator |
EP4104034A4 (en) | 2020-02-10 | 2024-02-21 | Magic Leap Inc | Body-centric content positioning relative to three-dimensional container in a mixed reality environment |
JP2023517281A (en) | 2020-02-14 | 2023-04-25 | マジック リープ, インコーポレイテッド | Virtual Object Movement Velocity Curves for Virtual and Augmented Reality Display Systems |
KR102337212B1 (en) | 2020-02-18 | 2021-12-09 | 주식회사 페네시아 | Smart glass device using hologram optical element |
JP2023516596A (en) | 2020-02-26 | 2023-04-20 | マジック リープ, インコーポレイテッド | procedural electron beam lithography |
US11840034B2 (en) | 2020-02-28 | 2023-12-12 | Magic Leap, Inc. | Method of fabricating molds for forming eyepieces with integrated spacers |
US11262588B2 (en) | 2020-03-10 | 2022-03-01 | Magic Leap, Inc. | Spectator view of virtual and physical objects |
WO2021188926A1 (en) | 2020-03-20 | 2021-09-23 | Magic Leap, Inc. | Systems and methods for retinal imaging and tracking |
CN115698782A (en) | 2020-03-25 | 2023-02-03 | 奇跃公司 | Optical device with a single-way mirror |
WO2021202746A1 (en) | 2020-04-03 | 2021-10-07 | Magic Leap, Inc. | Wearable display systems with nanowire led micro-displays |
US11348300B2 (en) | 2020-04-03 | 2022-05-31 | Magic Leap, Inc. | Avatar customization for optimal gaze discrimination |
JP2023526019A (en) * | 2020-05-14 | 2023-06-20 | マジック リープ, インコーポレイテッド | Methods and systems for integration of refractive optics and diffractive eyepiece waveguide displays |
CN116194821A (en) | 2020-05-22 | 2023-05-30 | 奇跃公司 | Augmented and virtual reality display system with associated in-and out-coupling optical zones |
US11662810B2 (en) | 2020-06-05 | 2023-05-30 | Magic Leap, Inc. | Enhanced eye tracking techniques based on neural network analysis of images |
CN116113870A (en) | 2020-08-07 | 2023-05-12 | 奇跃公司 | Adjustable cylindrical lens and head-mounted display comprising same |
WO2022046948A1 (en) * | 2020-08-28 | 2022-03-03 | Perdix Systems Llc | Optical systems having polarization recycling structures |
EP4226210A1 (en) | 2020-08-28 | 2023-08-16 | Apple Inc. | Optical systems having flcos display panels |
EP4214555A1 (en) * | 2020-09-17 | 2023-07-26 | Pacific Light&Hologram, Inc. | Displaying three-dimensional objects |
US11762333B2 (en) | 2020-09-17 | 2023-09-19 | Pacific Light & Hologram, Inc. | Reconstructing objects with display zero order light suppression |
JP2023545653A (en) | 2020-09-29 | 2023-10-31 | エイヴギャント コーポレイション | Architecture for illuminating display panels |
IL305555A (en) | 2021-03-01 | 2023-10-01 | Lumus Ltd | Optical system with compact coupling from a projector into a waveguide |
CN116783539A (en) | 2021-05-19 | 2023-09-19 | 鲁姆斯有限公司 | Active optical engine |
US11940627B2 (en) * | 2021-07-09 | 2024-03-26 | Realwear, Inc. | Opaque waveguide optical engine assembly for head-mounted device |
US11852822B2 (en) * | 2021-07-09 | 2023-12-26 | Realwear, Inc. | Convertible waveguide optical engine assembly for head-mounted device |
US11886008B2 (en) | 2021-08-23 | 2024-01-30 | Lumus Ltd. | Methods of fabrication of compound light-guide optical elements having embedded coupling-in reflectors |
CN116413911A (en) * | 2021-12-31 | 2023-07-11 | 北京耐德佳显示技术有限公司 | Ultra-thin lens, virtual image imaging device using same and near-eye display |
US20240103280A1 (en) * | 2022-09-22 | 2024-03-28 | Apple Inc. | Display with Lens Integrated Into Cover Layer |
US11900842B1 (en) | 2023-05-12 | 2024-02-13 | Pacific Light & Hologram, Inc. | Irregular devices |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20060031377A (en) * | 2004-10-08 | 2006-04-12 | (주)드리맥스 | Optical system for biocular head mounted display |
KR20070100460A (en) * | 2006-04-07 | 2007-10-11 | 엘지전자 주식회사 | Optical system for head mounted display |
US20080062537A1 (en) * | 2006-09-08 | 2008-03-13 | Asia Optical Co., Inc. | Compact imaging lens system |
KR20080044040A (en) * | 2006-11-15 | 2008-05-20 | 전자부품연구원 | Optical system for head mounted display |
US20120162549A1 (en) * | 2010-12-24 | 2012-06-28 | Chunyu Gao | Ergonomic Head Mounted Display Device And Optical System |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3658034B2 (en) | 1995-02-28 | 2005-06-08 | キヤノン株式会社 | Image observation optical system and imaging optical system |
JP3599828B2 (en) | 1995-05-18 | 2004-12-08 | オリンパス株式会社 | Optical device |
EP0785457A3 (en) * | 1996-01-17 | 1998-10-14 | Nippon Telegraph And Telephone Corporation | Optical device and three-dimensional display device |
JPH09219832A (en) | 1996-02-13 | 1997-08-19 | Olympus Optical Co Ltd | Image display |
JP3563955B2 (en) * | 1998-02-26 | 2004-09-08 | キヤノン株式会社 | Observation system having half mirror and method of manufacturing the half mirror |
JP4550184B2 (en) * | 1999-07-02 | 2010-09-22 | オリンパス株式会社 | Observation optical system |
DE60019055T2 (en) * | 1999-04-02 | 2005-09-29 | Olympus Corporation | OPTICAL VIEW UNIT AND PICTURE DISPLAY WITH THIS UNIT |
US6618209B2 (en) * | 2000-08-08 | 2003-09-09 | Olympus Optical Co., Ltd. | Optical apparatus |
JP4717196B2 (en) * | 2000-10-26 | 2011-07-06 | キヤノン株式会社 | Image observation apparatus and image observation system |
JP2004298461A (en) * | 2003-03-31 | 2004-10-28 | Topcon Corp | Refraction measuring apparatus |
WO2006061927A1 (en) | 2004-12-06 | 2006-06-15 | Nikon Corporation | Image display optical system, image display unit, lighting optical system, and liquid crystral display unit |
US7535638B2 (en) | 2005-11-01 | 2009-05-19 | Hewlett-Packard Development Company, L.P. | Fractional coverage louver device for a light guide screen |
JP5031272B2 (en) * | 2006-06-06 | 2012-09-19 | キヤノン株式会社 | Display optical system and image display apparatus having the same |
KR101258584B1 (en) | 2006-06-21 | 2013-05-02 | 엘지디스플레이 주식회사 | Volumetric type 3-Dimension Image Display Device |
JP2008165063A (en) * | 2006-12-28 | 2008-07-17 | Scalar Corp | Head mounted display |
JP2010517090A (en) * | 2007-01-25 | 2010-05-20 | ローデンストック.ゲゼルシャフト.ミット.ベシュレンクテル.ハフツング | Glasses and spectacle lenses for data reflection |
WO2010123934A1 (en) | 2009-04-20 | 2010-10-28 | The Arizona Board Of Regents On Behalf Of The University Of Arizona | Optical see-through free-form head-mounted display |
JP5603716B2 (en) | 2010-09-06 | 2014-10-08 | オリンパス株式会社 | PRISM OPTICAL SYSTEM, IMAGE DISPLAY DEVICE AND IMAGING DEVICE USING PRISM OPTICAL SYSTEM |
CN102566044A (en) | 2010-12-22 | 2012-07-11 | 黄志奇 | Optical imaging system adopting free-form surface prism |
US9726862B2 (en) * | 2012-11-08 | 2017-08-08 | DynaOptics LTD, A Public Limited CO. | Lens assemblies and actuators for optical systems and methods therefor |
-
2013
- 2013-09-11 WO PCT/US2013/059207 patent/WO2014043196A1/en active Application Filing
- 2013-09-11 JP JP2015531334A patent/JP2015534108A/en active Pending
- 2013-09-11 EP EP13836713.1A patent/EP2895910A4/en not_active Withdrawn
- 2013-09-11 AU AU2013315607A patent/AU2013315607A1/en not_active Abandoned
- 2013-09-11 CN CN201380058207.8A patent/CN104813218A/en active Pending
- 2013-09-11 KR KR1020157009177A patent/KR20150054967A/en not_active Application Discontinuation
- 2013-09-11 US US14/024,386 patent/US9740006B2/en active Active
- 2013-09-11 CA CA2884663A patent/CA2884663A1/en not_active Abandoned
-
2015
- 2015-03-11 IL IL237667A patent/IL237667A0/en unknown
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20060031377A (en) * | 2004-10-08 | 2006-04-12 | (주)드리맥스 | Optical system for biocular head mounted display |
KR20070100460A (en) * | 2006-04-07 | 2007-10-11 | 엘지전자 주식회사 | Optical system for head mounted display |
US20080062537A1 (en) * | 2006-09-08 | 2008-03-13 | Asia Optical Co., Inc. | Compact imaging lens system |
KR20080044040A (en) * | 2006-11-15 | 2008-05-20 | 전자부품연구원 | Optical system for head mounted display |
US20120162549A1 (en) * | 2010-12-24 | 2012-06-28 | Chunyu Gao | Ergonomic Head Mounted Display Device And Optical System |
Non-Patent Citations (1)
Title |
---|
See also references of EP2895910A4 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016203212A2 (en) | 2015-06-15 | 2016-12-22 | The Technology Partnership Plc | Optical system |
US11480861B2 (en) | 2017-03-21 | 2022-10-25 | Magic Leap, Inc. | Low-profile beam splitter |
US11567320B2 (en) | 2017-03-21 | 2023-01-31 | Magic Leap, Inc. | Methods, devices, and systems for illuminating spatial light modulators |
US11835723B2 (en) | 2017-03-21 | 2023-12-05 | Magic Leap, Inc. | Methods, devices, and systems for illuminating spatial light modulators |
Also Published As
Publication number | Publication date |
---|---|
AU2013315607A1 (en) | 2015-04-02 |
EP2895910A4 (en) | 2016-04-20 |
US9740006B2 (en) | 2017-08-22 |
IL237667A0 (en) | 2015-04-30 |
CN104813218A (en) | 2015-07-29 |
JP2015534108A (en) | 2015-11-26 |
US20140071539A1 (en) | 2014-03-13 |
KR20150054967A (en) | 2015-05-20 |
EP2895910A1 (en) | 2015-07-22 |
CA2884663A1 (en) | 2014-03-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9740006B2 (en) | Ergonomic head mounted display device and optical system | |
JP6952738B2 (en) | Ergonomic head-mounted display devices and optical systems | |
US20200124858A1 (en) | Freeform head mounted display | |
JP2015106146A (en) | Virtual image display device | |
Zhuang et al. | A compact and lightweight off-axis lightguide prism in near to eye display |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13836713 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2884663 Country of ref document: CA Ref document number: 2015531334 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REEP | Request for entry into the european phase |
Ref document number: 2013836713 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 237667 Country of ref document: IL Ref document number: 2013836713 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2013315607 Country of ref document: AU Date of ref document: 20130911 Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 20157009177 Country of ref document: KR Kind code of ref document: A |