|Publication number||US7881901 B2|
|Application number||US 11/857,161|
|Publication date||Feb 1, 2011|
|Filing date||Sep 18, 2007|
|Priority date||Sep 18, 2007|
|Also published as||CA2699560A1, CA2699560C, CN101815980A, CN101815980B, EP2201446A2, US20090076766, WO2009039260A2, WO2009039260A3|
|Publication number||11857161, 857161, US 7881901 B2, US 7881901B2, US-B2-7881901, US7881901 B2, US7881901B2|
|Inventors||Gene S. Fein, Edward Merritt|
|Original Assignee||Gefemer Research Acquisitions, Llc|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (10), Referenced by (12), Classifications (12), Legal Events (2)|
|External Links: USPTO, USPTO Assignment, Espacenet|
A graphical user interface (GUI) is a type of computer application user interface that allows people to interact with a computer and computer-controlled devices. A GUI typically employs graphical icons, visual indicators or special graphical elements, along with text, labels or text navigation to represent the information and actions available to a user. The actions are usually performed through direct manipulation of the graphical elements.
Holographic images can be created as single or consecutive images using available holographic technology. These technologies include mirrors, lasers, light and images strategically positioned to cause the proper reflection to yield a holographic image broadcast through an entry point in the laser and mirror positioning system. Black background and rooms with low or no light may enhance the appearance of the holographic image or images, which may also use a holographic plate as a display medium. Holographic systems may be large in size and spread out over a large broadcasting area or may be compact enough to fit in spaces smaller than a desk top. Holographic technology is only limited in size by the size of the component parts. By using holographic technology, images may be displayed multi-dimensionally, rather simply on a planar projection.
Currently progress has been made in technologies that can enhance the capability and range of holographic media in projects that employ multi-million mirror systems and via companies that have designed specialized high speed and high capacity micro processors for specialized jobs, other than holographic systems, where the technology could be applied to holographic technologies to make possible the proper positioning of millions of mirrors at a rate of between 24 to 60 or more frames of video per second, with corresponding synched audio.
Holographic displays generated over the last 20-year period utilize various configurations including lasers with images on glass plates such as an AGFA 8E75HD glass plate or other glass plates as well a laser such as a Spectra Physics 124B HeNe laser, a 35 mW laser diode system utilizing different processing methods such as pyrochrome processing. Split beam techniques can also be used Multi H1 to Multi H2. Such configurations as 8×10, triethanolomine, from Linotronic 300 image setter film are also commonly utilized or a configuration with rear-illuminated for 30×40 cm reflection hologram, where a logo floats 18-inches in front of the plate.
Some user interfaces have adopted a multi-dimensional interface approach. For example, the “heliodisplay” of 102 Technology, LLC of San Francisco, Calif. projects images into a volume of free space, i.e. into an aerosol mixture such as fog or a gas, and may operate as floating touchscreen when connected to a PC by a USB cable. However, with the heliodisplay, the image is displayed into two-dimensional space (i.e. planar). While the Heliodisplay images appear 3 dimensional (“3-D”), the images are planar and have no physical depth reference.
Unfortunately, theses existing uses have certain limitations in distribution and deployment. For example, functionally, the heliodisplay is a two dimensional display that projects against a curtain of air, or even glass. While, the heliodisplay may give the appearance of 3-D, the images displayed and the interface are 2-D. As such, the heliodisplay is not a true 3-D holographic display, and thus the interface operates on a two-dimensional plane, not taking advantage of a full three dimensional coordinate system.
Accordingly, there is a need for an integrated User Interface that utilizes true 3-D technology to create a computing and multimedia environment where a user can easily navigate by touch, mouse or pointer system to effectively navigate the interface to raise the level of the user experience to a true 3-D environment, with the goal of attaining elements of the attenuated clarity, realism and benefits of that environment that match our day to day conventional interactions with the 3-D world. The present invention relates to the creation of a holographic user interface display system that combines physical media or digitally stored files with a digital holographic player hardware system. The result is the creation of a multimedia holographic user interface and viewing experience, where a variety of graphical schematics enabling cohesive access to information utilizing pyramids, blocks, spheres, cylinders, other graphical representations, existing templates, specific object rendering, free form association, user delegated images and quantum representations of information to form a user interface where the available tools combine over time to match a users evolving data and requests.
In one example embodiment of the invention, a system and corresponding method for providing a 3-D user interface involves display images in a 3-D coordinate system. Sensors are configured to sense user interaction within the 3-D coordinate system, so that a processor may receive user interaction information from the sensors. The sensors are able to provide information to the processor that enables the processor to correlate user interaction with images in the 3-D coordinate system.
Embodiments of the invention provide a holographic user interface which transforms the computing environment to enable a three dimensional holographic style user interface and display system. The system utilizes holographic projection technology along with programmed quadrant matrixes sensor field to create multiple methods to select and interact with data and user interface tools and icons presented in a holographic format. The system may be used for interconnecting or communicating between two or more components connected to an interconnection medium (e.g., a bus) within a single computer or digital data processing system.
The foregoing will be apparent from the following more particular description of example embodiments of the invention, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating embodiments of the invention.
A description of example embodiments of the invention follows.
The present invention, in accordance with one embodiment relates to the creation of a holographic user interface which transforms the computing environment to enable a three dimensional (3-D) holographic style user interface and display system. The system utilizes holographic projection technology along with programmed quadrant matrixes sensor field to create multiple methods to select and interact with data and user interface tools and icons presented in a holographic format.
One skilled in the art will recognize that other sensing configurations or devices may be used to sense a location within a 3-D coordinate system. For example, the sensors may be laser sensors configured to provide data to triangulate a point within the 3-D coordinate system, photo voltaic sensors, photo electric light sensors, or image sensors. The sensors may be programmed to identify the specific location of the touchpoint 330 that may extend through multiple planar images, to identify a single image located at a 3-D coordinate space.
Those of ordinary skill in the art should recognize that methods involved in providing a 3-D user interface with a system may be embodied in a computer program product that includes a computer usable medium. For example, such a computer usable medium can include a readable memory device, such as a solid state memory device, a hard drive device, a CD-ROM, a DVD-ROM, or a computer diskette, having stored computer-readable program code segments. The computer readable medium can also include a communications or transmission medium, such as electromagnetic signals propagating on a computer network, a bus or a communications link, either optical, wired, or wireless, carrying program code segments as digital or analog data signals. The program code enables and supports computer implementation of the operations described in
While this invention has been particularly shown and described with references to example embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention encompassed by the appended claims.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US6031519||Dec 30, 1997||Feb 29, 2000||O'brien; Wayne P.||Holographic direct manipulation interface|
|US6377238||Jun 6, 1995||Apr 23, 2002||Mcpheters Robert Douglas||Holographic control arrangement|
|US7054045||Jul 2, 2004||May 30, 2006||Holotouch, Inc.||Holographic human-machine interfaces|
|US7185271||Aug 20, 2002||Feb 27, 2007||Hewlett-Packard Development Company, L.P.||Methods and systems for implementing auto-complete in a web page|
|US7262783||Mar 3, 2004||Aug 28, 2007||Virtual Iris Studios, Inc.||System for delivering and enabling interactivity with images|
|US20020070921||Dec 13, 2000||Jun 13, 2002||Feldman Stephen E.||Holographic keyboard|
|US20060055993||Sep 9, 2005||Mar 16, 2006||Masanori Kobayashi||Hologram element, production method thereof, and optical header|
|US20070169066||Nov 15, 2006||Jul 19, 2007||Nielsen Spencer J||System and method for an extensible 3D interface programming framework|
|US20080079723 *||May 16, 2007||Apr 3, 2008||David Hanson||System and method for visualizing multiple-sensor subsurface imaging data|
|US20080231926 *||Mar 18, 2008||Sep 25, 2008||Klug Michael A||Systems and Methods for Updating Dynamic Three-Dimensional Displays with User Input|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US8319773||Mar 16, 2011||Nov 27, 2012||Fein Gene S||Method and apparatus for user interface communication with an image manipulator|
|US8477098||Oct 31, 2007||Jul 2, 2013||Gene S. Fein||Method and apparatus for user interface of input devices|
|US8479110||Mar 20, 2011||Jul 2, 2013||William J. Johnson||System and method for summoning user interface objects|
|US8643569||Jul 13, 2011||Feb 4, 2014||Zspace, Inc.||Tools for use within a three dimensional scene|
|US8730165||May 29, 2013||May 20, 2014||Gene S. Fein||Method and apparatus for user interface of input devices|
|US8870392||Feb 28, 2011||Oct 28, 2014||Electrolux Home Products Corporation N.V.||Projector and household appliance comprising such a projector|
|US8902225||Oct 18, 2012||Dec 2, 2014||Genedics Llc||Method and apparatus for user interface communication with an image manipulator|
|US9110563||Apr 7, 2014||Aug 18, 2015||Genedics Llc||Method and apparatus for user interface of input devices|
|US9134880||May 2, 2013||Sep 15, 2015||William J. Johnson||System and method for summoning user interface objects|
|US20090109175 *||Oct 31, 2007||Apr 30, 2009||Fein Gene S||Method and apparatus for user interface of input devices|
|US20110212774 *||Jun 29, 2010||Sep 1, 2011||Karl Wudtke||Terminal including a button and button having projected images and method|
|US20120005624 *||Jan 5, 2012||Vesely Michael A||User Interface Elements for Use within a Three Dimensional Scene|
|U.S. Classification||702/150, 715/851, 345/173, 702/153, 715/852, 715/850, 345/156, 702/152|
|Cooperative Classification||G03H2001/0061, G06F3/0304|
|Mar 5, 2008||AS||Assignment|
Owner name: GEFEMER RESEARCH ACQUISITIONS, LLC, DELAWARE
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FEIN, GENE;MERRITT, EDWARD;REEL/FRAME:020605/0104
Effective date: 20071129
Owner name: GEFEMER RESEARCH ACQUISITIONS, LLC, DELAWARE
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GENEDICS LLC;REEL/FRAME:020605/0135
Effective date: 20071129
|Jul 25, 2014||FPAY||Fee payment|
Year of fee payment: 4