Search Images Maps Play YouTube News Gmail Drive More »
Advanced Patent Search | Web History | Sign in

Patents

A one or two player virtual reality game efficiently detects and tracks a distinctively colored glove. According to the preferred basketball embodiment, a single player equipped with the distinctively colored glove is matched up against a virtual opponent. The object of the game is for the real player to put a virtual basketball into a virtual basketball hoop before his/her virtual opponent steals the ball. Initially, the background site is scanned, and then the operator with the glove is scanned. A table of colors is then established which are unique only to the glove. A player is then scanned against the background to identify which color glove will have the least conflict with colors worn by the player. During play, the player is scanned at 30 frames a second and the information is stored in a frame buffer. A prediction is made of the location of the glove in subsequent frames based upon its previously known location and velocity. Therefore, a search for the glove can be made of...

InventorGeoffrey M. Davis
Original AssigneeMetaMedia Ventures, Inc.
Current U.S. Classification463/4; 345/4; 345/589; 345/600; 345/629; 348/25; 348/172; 463/31; 463/36
International Classification: A63F 922

View patent at USPTO
Search USPTO Assignment Database

Citations

Cited PatentFiling dateIssue dateOriginal AssigneeTitle
US4488245Apr 6, 1982Dec 11, 1984LogE/Interpretation Systems Inc.Method and means for color detection and modification
US4590469Aug 27, 1984May 20, 1986Color based data encoding and storage apparatus
US4678338Nov 22, 1983Jul 7, 1987Hitachi Maxell, Ltd.Color sensor
US4797738May 15, 1987Jan 10, 1989Kabushiki Kaisha TohkenColor recognition apparatus
US4917500Nov 30, 1988Apr 17, 1990Siemens AktiengesellschaftColor sensor system for the recognition of objects with colored surfaces
US4954972Nov 9, 1987Sep 4, 1990Honeywell Inc.Color signature sensor
US4958224Aug 15, 1989Sep 18, 1990Hughes Aircraft CompanyForced correlation/mixed mode tracking system
US4984179Sep 7, 1989Jan 8, 1991W. Industries LimitedMethod and apparatus for the perception of computer-generated imagery
US5012431Feb 2, 1990Apr 30, 1991Colwell/General, Inc.Objective color notation system
US5027195Oct 10, 1989Jun 25, 1991Xerox CorporationColor detection and/or recognition apparatus
US5117101Aug 13, 1990May 26, 1992Technostics CorporationTristimulus color recognition system with means for compensating for variations in light source color
US5130794Mar 29, 1990Jul 14, 1992Panoramic display system
US5136519Mar 12, 1990Aug 4, 1992Ishizaka Shoji Co., Ltd.Textile color design simulating apparatus
US5142506Oct 22, 1990Aug 25, 1992Logitech, Inc.Ultrasonic position locating method and apparatus therefor
US5148154Dec 4, 1990Sep 15, 1992Sony Corporation of AmericaMulti-dimensional user interface
US5148310Aug 30, 1990Sep 15, 1992Rotating flat screen fully addressable volume display system
US5165897Aug 10, 1990Nov 24, 1992TiNi Alloy CompanyProgrammable tactile stimulator array system and method of operation
US5174759Nov 28, 1989Dec 29, 1992TV animation interactively controlled by the viewer through input above a book page
US5175694Feb 8, 1990Dec 29, 1992The United States of America as represented by The Secretary of the NavyCentroid target tracking system utilizing parallel processing of digital data patterns
US5177872Oct 5, 1990Jan 12, 1993Texas Instruments IncorporatedMethod and apparatus for monitoring physical positioning of a user
US5184319Feb 2, 1990Feb 2, 1993Force feedback and textures simulating interface device
US5185561Jul 23, 1991Feb 9, 1993Digital Equipment CorporationTorque motor as a tactile feedback device in a computer system
US5187540Oct 30, 1991Feb 16, 1993GEC Ferranti Defence Systems LimitedOptical system for the remote determination of position and orientation
US5193000Aug 28, 1991Mar 9, 1993StereoGraphics CorporationMultiplexing technique for stereoscopic video system
US5214615Sep 24, 1991May 25, 1993Three-dimensional displacement of a body with computer interface
US5227985Aug 19, 1991Jul 13, 1993University of MarylandComputer vision system for position monitoring in three dimensions using non-coplanar light sources attached to a monitored object
US5229756May 14, 1992Jul 20, 1993Yamaha CorporationImage control apparatus
US5288078Jul 16, 1992Feb 22, 1994David G. CapperControl interface apparatus
US5319387Apr 17, 1992Jun 7, 1994Sharp Kabushiki KaishaApparatus for specifying coordinates of a body in three-dimensional space
USD338050Mar 22, 1991Aug 3, 1993W Industries LimitedConsole for providing virtual reality environments
USD338051Mar 22, 1991Aug 3, 1993W Industries LimitedConsole for providing virtual reality environments
USRE33662Sep 21, 1989Aug 13, 1991TV animation interactively controlled by the viewer

Referenced by

Citing PatentFiling dateIssue dateOriginal AssigneeTitle
US5563988Aug 1, 1994Oct 8, 1996Massachusetts Institute of TechnologyMethod and system for facilitating wireless, full-body, real-time user interaction with a digitally represented visual environment
US5577961Jun 28, 1994Nov 26, 1996The Walt Disney CompanyMethod and system for restraining a leader object in a virtual reality presentation
US5588914Jun 28, 1994Dec 31, 1996The Walt Disney CompanyMethod and system for guiding a user in a virtual reality presentation
US5662523Jul 7, 1995Sep 2, 1997Sega Enterprises, Ltd.Game apparatus using a video display device
US5704836Feb 21, 1996Jan 6, 1998Perception Systems, Inc.Motion-based command generation technology
US5714997Jan 6, 1995Feb 3, 1998Virtual reality television system
US5764164Feb 7, 1997Jun 9, 1998Reality Quest Corp.Ergonomic hand-attachable controller
US5790124Nov 20, 1995Aug 4, 1998Silicon Graphics, Inc.System and method for allowing a performer to control and interact with an on-stage display device
US5791988Jul 22, 1996Aug 11, 1998Computer gaming device with playing pieces
US5796354Feb 7, 1997Aug 18, 1998Reality Quest Corp.Hand-attachable controller with direction sensing
US5801704Aug 15, 1995Sep 1, 1998Hitachi, Ltd.Three-dimensional input device with displayed legend and shape-changing cursor
US5803810Nov 7, 1995Sep 8, 1998Perception Systems, Inc.Velocity-based command recognition technology
US5890906Jul 19, 1996Apr 6, 1999Vincent J. MacriMethod and apparatus for tutorial, self and assisted instruction directed to simulated preparation, training and competitive play and entertainment
US5913727Jun 13, 1997Jun 22, 1999Interactive movement and contact simulation game
US5952993Aug 22, 1996Sep 14, 1999Kabushiki Kaisha ToshibaVirtual object display apparatus and method
US5966526Jun 11, 1997Oct 12, 1999Kabushiki Kaisha Bandai
Kabushiki Kaisha Wiz
Simulation device for fostering a virtual creature
US6056640May 7, 1999May 2, 2000Computerized gaming apparatus
US6080063Jan 6, 1997Jun 27, 2000Simulated real time game play with live event
US6128003Dec 22, 1997Oct 3, 2000Hitachi, Ltd.Hand gesture recognition system and method
US6142870Nov 23, 1998Nov 7, 2000Konami Co., Ltd.Simulation game machine
US6144366Oct 17, 1997Nov 7, 2000Kabushiki Kaisha ToshibaMethod and apparatus for generating information input using reflected light image of target object
US6190174Jun 3, 1999Feb 20, 2001Kader Industrial Company LimitedElectronic story board
US6213871Feb 19, 1997Apr 10, 2001Kabushiki Kaisha Bandai
Kabushiki Kaisha Wiz
Nurturing simulation apparatus for virtual creatures
US6220865Oct 6, 1997Apr 24, 2001Vincent J. MacriInstruction for groups of users interactively controlling groups of images to make idiosyncratic, simulated, physical movements
US6227966Aug 12, 1997May 8, 2001Kabushiki Kaisha Bandai
Kabushiki Kaisha Wiz
Simulation device for fostering a virtual creature
US6278479Feb 24, 1998Aug 21, 2001Wilson, Hewitt & Associates, Inc.Dual reality system
US6308565Oct 15, 1998Oct 30, 2001Impulse Technology Ltd.System and method for tracking and assessing movement skills in multidimensional space
US6368217Feb 12, 1998Apr 9, 2002Kabushiki Kaisha Sega EnterprisesInput device, data processing device, data processing method, game device and medium
US6400374Sep 18, 1996Jun 4, 2002Eyematic Interfaces, Inc.Video superposition system and method
US6430997Sep 5, 2000Aug 13, 2002Trazer Technologies, Inc.System and method for tracking and assessing movement skills in multidimensional space
US6471584Jun 15, 2000Oct 29, 2002Konami Co., Ltd.Simulation game machine
US6500008Mar 15, 2000Dec 31, 2002Information Decision Technologies, LLCAugmented reality-based firefighter training system and method
US6522312Mar 23, 1998Feb 18, 2003Canon Kabushiki KaishaApparatus for presenting mixed reality shared among operators
US6545661Jun 21, 1999Apr 8, 2003Midway Amusement Games, LLCVideo game system having a control unit with an accelerometer for controlling a video game
US6563520Apr 1, 1997May 13, 2003Light and Sound Design Ltd.Virtual reality interface for show control
US6599194Apr 8, 1999Jul 29, 2003Home video game system with hard disk drive and internet access capability
US6677967Feb 21, 2001Jan 13, 2004Nintendo Co., Ltd.Video game system for capturing images and applying the captured images to animated game play characters
US6681031Aug 10, 1999Jan 20, 2004Cybernet Systems CorporationGesture-controlled interfaces for self-service machines and other applications
US6685480Mar 23, 2001Feb 3, 2004Yamaha CorporationPhysical motion state evaluation apparatus
US6726567Dec 17, 1999Apr 27, 2004Simulated real time game play with live event
US6765726Jul 17, 2002Jul 20, 2004Impluse Technology Ltd.System and method for tracking and assessing movement skills in multidimensional space
US6784901Aug 31, 2000Aug 31, 2004ThereMethod, system and computer program product for the delivery of a chat message in a 3D multi-user environment
US6831659Jul 21, 2000Dec 14, 2004Kabushiki Kaisha Sega EnterprisesImage processor unit, game machine, image processing method, and recording medium
US6832955May 16, 2003Dec 21, 2004Kabushiki Kaisha Bandai
Kabushiki Kaisha Wiz
Breeding simulation apparatus for virtual creatures
US6876496Jul 9, 2004Apr 5, 2005Impulse Technology Ltd.System and method for tracking and assessing movement skills in multidimensional space
US6894686May 15, 2001May 17, 2005Nintendo Co., Ltd.System and method for automatically editing captured images for inclusion into 3D video game play
US6950534Jan 16, 2004Sep 27, 2005Cybernet Systems CorporationGesture-controlled interfaces for self-service machines and other applications
US6951515Feb 17, 2000Oct 4, 2005Canon Kabushiki KaishaGame apparatus for mixed reality space, image processing method thereof, and program storage medium
US7038855Apr 5, 2005May 2, 2006Impulse Technology Ltd.System and method for tracking and assessing movement skills in multidimensional space
US7048630Oct 17, 2002May 23, 2006IGTSystem for and method of capturing a player's image for incorporation into a game
US7104884Dec 8, 2004Sep 12, 2006Kabushiki Kaisha Bandai
Kabushiki Kaisha Wiz
Breeding simulation apparatus for virtual creatures
US7148913Oct 12, 2002Dec 12, 2006HRL Laboratories, LLCVision-based pointer tracking and object classification method and apparatus
US7225414Aug 5, 2003May 29, 2007VideoMining CorporationMethod and system for virtual touch entertainment
US7292151Jul 22, 2005Nov 6, 2007Human movement measurement system
US7359121May 1, 2006Apr 15, 2008Impulse Technology Ltd.System and method for tracking and assessing movement skills in multidimensional space
US7397481Sep 29, 2004Jul 8, 2008Canon Kabushiki KaishaImage display method and image display system
US7421155Apr 1, 2005Sep 2, 2008Exbiblio B.V.Archive of text captures from rendered documents
US7436983Jul 31, 2002Oct 14, 2008National Institute of Information and Communications Technology Incorporated Administrative AgencyImage recognition apparatus and image recognition program
US7437023Aug 18, 2005Oct 14, 2008Exbiblio B.V.Methods, systems and computer program products for data gathering in a digital and hard copy document environment
US7460690Sep 14, 2005Dec 2, 2008Cybernet Systems CorporationGesture-controlled interfaces for self-service machines and other applications
US7463270Feb 10, 2006Dec 9, 2008Microsoft CorporationPhysical-virtual interpolation
US7492268Nov 6, 2007Feb 17, 2009Motiva LLCHuman movement measurement system
US7552402Jun 22, 2006Jun 23, 2009Microsoft CorporationInterface orientation using shadows
US7593605Apr 1, 2005Sep 22, 2009Exbiblio B.V.Data capture from rendered documents using handheld device
US7596269Apr 1, 2005Sep 29, 2009Exbiblio B.V.Triggering actions in response to optically or acoustically capturing keywords from a rendered document
US7599580Apr 1, 2005Oct 6, 2009Exbiblio B.V.Capturing text from rendered documents using supplemental information
US7599844Apr 1, 2005Oct 6, 2009Exbiblio B.V.Content access with handheld document data capture devices
US7606741Apr 1, 2005Oct 20, 2009Exbibuo B.V.Information gathering system and method
US7612786Feb 10, 2006Nov 3, 2009Microsoft CorporationVariable orientation input mode
US7668340Dec 2, 2008Feb 23, 2010Cybernet Systems CorporationGesture-controlled interfaces for self-service machines and other applications
US7684592Jan 14, 2008Mar 23, 2010Cybernet Systems CorporationRealtime object tracking system
US7702624Apr 19, 2005Apr 20, 2010Exbiblio, B.V.Processing techniques for visual capture data from a rendered document
US7706611Aug 23, 2005Apr 27, 2010Exbiblio B.V.Method and system for character recognition
US7707039Dec 3, 2004Apr 27, 2010Exbiblio B.V.Automatic modification of web pages
US7724250Dec 19, 2003May 25, 2010Sony CorporationApparatus, method, and program for processing information
US7742953Apr 1, 2005Jun 22, 2010Exbiblio B.V.Adding information or functionality to a rendered document via association with an electronic counterpart
US7761803May 13, 2003Jul 20, 2010Production Resource Group, Inc.Virtual reality interface for show control
US7791808Apr 10, 2008Sep 7, 2010Impulse Technology Ltd.System and method for tracking and assessing movement skills in multidimensional space
US7812860Sep 27, 2005Oct 12, 2010Exbiblio B.V.Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device
US7818215May 17, 2005Oct 19, 2010Exbiblio, B.V.Processing techniques for text capture from a rendered document
US7831912Apr 1, 2005Nov 9, 2010Exbiblio B. V.Publishing techniques for adding value to a rendered document
US7847808Jul 18, 2007Dec 7, 2010World Golf Tour, Inc.Photographic mapping in a simulation
US7864168May 10, 2006Jan 4, 2011Impulse Technology Ltd.Virtual reality movement system
US7952483Feb 16, 2009May 31, 2011Motiva LLCHuman movement measurement system
US7990556Feb 28, 2006Aug 2, 2011Google Inc.Association of a portable scanner with input/output and storage devices
US8001613Jun 23, 2006Aug 16, 2011Microsoft CorporationSecurity using physical objects
US8005720Aug 18, 2005Aug 23, 2011Google Inc.Applying scanned information to identify content
US8019648Apr 1, 2005Sep 13, 2011Google Inc.Search engines and systems with handheld document data capture devices
US8117137Apr 19, 2007Feb 14, 2012Microsoft CorporationField-programmable gate array based accelerator system
US8128533Dec 11, 2006Mar 6, 2012SSD Company LimitedExercise assisting method, exercise appliance, and information processor
US8131659Sep 25, 2008Mar 6, 2012Microsoft CorporationField-programmable gate array based accelerator system
US8139059Mar 31, 2006Mar 20, 2012Microsoft CorporationObject illumination in a virtual environment
US8159354Apr 28, 2011Apr 17, 2012Motiva LLCHuman movement measurement system
US8172680Aug 5, 2009May 8, 2012Sony CorporationInformation processing system for capturing operations, transferring data and performing remote operations
US8179563Sep 29, 2010May 15, 2012Google Inc.Portable scanning device
US8206219Oct 30, 2002Jun 26, 2012NIKE, Inc.Interactive gaming apparel for interactive gaming
US8213680Mar 19, 2010Jul 3, 2012Microsoft CorporationProxy training data for human body tracking
US8214387Apr 1, 2005Jul 3, 2012Google Inc.Document enhancement system and method
USD653245Apr 14, 2011Jan 31, 2012Cisco Technology, Inc.Video unit with integrated features
USD655279Apr 14, 2011Mar 6, 2012Cisco Technology, Inc.Video unit with integrated features

Claims

1. A virtual reality game method for use by at least one human player who wears at least one identifiable object having a unique color, said game comprising the steps of:

(a) scanning a background and creating a first color table of background colors;
(b) scanning said identifiable object;
(c) creating a second color table with colors distinctive only to said identifiable object by deleting all colors that said identifiable object has in common with said background;
(d) repeatedly scanning said player wearing said identifiable object against said background and creating frames of pixels in a frame buffer representative of said colors in said scan;
(e) identifying said colors in said frames that are unique to said identifiable objects;
(f) predicting an area, less than a full frame, where said identifiable object will be located in subsequent frames;
(g) scanning said predicted area to locate said identifiable object; and,
(h) using said identifiable object to manipulate a virtual object toward a virtual goal.

2. The method of claim 1 further comprising the step of:

(i) locating the centroid of said identifiable object in order to establish specific x and y coordinates for said identifiable object.

3. The method of claim 2 further comprising the steps of:

(j) attaching said virtual object to said identifiable object in a display;
(k) detecting the movement of said identifiable object to distinguish between at least two different gestures involving said identifiable object; and,
(l) propelling said virtual object toward said goal in response to the recognition of one of said at least two gestures made by said identifiable object.

4. The method of claim 3 wherein said identifiable object comprises a glove and said virtual object comprises a ball and wherein said method further comprises the step of:

(m) determining the direction and velocity of said gesture detected in step (k) and crediting the player with a score if said direction and velocity are substantially in the direction of said goal.

5. The method of claim 4 further comprising the steps of:

(n) determining the height of said player by detecting when a scan of said player against said background first comes into contact with a non-background object; and,
(o) automatically scaling the height of a virtual opponent in proportion to the height of said player.

6. The method of claim 5 further comprising the step of:

(p) performing a coarse-to-fine search by searching only a limited number of lines of said predicted area from step (g) first, and then increasing the number of lines searched until said glove is located.

7. The method of claim 6 further comprising the step of:

(q) increasing the size of said predicted search area to a larger search area if said glove is not located.

8. The method of claim 7 further comprising the step of:

(r) searching the entire frame stored in said frame buffer, beginning with the center thereof, if said glove is not located in said predicted search area determined by step (g) or in said larger search area as determined in step (q).

9. The method of claim 8 further comprising the step of:

(s) increasing the population of identifiable object color specific pixels by merging a first table of possible colors with a second master table of glove colors and then increasing the merged table of glove colors by filling in the voids surrounded by glove colors and by allowing neighboring colors on the edges of said glove colors in the merged table to take on glove specific color values.

10. The method of claim. 9 further comprising the step of:

(t) organizing pixels in said color tables by chroma X, chroma Y and luma, wherein each pixel is formatted initially by two bits of chroma X, followed by two bits of chroma Y, and followed by six bits of luma,
wherein said color values in said color tables are first compared using said above information as a means of rapid comparison of said values.

11. The method of claim 10 further comprising the step of:

(u) determining the width of said player so that said player's location can interact with a background.

12. The method of claim 10 further comprising the step of:

(v) determining the outline of said player so that said player can interact with a background.

13. The method of claim 3 wherein said game includes two players each wearing different identifiable object gloves, and wherein said two players play against each other to put said virtual object in said virtual goal.

14. The method of claim 3 wherein predetermined gestures made by said identifiable object cause the image of said player to move with respect to said display,

wherein the movement of said player causes the player to appear as though the player was in an environment having gravity substantially smaller than that of the earth.

15. A virtual reality game apparatus for use by at least one player having on his person an identifiable object having a distinctive color, said apparatus comprising:

scanning means for scanning said player and for storing said information in a frame buffer;
color identifying means for determining which of said colors of said identifiable object is most accurately identifiable and, for locating said identifiable object from the information in said frame buffer based upon its distinctive color when said player is wearing said identifiable object; and,
display means for displaying said player and said identifiable object having said most accurately identifiable color in a virtual reality setting,
wherein said player is correctly positioned within said virtual reality setting based upon the location of said identifiable object with said most accurately identifiable color.