Search Images Maps Play YouTube News Gmail Drive More »
Sign in
Screen reader users: click this link for accessible mode. Accessible mode has the same essential features but works better with your reader.

Patents

  1. Advanced Patent Search
Publication numberUS8098277 B1
Publication typeGrant
Application numberUS 11/634,044
Publication dateJan 17, 2012
Filing dateDec 4, 2006
Priority dateDec 2, 2005
Publication number11634044, 634044, US 8098277 B1, US 8098277B1, US-B1-8098277, US8098277 B1, US8098277B1
InventorsMatthew Bell
Original AssigneeIntellectual Ventures Holding 67 Llc
Export CitationBiBTeX, EndNote, RefMan
External Links: USPTO, USPTO Assignment, Espacenet
Systems and methods for communication between a reactive video system and a mobile communication device
US 8098277 B1
Abstract
Systems and methods are provided for communication between a reactive video engine and a mobile communication device. In a system according to one embodiment, a reactive video engine is coupled to a communication interface. The communication interface is configured to facilitate communication with the reactive video engine and a mobile communication device.
Images(7)
Previous page
Next page
Claims(20)
1. A system comprising:
a camera configured to capture video data of a space occupied by a user having a mobile communication device that is operable by the user;
a display configured to present an interactive image to the user; and
a processor configured to
determine an identity of the user based on information transmitted by the mobile communication device;
identify an image of at least a face of the user; and
update the interactive image on the display to include the face of the user on a user-controlled character.
2. The system of claim 1, wherein the user may complete a purchase of a product, the product represented in the interactive image.
3. The system of claim 1, wherein the interactive image comprises a barcode.
4. The system of claim 1, wherein the interactive image comprises objects recognizable to the mobile communication device.
5. The system of claim 1, wherein at least some of the information transmitted by the mobile communication device is manually entered into the mobile communication device by the user.
6. The system of claim 1, wherein the system is further configured to initiate communication with the mobile communication device.
7. The system of claim 1, wherein the user may choose to accept the communication.
8. A method comprising:
capturing video data corresponding to an interaction between a user of a mobile communication device and a virtual object generated by an interactive video computing system;
determining an identity of the user based on the video data or information transmitted by the mobile communication device;
identifying individualized content associated with the determined identity; and
presenting an interactive image on a display that is viewable by the user in accordance with the individualized content.
9. The method of claim 8, further comprising completing a purchase of a product, the product represented in the interactive image.
10. The method of claim 8, wherein the interactive image comprises a barcode.
11. The method of claim 8, wherein the interactive image comprises objects recognizable to the mobile communication device, the mobile communication device including a camera.
12. The method of claim 8, wherein at least some of the information transmitted by the mobile communication device is manually entered into the mobile communication device by the user.
13. The method of claim 8, further comprising transmitting information to the mobile communication device.
14. A hardware computer readable storage medium having embodied thereon a program, the program being executable by a processor of a computing system in order to cause the computing system to perform operations comprising:
capturing video data including a space occupied by a user of a mobile communication device;
determining an identity of the user based on the video data or information transmitted by the mobile communication device;
identifying individualized content associated with the determined identity; and
presenting an interactive image that is customized at least partly based on the individualized content on a display.
15. The hardware computer readable storage medium of claim 14, wherein the operations further comprise completing a purchase of a product, the product represented in the interactive image.
16. The hardware computer readable storage medium of claim 14, wherein the interactive image comprises a barcode.
17. The hardware computer readable storage medium of claim 14, wherein the interactive image comprises objects recognizable to the mobile communication device.
18. The hardware computer readable storage medium of claim 14, wherein at least some of the information transmitted by the mobile communication device is manually entered into the mobile communication device by the user.
19. The hardware computer readable storage medium of claim 14, wherein the operations further comprise transmitting information to the mobile communication device.
20. The hardware computer readable medium of claim 19, wherein the user may choose to accept the transmitted information.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the priority benefit of U.S. provisional application Ser. No. 60/741,557 filed on Dec. 2, 2005 and entitled “Deliverance of Personalized Information and Interaction with Mobile Communications Devices on Reactive Displays,” and of U.S. provisional application Ser. No. 60/817,278 filed on Jun. 28, 2006 and entitled “Using MCDs to Upload Information to an Interactive Display System,” which are hereby incorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates generally to communication with a reactive video system, and more particularly to systems and methods for communication between a reactive video system and a mobile communication device.

2. Description of the Related Art

Conventionally, human interaction with video display systems has required users to employ devices such as hand-held remote controllers, keyboards, mice, and/or joystick controllers to control the video display systems. Recently, a new type of system for human interaction with video displays has been developed called a reactive video system. A reactive video system allows real-time, interactive and unencumbered human interaction with images generated by the system. In such a reactive video system, the location and the motions of humans or other physical objects are captured as data using a computer vision system. The captured data may then be analyzed using software and/or hardware systems to generate images using the reactive video display, including by using a projector, television display screen, liquid crystal display screen, or other video display medium that is a part of the reactive video system.

While existing reactive video systems using computer vision methods capture and analyze data representing human and/or object interactions, they do not provide for easy and/or private communications with a user. For example, it is not possible for the user to send a text message, an image or a video to a reactive video system. Furthermore, existing reactive video systems do not identify their users, and they do not individualize (i.e., personalize) the images they generate in response to specific users.

SUMMARY OF THE INVENTION

Systems and methods are provided for communication between a reactive video engine and a mobile communication device. In a system according to one embodiment, a reactive video engine is coupled to a communication interface. The communication interface is configured to facilitate communication with the reactive video engine and a mobile communication device.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an exemplary environment for communication between a reactive video engine and a mobile communication device.

FIG. 2 illustrates a block diagram of an exemplary reactive video engine.

FIG. 3 illustrates a flow diagram of an exemplary process for communication between a mobile communication device and a reactive video engine.

FIG. 4 illustrates a flow diagram of an exemplary process for generating an image based on individualized content.

FIG. 5 illustrates a flow diagram of an exemplary process for generating an image based on an individualized communication.

FIG. 6 illustrates a flow diagram of an exemplary process for providing an information to a mobile communication device based on body motions using a reactive video engine.

DETAILED DESCRIPTION

Various embodiments include systems and methods for communication between a reactive video engine and a mobile communication device. Applications for reactive video engines are widely varied, and include advertising, video games, information browsing, product customization, branding, in-store marketing, and other commercial and non-commercial uses. Reactive video engines can be deployed in public and/or private spaces, such as malls, transit centers, retail stores, movie theaters, sports arenas, restaurants, clubs, bars, schools, and private homes.

FIG. 1 illustrates an exemplary environment for communication between a reactive video engine 110 and a mobile communication device 130 via network 120 and/or communication interface 140. A user can interact with the reactive video engine 110 using the mobile communication device 130 and/or by using the user's body motions. The reactive video engine 110 can generate images based on the user's interactions, and the mobile communication device 130 can detect the images. In various embodiments, the mobile communication device 130 includes a camera to detect the images. The images can comprise a barcode containing information that can be decoded by the mobile communication device 130 and/or the images can be configured to be recognized using software associated with the mobile communication device 130. The reactive video engine 110 and the mobile communication device 130 can communicate with each other using the communication interface 140 and/or the network 120.

A mobile communication device 130 comprises a device with communication functionality such as a mobile phone, a mobile computer, a personal digital assistant (PDA), an active or passive radio frequency identification (RFID) device, a hand-held video game system, and so forth. The network 120 may be any network including, but not limited to, a telephone network or a computer network (e.g., the interne, a local area network, a wide area network, and/or wireless network such as a cellular network, a WiFi network according to Institute of Electrical and Electronics Engineers (IEEE) standards 802.11a/b or g or other such wireless local area network standards, or a WiMax network according to IEEE standard 802.16 or another such wireless broadband standard).

The reactive video engine 110 can generate an image that is detected by the mobile communication device 130, and/or can generate an image of a text wherein at least part of the text can be entered by a user into the mobile communication device 130.

The communication interface 140 may comprise any device that enables direct communications between the mobile communication device 130 and the reactive video engine 110. Furthermore, the communication interface 140 may be used in conjunction with the network 120 to provide communication between the reactive video engine 110 and the mobile communication device 130. In various embodiments, the communication interface 140 may be used when short latency periods are desired for communications. For example, the communication interface 140 may provide communication using Wi-Fi according to IEEE standards 802.11a/b or g or other such wireless local area network standards, WiMAX IEEE standard 802.16 or another such wireless broadband standard, the Bluetooth® wireless technology standard IEEE 802.15.1 for wireless personal area networks (PANs) or another personal area network standard, or a wireless, infrared standard such IrDA® promulgated by the Infrared Data AssociationSM. Furthermore, in various embodiments, the communication interface 140 may be configured to receive the unique electromagnetic signals emitted, for example, by mobile phones, and to excite and/or receive signals from RFID devices.

FIG. 2 illustrates a block diagram of an exemplary reactive video engine, such as the reactive video engine 110 discussed with reference to FIG. 1. The reactive video engine 110 comprises a reactive video display module 200, a mobile communication interface module 210, a communication module 220, an analysis module 230, an information filter module 240, and a storage medium 250. Although the reactive video engine 110 is described as comprising various components, such as the reactive video display module 200 and the mobile communication interface module 210, the reactive video engine 110 may comprise fewer or more components and still fall within the scope of various embodiments.

The reactive video display module 200 may comprise a camera, a video projector and/or another display medium, and/or a computer system configured to capture information in an interactive area. According to various embodiments, for example, the reactive video display module 200 may comprise any of the interactive video display systems (reactive video systems) disclosed in U.S. patent application Ser. No. 10/160,217, filed May 28, 2002, entitled “Interactive Video Display System,” now U.S. Pat. No. 7,259,747, U.S. patent application Ser. No. 10/946,263, filed Sep. 20, 2004, entitled “Self-Contained Interactive Video Display System,” U.S. patent application Ser. No. 10/974,044, filed Oct. 25, 2004, entitled “Method and System for Processing Captured Image Information in an Interactive Video Display System,” now U.S. Pat. No. 7,536,032, U.S. patent application Ser. No. 10/946,084, filed Sep. 20, 2004, entitled “Self-Contained Interactive Video Display System,” U.S. patent application Ser. No. 10/946,414, filed Sep. 20, 2004, entitled “Interactive Video Window Display System,” now U.S. Pat. No. 7,710,391 and U.S. patent application Ser. No. 11/083,851, filed Mar. 18, 2005, entitled “Interactive video display system,” now U.S. Pat. No. 7,170,492. The entireties of the above patents and patent applications are incorporated herein by reference.

The mobile communication interface module 210 can facilitate communication between the communication interface 140 described with reference to FIG. 1 and the reactive video engine 110. The communication module 220 may also facilitate communication between the network 120 described with reference to FIG. 1 and the reactive video engine 110. In various embodiments, the communication interface 140, the mobile communication interface module 210 and/or the communication module 220 may detect the presence of the mobile communication device 130. This detection may occur passively, such as when the mobile communication device 130 emits signals that are detected within a detection zone of the reactive video engine 110, or the detection may be based on a user-initiated communication sent from the mobile communication device 130 and is received by the reactive video engine 110. Furthermore, the reactive video engine 110 can also send information to the mobile communication device 130 using the mobile communication interface module 210 and/or the communication module 220 using the communication interface 140 and/or the network 120. In exemplary embodiments, the mobile communication interface module 210 can facilitate communication between a first mobile communication device, such as the mobile communication device 130, and one or more other mobile communication devices.

As discussed herein, for example, the reactive video display module 200 can generate an image of a one-dimensional or a two-dimensional barcode, which can be detected and analyzed using a camera and software application associated with the mobile communication device 130. In various embodiments, the barcode can encode information that enables the mobile communication device 130 and/or the user to contact and communicate with the reactive video engine 110. In another example, the reactive video display module 200 can generate an image representing a unique picture, an icon, a web page Uniform Resource Locator (URL), a text string, an email address, a Common Short Code (CSC) and a keyword for use via Short Message Service (SMS), an instant message (IM) address, etc., which the user can optionally detect using the mobile communication device 130, or which the user can enter into the mobile communication device 130, as text. The images can represent specific information which can be used to access other information or a service. The images may be accessed either immediately, for example, or at a later time, or when the user is away from the reactive video engine 110.

In various embodiments, the reactive video engine 110 can receive an individualized communication from the mobile communication device 130. An individualized communication may comprise any communication or information specific to a particular user or a particular mobile communication device, such as the mobile communication device 130.

In one embodiment, the individualized communication may include the user log-in identification. For example, the reactive video display module 200 may generate an image that depicts a CSC and a keyword. In one instance, the mobile communication device 130 may comprise a mobile telephone, and the user may enter the CSC and keyword in the mobile telephone so that SMS and/or Multimedia Message Service (MMS) messages are received by the reactive video engine 110. The SMS and/or MMS message may provide the individualized communication establishing the user's identity, the reactive video engine 110 the user is located at, and/or other information.

The reactive video engine 110 can also send information to the mobile communication device 130. The reactive video engine 110 can send information in response to a previous communication received from the mobile communication device 130 or, for example, by allowing a user to use the user's body or appendages to enter the user's phone number, an instant message name, an email address, and so forth, directly into the reactive video engine 110 via body motions on a virtual keypad. The reactive video engine 110 can then communicate with the mobile communication device 130 and send the information from the user using the network 120 or the communication interface 140. According to exemplary embodiments, the SMS and/or MMS messages described herein may allow the reactive video engine 110 to facilitate sending an advertising coupon or other information to the mobile communication device 130.

A variety of different types of information may be encoded into the communication by the reactive video engine 110 and/or the mobile communication device 130. For example, the identity of the reactive video engine 110 being accessed by the user, the time and date of the user's access, and/or particular choices or selections made by the user while interacting with the reactive video engine 110 may be communicated. In an exemplary game application, the communication can include a performance of a user in the game, and whether the user won a particular sweepstakes or contest. In various embodiments, the communication may provide a full record or description of the user's interaction with the reactive video engine 110. In other embodiments, the communication may be a unique code that allows the interaction to be identified and/or retrieved from a storage medium, such as the storage medium 250.

In various embodiments, the reactive video engine 110 can display a unique session identifier (session ID), which can encode for the identity of the reactive video engine 110, the time, and other information. A user can use the session ID to log-in by using the mobile communication device 130 to communicate with the reactive video engine 110. Multiple users may be identified by providing a different session ID to each user, for example, by having one user stand in one region of the display screen while logging in, and having another user stand in a different section of the display screen while logging in. In other embodiments, the session ID can be automatically sent to the mobile communication device 130 of all users on or near the reactive video engine 110.

The log-in process can take many forms. For example, the session ID may consist of a short text string, which the user can type into the mobile communication device 130 and send as an SMS message to the reactive video engine 110. In another example, a log-in may consist of the user's mobile phone number, which is sent as part of the SMS message, and may be used to identify the user. In another example, the session ID may be encoded as text, image, or a barcode readable by a camera and software on the mobile communication device 130. Thus, the user can point the mobile communication device 130 at the text, image, or barcode, and the application on the mobile communication device 130 can automatically extract the session ID.

In another embodiment, the log-in process may be initiated by the reactive video engine 110. The reactive video engine 110 can send out a signal that can be picked up by the mobile communication device 130 of the user. If the mobile communication device 130 is a RFID device or contains a radio frequency transmitter, the reactive video engine 110 can use a group of receivers or a directional receiver to triangulate or otherwise disambiguate the position of the mobile communication device 130, and thus unambiguously identify each particular user within a group of users. In some embodiments, session IDs may be unnecessary and the reactive video engine 110 can simply send out a generic signal to trigger each mobile communication device 130 to broadcast the user identifications (users IDs) associated with the mobile communication device 130. In other embodiments, the reactive video engine 110 need not send out a signal, for example, when the mobile communication device 130 continuously sends out a unique signal which can act as a user ID.

The storage medium 250 can include, but is not limited to random access memory (RAM) and/or a read only memory (ROM). A storage device, such as a hard drive or a flash drive can comprise the storage medium 250. A database may be contained within the storage medium 250, and can provide an individualized content to the reactive video engine 110. The individualized content may comprise any communication or information specific to the particular user or the mobile communication device 130 that is stored in the storage medium 250. In exemplary embodiments, the storage medium 250 stores the communication between the reactive video engine 110 and the mobile communication device 130. In various embodiments, a full or partial record of the communication can be stored, along with the unique code identifying the interaction. According to some embodiments, access to the storage medium 250 allows the reactive video engine 110, the user, or a manager responsible for the operation and maintenance of reactive video engine 110, to use the unique code to access the record of the communication. The storage medium 250 may be located at the physical location of the reactive video display module 200 or at another location (not shown).

Users may create accounts in which the user's name, preferences, and/or statistics are linked to a unique identifier, such as a user ID that is stored in the storage medium 250. The unique identifier can take many forms, including a cell phone number, an identification code stored on the mobile communication device 130, a password that can be typed into the mobile communication device 130, or a RFID device encoded with a specific frequency. Links between unique identifiers and personal information, for example, the user's name, preferences, and/or statistics, can be stored in a database, such as storage medium 250.

In exemplary embodiments, the analysis module 230 analyzes and/or reviews the communication received from the mobile communication device 130. The communication (images, text, videos, sounds, etc.) submitted by the user can analyzed before the reactive video engine 110 generates one or more images, videos, and/or sounds based at least in part on the communication. The communication can then be incorporated into the content used to generate the one or more images. For example, an image of the user's face may be submitted and generated as an image on the display screen used by the reactive video engine 110. The reactive video display module 200 can generate arbitrary graphical content and the image of the face can be used like any other image on the display screen. For example, the image of the user's face may be shown on a head of a user-controlled video game character, or as a head of a mannequin in a clothing/dressing application. In applications where the communication is a user-submitted image of a person, for example, the analysis module 230 can include face-finding and/or facial-feature-finding functionality that can extract and/or otherwise change the image of the user's face.

The use of individualized content can be persistent. The reactive video engine 110 can implement log-in procedures. For example, when a user uses the mobile communication device 130 to send a log-in communication to a reactive video engine 110, the storage medium 250 can access the information that the user has submitted in the past. The information may be stored locally or at a central database. Thus, for example, if a user logs-in to play a game, the user's logo, character, and other user-submitted information previously submitted can be available to the reactive video engine 110. In various embodiments, user-submitted communications can be stored in a central database and tagged with a user's identification, a timestamp of the submission, and the location of the submission, allowing a network of reactive displays to have persistent access to the communications.

Since the reactive video engine 110 can be in public venues, the information filter module 240 enables the filtering (information screening) of an individualized (personalized) communication before a public display via the reactive video engine 110. The information filter module 240 reviews the individualized communication and provides a reviewed individualized communication to the reactive video engine 110.

In various embodiments, an individualized communication (e.g., images, text, videos, sounds, etc.) is reviewed by the information filter module 240 before being made public by the reactive video display module 200. The reactive video engine 110 can generate an image of a text based at least in part on the individualized communication and/or a non-text image based at least in part on the individualized communication.

The information filter module 240 can filter out inappropriate material, which may include racist, offensive, pornographic, copyrighted, trademarked, or otherwise unacceptable content. The information filter module 240 may use known automated filtering techniques that are in common use for web content, image recognition techniques, and/or other techniques. In addition, the information filter module 240 can use a manual technique, in which a person reviews and approves each user-submitted communication prior to public display. The information filter module 240 can also use a combination of automated and manual filtering techniques.

The reactive video engine 110 described with reference to FIGS. 1 and 2 can be use to implement a variety of exemplary applications, some examples of which are described herein.

For example, the reactive video engine 110 can provide a coupon to the user with the mobile communication device 130. The coupon can be either unique or non-unique to a particular user. A unique coupon code can be provided via a CSC and a keyword (or a similar method) and displayed using the reactive video display module 200. The user can enter the coupon code in the mobile communication device 130 and thereby send an SMS message to the reactive video engine 110 or to another system (not shown), which then can send a coupon back via SMS to the user's mobile communication device 130 (e.g., a mobile phone associated with the user). In various embodiments, the coupon may be in the form of a SMS message, image, or other message. The reactive video engine 110 or another system (not shown) can provide an online database, such as the storage medium 250, which can store detailed information about the user's interaction linked to the unique coupon code. Alternatively, the coupon may be encoded uniquely via a text string, image, barcode, or any of the other communication techniques described herein. To redeem the coupon at a store, the user can present the mobile communication device 130, with the stored coupon, to an employee of the store. If necessary, the employee may then verify the validity of the coupon, by accessing the database provided by the storage medium 250. The coupon can also be redeemed online. The user may type a coupon code or URL into a website of an online store, and the store can automatically check the validity of the coupon against the database provided, for example, by the storage medium 250.

According to another embodiment, the user may be randomly selected while the user interacts with the reactive video engine 110, and the user is provided with a coupon code as described herein. For identification purposes, a video camera associated with the reactive video engine 110 can take an image of the user so that the user can be distinguished from other nearby people who saw the coupon code as well.

According to another embodiment, the reactive video engine 110 can allow the user to vote or to take a survey. To prevent users from voting more than once, the user can send the user's votes and/or the user's answers through the mobile communication device 130. Thus, the reactive video engine 110 can uniquely identify the user using, for example, a mobile phone number.

According to another embodiment, the reactive video engine 110 can allow the user to view and to vote on a series of images, text strings, videos, or other content. For example, the reactive video engine 110 can provide images of buttons, allowing the user to express opinions by touching the parts of the image. Each button pressed, or otherwise selected, is perceived as a vote or a rating for the content shown. Data from the voting may be aggregated at the reactive video engine 110 and/or shared over a network a plurality of the reactive video engines 110. A central database may keep track of vote counts, and the user may submit images, text, videos and/or other content using the mobile communication device 130 to the reactive video engine 110 for incorporation into the list of images, text strings, videos, or other content being voted upon. The submissions may be sent to the reactive video engine 110, or to a network of the reactive video engines 110. The user who submits content that receives a specific number of votes can win a prize.

In another embodiment, a player of a game using the reactive video engine 110 can be provided with a unique coupon code using mobile communication device 130, as described herein, upon completion of the game. The resulting coupon may be based on the player's performance on the game. The player may win a coupon representing a special offer or a free item as a result of winning the game or achieving a particular score, for example.

In another embodiment, the reactive video engine 110 can allow users to make a set of choices. For example, users may use the reactive video engine 110 to customize a particular product. The reactive video engine 110 can provide the user with a code that either indicates the choices the user made, or a unique identifier that can be used to access a database, such as storage medium 250, that stores the user's choices. The user can use the reactive video engine 110 as a creative tool to create an image or other content. At a later time, the user can use the code or unique identifier to access the image or content the user previously created. The code may be received using the mobile communication device 130.

In another embodiment, the user can purchase an item the user views, designs, and/or customizes using the reactive video engine 110. The reactive video engine 110 can provide the user with a code that identifies the item, allowing the user to enter confidential financial information into their mobile communication device 130 to complete the purchase.

In another embodiment, the mobile communication device 130 may be used as a video game controller when the reactive video engine 110 provides a game. For example, the user playing a magic-themed game can use a combination of hand gestures and buttons on the mobile communication device 130 to cast a spell, for example, by using one particular button on the mobile communication device 130 to select a spell, and the body motions of the user's arm to aim it. The mobile communication device 130 can also direct the movements of a virtual objects or characters generated by the reactive video engine 110.

In another embodiment, using the reactive video engine 110 to play games can include games in which each user's performance history is tracked. Using the mobile communication device 130, the user could have a unique virtual character and/or set of abilities that may be associated with the user, and the reactive video engine 110 can individualize (personalize) the appearance of the unique virtual character based on preferences selected by the user. In the case of multiple users, the reactive video engine 110 can individualize (personalize) a section of the display to each user. For example, the image of a distinctive “aura” may be displayed around each user's body. If the user returns to a game previously played, the game can continue where the game left off when last played. Using the mobile communication device 130, the user can receive a code representing a promotion or prize for visiting a particular set of the reactive video engines 110. Furthermore, the using mobile communication device 130, a user can submit text, photos, or other information to the reactive video engine 110 such that text, photos, etc. appear in the game.

FIG. 3 illustrates a flow diagram of an exemplary process for communication between a mobile communication device and a reactive video engine, such as the mobile communication device 130 and the reactive video engine 110. At step 310, a communication is received from the mobile communication device. As discussed herein, receiving the communication may include the use of the communication interface 140, the mobile communication interface module 210, and/or the communication module 220 and detecting the presence of the mobile communication device 130. This detection may occur passively, such as when the mobile communication device 130 emits signals that are detected within a detection zone of the reactive video engine 110, or the detection may be based on a user-initiated communication sent from the mobile communication device 130 and received by the reactive video engine 110. The user-initiated communication may be facilitated by images and/or signals emitted by the reactive video engine 110 or the communication interface 140.

At step 320, the communication is analyzed. As discussed herein, the analysis module 230 analyzes and/or reviews the communication received from mobile communication device 130. The communication, which may include images, text, videos, sound, etc., is analyzed before reactive video display module 200 generates one or more images based at least in part on the communication. Operations may be performed on the communication that may be necessary to convert the communication from one format into another format that may be needed by the reactive video engine 110. In various embodiments, where the communication is an image of a person, for example, step 320 may include functionality provided by the analysis module 230 that can include face-finding and/or facial-feature-finding functionality that can extract and/or otherwise change the image of the user's face.

At step 330, one or more images are generated using the reactive video display module 200 such that the image is based at least in part on the communication received in step 310. For example, an icon or graphic symbol may be utilized as an image on the display screen used by the reactive video engine 110. In various embodiments, the one or more images generated at step 330 may be configured to be detected by the mobile communication device 130. For example, the reactive video display module 200 can generate an image of a one-dimensional or a two-dimensional barcode, which can be detected or captured and analyzed using a camera and a software application associated with the mobile communication device 130. In other embodiments, the one or more images generated at step 330 may include an image of a text wherein at least part of the text can be entered by the user into the mobile communication device 130. For example, the reactive video display module 200 can generate an image representing a web page Uniform Resource Locator (URL), a text string, an email address, an instant message (IM) address, etc., which the user can optionally detect using the mobile communication device 130, or which the user can enter into mobile communication device 130, as text.

FIG. 4 illustrates a flow diagram of an exemplary process for generating an image based on individualized content. Individualized content may comprise any communication or information specific to a particular user or the mobile communication device 130. The individualized content may be stored, for example, using the storage medium 250. In various embodiments, individualized content may include a session ID, user ID, text, image, video, and/or a sound.

At step 410, a communication is received from a mobile communication device, such as mobile communication device 130. Receiving the communication may include the use of the communication interface 140, the mobile communication interface module 210 and/or the communication module 220 and detecting the presence of the mobile communication device 130. This detection may occur passively, such as when the mobile communication device 130 emits signals that are detected within a detection zone of the reactive video engine 110, or the detection may be based on a user-initiated communication sent from the mobile communication device 130 and received by the reactive video engine 110, as discussed herein. The user-initiated communication may be facilitated by images and/or signals emitted by the reactive video engine 110 and/or the communication interface 140.

At step 420, the communication is analyzed. As discussed herein, the analysis module 230 analyzes and/or reviews the communication received from the mobile communication device 130. The communication, which may include images, text, videos, sound, etc., is analyzed before the reactive video display module 200 generates one or more images based at least in part on the communication. As discussed herein, the communication may be converted from one format into another format that may be needed by the reactive video engine 110. In exemplary embodiments where the communication is a image of a person, for example, step 420 may include functionality provided by the analysis module 230 that can include face-finding and/or facial-feature-finding functionality that can extract and/or otherwise change the image of the user's face.

At step 430, a database contained within the storage medium 250 is queried for individualized content. As discussed herein, individualized content may be a session ID, user ID, image, video, and/or a sound that was previously stored using the storage medium 250. For example, an image of a user's face can be previously stored, and the query performed at step 430 can retrieve the stored image. In another example, a database contained within the storage medium 250 can be queried for information that the user submitted in the past, such as a login communication discussed herein. Thus, for example, if the user logs-in to play a game, the user's logo, character, and/or other information previously submitted can be available to the reactive video engine 110. In various embodiments, the user's communications can be stored in a central database and tagged with the user's identification, a timestamp of the submission, and/or the location of the submission, allowing one or more reactive video engines 110 to have persistent access to the stored communications.

At step 430, an image is generated using the reactive video display module 200 such that the image is based at least in part on the individualized content. For example, the reactive video display module 200 can generate arbitrary graphical content and a previously stored image of a face can be used like any other image displayed on the display screen of the reactive video engine 110. For example, the image of the user's face may be shown on the head of a user-controlled video game character, or as the head of a mannequin in a clothing/dressing application.

FIG. 5 illustrates a flow diagram of an exemplary process for generating an image based on an individualized communication. At step 510, a communication is received from a mobile communication device, as is described with reference to step 310 in FIG. 3. At step 520, the communication is analyzed, as is described with reference to step 320 in FIG. 3.

At step 530, the reactive video engine 110 determines if the communication received from the mobile communication device 130 includes an individualized communication. An individualized communication may comprise any communication or information specific to a particular user or to the mobile communication device 130. If the communication is not individualized, at step 540 an image is generated using the reactive video display module 200 such that the image is based at least in part on the communication received in step 510. Step 540 may generate an image using the process described with reference to step 330 in FIG. 3

Step 550 is performed if the reactive video engine 110 determines that the communication received from the mobile communication device is an individualized communication. At step 550, the individualized communication is reviewed using an information filter module, such as information filter module 240. The individualized communication is reviewed using a filter and/or an information screen, as described herein. Step 550 insures that a user-submitted communication (e.g., images, text, sounds, or videos) is reviewed by information filter module 240 before being made public by the reactive video display module 200. The review performed by the information filter module 240 may be configured to filter out inappropriate material such as, for example, include racist, offensive, pornographic, copyrighted, trademarked, or otherwise unacceptable content. The review performed by the information filter module 240 may use known automated filtering techniques that are in common use for web content, image recognition techniques, and/or other techniques. In addition, the information filter module 240 can use a manual technique, in which a person reviews and approves each user-submitted communication prior to public display. The Information filter module 240 can also use a combination of automated and manual filtering techniques.

At step 560, the reactive video display module 200 generates an image of a text based at least in part on the individualized communication and/or a non-text image based at least in part on the individualized communication. For example, the image may include specific information about the user, such as images, text, sounds, or videos submitted by the user. As discussed herein, the image generated at step 560 may comprise an image of a text wherein at least part of the text can be entered by a user into the mobile communication device 130. For example, the reactive video display module 200 can generate an image representing a web page Uniform Resource Locator (URL), a text string, an email address, an instant message (IM) address, etc., which the user can optionally store using the mobile communication device 130, or which the user can enter into mobile communication device 130 as text. As discussed herein, a non-text image generated at step 560 may comprise an image of a one-dimensional or a two-dimensional barcode, which can be detected and analyzed using mobile communication device 130. For example, the when mobile communication device 130 is a mobile phone with a camera, a camera and software application in the mobile phone can detect the image generated at step 560.

FIG. 6 illustrates a flow diagram of an exemplary process for providing an information to a mobile communication device based on body motions using a reactive video engine, such as reactive video engine 110. At step 610, the user can interact with the reactive video engine 100 by using the body motions of the user. As described herein, the reactive video engine 100 allows human interaction with images generated by reactive video engine 100. The body motions of the user, including the location and the motions of the user and of other physical objects controlled by the user, are captured as data. In one exemplary embodiment, reactive video engine 110 can interact with images of buttons allowing the users to express the user's opinions by touching the parts of the image. In another exemplary embodiment, the user playing a game can use the user's hand, other appendages or gestures that interact with the reactive video engine 110 to direct the playing of the game.

At step 620, the reactive video engine 110 provides an information to the mobile communication device based on the user's body motions using the reactive video engine 110. For example, based on the body motions of a user, the user may request information, win a game, or otherwise interact with the reactive video engine 110. As a result, the reactive video engine 110 can provide the information to a mobile communication device 130 that provides the requested information, a coupon code, a SMS or MMS message, or other information.

In exemplary embodiments, the information may comprise an image, an electromagnetic signal, and/or may be individualized to the user. As discussed herein, when the information comprises an image, the image can represent a web page Uniform Resource Locator (URL), a text string, an email address, an instant message (IM) address, etc., which the user can enter into mobile communication device 130 as text. Furthermore, a non-text image can be an image of a one-dimensional or a two-dimensional barcode, which can be detected (captured) and analyzed using a camera and software application in the mobile communication device 130. When the information comprises an electromagnetic signal, the information may comprise any of the electromagnetic signals described with reference to FIG. 1 (e.g., Wi-Fi, WiMAX, Bluetooth®, IrDA®, an RFID signal). When the information is individualized to the user, the information may comprise an individualized information. An individualized information is any communication or information specific to a particular user or to the mobile communication device 130, and is described herein with reference to FIGS. 1, 2 and 5.

While various embodiments have been described above, it should be understood that they have been presented by way of example only, and not limitation. For example, any of the elements associated with reactive video engine 110 may employ any of the desired functionality set forth herein above. Thus, the breath and scope of any particular embodiment should not be limited by any of the above-described exemplary embodiments.

Patent Citations
Cited PatentFiling datePublication dateApplicantTitle
US2917980Dec 30, 1955Dec 22, 1959Mergenthaler Linotype GmbhLenslet assembly for photocomposing machines
US3068754Jul 30, 1958Dec 18, 1962Corning Giass WorksPrismatic light transmitting panel
US3763468Oct 1, 1971Oct 2, 1973Energy Conversion Devices IncLight emitting display array with non-volatile memory
US4053208Feb 3, 1976Oct 11, 1977Fuji Photo Film Co., Ltd.Rear projection screens
US4275395Sep 28, 1979Jun 23, 1981International Business Machines CorporationInteractive projection display system
US4573191Mar 29, 1984Feb 25, 1986Tokyo Shibaura Denki Kabushiki KaishaStereoscopic vision system
US4725863Feb 20, 1987Feb 16, 1988United Kingdom Atomic Energy AuthorityStereo camera
US4843568Apr 11, 1986Jun 27, 1989Krueger Myron WReal time perception of and response to the actions of an unencumbered participant/user
US4887898Apr 13, 1988Dec 19, 1989Rowe Furniture CorporationFabric projection system
US4948371Apr 25, 1989Aug 14, 1990The United States Of America As Represented By The United States Department Of EnergySystem for training and evaluation of security personnel in use of firearms
US5001558Jun 11, 1985Mar 19, 1991General Motors CorporationNight vision system with color video camera
US5138304Aug 2, 1990Aug 11, 1992Hewlett-Packard CompanyProjected image light pen
US5151718Dec 31, 1990Sep 29, 1992Texas Instruments IncorporatedSystem and method for solid state illumination for dmd devices
US5239373Dec 26, 1990Aug 24, 1993Xerox CorporationVideo computational shared drawing space
US5276609May 28, 1991Jan 4, 1994Durlach David M3-D amusement and display device
US5319496Nov 18, 1992Jun 7, 1994Photonics Research IncorporatedOptical beam delivery system
US5325472Apr 12, 1991Jun 28, 1994Matsushita Electric Industrial Co., Ltd.Image displaying system for interactively changing the positions of a view vector and a viewpoint in a 3-dimensional space
US5325473Oct 11, 1991Jun 28, 1994The Walt Disney CompanyApparatus and method for projection upon a three-dimensional object
US5426474Mar 22, 1994Jun 20, 1995Innersense, Inc.Light projection system using randomized fiber optic bundle
US5436639Mar 15, 1994Jul 25, 1995Hitachi, Ltd.Information processing system
US5442252Nov 16, 1992Aug 15, 1995General Electric CompanyLenticulated lens with improved light distribution
US5454043Jul 30, 1993Sep 26, 1995Mitsubishi Electric Research Laboratories, Inc.Dynamic and static hand gesture recognition through low-level image analysis
US5497269Jun 25, 1992Mar 5, 1996Lockheed Missiles And Space Company, Inc.Dispersive microlens
US5510828Mar 1, 1994Apr 23, 1996Lutterbach; R. StevenInteractive video display system
US5526182Feb 17, 1993Jun 11, 1996Vixel CorporationMultiple beam optical memory system
US5528263Jun 15, 1994Jun 18, 1996Daniel M. PlatzkerInteractive projected video image display system
US5528297Aug 25, 1994Jun 18, 1996Deutsche Thomson-Brant GmbhConvertible video camera/projector
US5534917May 9, 1991Jul 9, 1996Very Vivid, Inc.Video image based control system
US5548694Jan 31, 1995Aug 20, 1996Mitsubishi Electric Information Technology Center America, Inc.Collision avoidance system for voxel-based object representation
US5591972Aug 3, 1995Jan 7, 1997Illumination Technologies, Inc.Apparatus for reading optical information
US5594469Feb 21, 1995Jan 14, 1997Mitsubishi Electric Information Technology Center America Inc.Hand gesture machine control system
US5633691Jun 7, 1995May 27, 1997Nview CorporationStylus position sensing and digital camera with a digital micromirror device
US5703637Oct 26, 1994Dec 30, 1997Kinseki LimitedRetina direct display device and television receiver using the same
US5808784Sep 5, 1995Sep 15, 1998Dai Nippon Printing Co., Ltd.Lens array sheet surface light source, and transmission type display device
US5861881Feb 8, 1996Jan 19, 1999Actv, Inc.Interactive computer system for providing an interactive presentation with personalized video, audio and graphics responses for multiple viewers
US5882204Jul 13, 1995Mar 16, 1999Dennis J. LannazzoFootball interactive simulation trainer
US5923380Jan 25, 1996Jul 13, 1999Polaroid CorporationMethod for replacing the background of an image
US5923475Nov 27, 1996Jul 13, 1999Eastman Kodak CompanyLaser printer using a fly's eye integrator
US5953152Sep 23, 1997Sep 14, 1999Light & Sound Design, Ltd.Programmable light beam shape altering device using programmable micromirrors
US5969754Dec 9, 1996Oct 19, 1999Zeman; Herbert D.Contrast enhancing illuminator
US5978136Dec 17, 1997Nov 2, 1999Seiko Epson CorporationOptical element, polarization illumination device, and projection display apparatus
US5982352Jun 29, 1995Nov 9, 1999Pryor; Timothy R.Method for providing human input to a computer
US6008800Aug 15, 1994Dec 28, 1999Pryor; Timothy R.Man machine interfaces for entering data into a computer
US6058397Apr 8, 1997May 2, 2000Mitsubishi Electric Information Technology Center America, Inc.3D virtual environment creation management and delivery system
US6075895Jun 20, 1997Jun 13, 2000HoloplexMethods and apparatus for gesture recognition based on templates
US6084979Jun 20, 1996Jul 4, 2000Carnegie Mellon UniversityMethod for creating virtual reality
US6088612Apr 4, 1997Jul 11, 2000Medtech Research CorporationMethod and apparatus for reflective glare removal in digital photography useful in cervical cancer detection
US6097369Feb 2, 1995Aug 1, 2000Wambach; Mark L.Computer mouse glove
US6106119Nov 9, 1999Aug 22, 2000The Board Of Trustees Of The Leland Stanford Junior UniversityMethod for presenting high level interpretations of eye tracking data correlated to saved display images
US6118888Feb 25, 1998Sep 12, 2000Kabushiki Kaisha ToshibaMulti-modal interface apparatus and method
US6125198Nov 19, 1998Sep 26, 2000Matsushita Electric Industrial Co., Ltd.Method of matching stereo images and method of measuring disparity between these items
US6166744Sep 15, 1998Dec 26, 2000Pathfinder Systems, Inc.System for combining virtual images with real-world scenes
US6176782Dec 22, 1997Jan 23, 2001Philips Electronics North America Corp.Motion-based command generation technology
US6191773Apr 25, 1996Feb 20, 2001Matsushita Electric Industrial Co., Ltd.Interface apparatus
US6198487Feb 26, 1999Mar 6, 2001Intergraph CorporationOle for design and modeling
US6198844Jan 27, 1999Mar 6, 2001Konica CorporationImage processing apparatus
US6263339Aug 25, 1998Jul 17, 2001Informix Software, Inc.Dynamic object visualization and code generation
US6292171Mar 31, 1999Sep 18, 2001Seiko Epson CorporationMethod and apparatus for calibrating a computer-generated projected image
US6308565Oct 15, 1998Oct 30, 2001Impulse Technology Ltd.System and method for tracking and assessing movement skills in multidimensional space
US6323895Jun 10, 1998Nov 27, 2001Namco Ltd.Image generating system and information storage medium capable of changing viewpoint or line-of sight direction of virtual camera for enabling player to see two objects without interposition
US6333735May 24, 1999Dec 25, 2001International Business Machines CorporationMethod and apparatus for mouse positioning device based on infrared light sources and detectors
US6335977May 28, 1998Jan 1, 2002Mitsubishi Denki Kabushiki KaishaAction recognizing apparatus and recording medium in that action recognizing program is recorded
US6339748Nov 5, 1998Jan 15, 2002Seiko Epson CorporationCoordinate input system and display apparatus
US6349301Feb 24, 1998Feb 19, 2002Microsoft CorporationVirtual environment bystander updating in client server architecture
US6353428Feb 10, 1998Mar 5, 2002Siemens AktiengesellschaftMethod and device for detecting an object in an area radiated by waves in the invisible spectral range
US6359612Sep 29, 1999Mar 19, 2002Siemens AktiengesellschaftImaging system for displaying image information that has been acquired by means of a medical diagnostic imaging device
US6388657Dec 31, 1998May 14, 2002Anthony James Francis NatoliVirtual reality keyboard system and method
US6400374Sep 18, 1996Jun 4, 2002Eyematic Interfaces, Inc.Video superposition system and method
US6407870Oct 28, 1999Jun 18, 2002Ihar HurevichOptical beam shaper and method for spatial redistribution of inhomogeneous beam
US6414672Jul 6, 1998Jul 2, 2002Sony CorporationInformation input apparatus
US6445815Mar 12, 1999Sep 3, 2002Canon Kabushiki KaishaMeasurement of depth image considering time delay
US6454419Mar 19, 2001Sep 24, 2002Seiko Epson CorporationIndicated position detection by multiple resolution image analysis
US6480267Dec 26, 2000Nov 12, 2002Kabushiki Kaisha TopconWavefront sensor, and lens meter and active optical reflecting telescope using the same
US6491396Feb 14, 2001Dec 10, 2002Seiko Epson CorporationProjector modulating a plurality of partial luminous fluxes according to imaging information by means of an electro-optical device
US6501515Oct 13, 1998Dec 31, 2002Sony CorporationRemote control system
US6522312Mar 23, 1998Feb 18, 2003Canon Kabushiki KaishaApparatus for presenting mixed reality shared among operators
US6545706Jul 30, 1999Apr 8, 2003Electric Planet, Inc.System, method and article of manufacture for tracking a head of a camera-generated image of a person
US6552760Feb 17, 2000Apr 22, 2003Fujitsu LimitedLuminaire with improved light utilization efficiency
US6598978Jul 16, 2001Jul 29, 2003Canon Kabushiki KaishaImage display system, image display method, storage medium, and computer program
US6607275Mar 20, 2002Aug 19, 2003The Neiman Marcus Group, Inc.Merchandise display case and system
US6611241Nov 25, 1998Aug 26, 2003Sarnoff CorporationModular display system
US6654734Aug 30, 2000Nov 25, 2003International Business Machines CorporationSystem and method for query processing and optimization for XML repositories
US6658150Dec 1, 2000Dec 2, 2003Honda Giken Kogyo Kabushiki KaishaImage recognition system
US6661918Dec 3, 1999Dec 9, 2003Interval Research CorporationBackground estimation and segmentation based on range and color
US6677969Sep 24, 1999Jan 13, 2004Sanyo Electric Co., Ltd.Instruction recognition system having gesture recognition function
US6707054Mar 21, 2002Mar 16, 2004Eastman Kodak CompanyScannerless range imaging system having high dynamic range
US6707444Aug 18, 2000Mar 16, 2004International Business Machines CorporationProjector and camera arrangement with shared optics and optical marker for use with whiteboard systems
US6712476Nov 17, 2000Mar 30, 2004Seiko Epson CorporationProjection display apparatus and method of display
US6720949Aug 21, 1998Apr 13, 2004Timothy R. PryorMan machine interfaces and applications
US6732929Feb 1, 2002May 11, 2004Metrologic Instruments, Inc.Led-based planar light illumination beam generation module employing a focal lens for reducing the image size of the light emmiting surface of the led prior to beam collimation and planarization
US6747666Jan 26, 2001Jun 8, 2004New York UniversityMethod and system for facilitating wireless, full-body, real-time user interaction with digitally generated text data
US6752720Jun 15, 2000Jun 22, 2004Intel CorporationMobile remote control video gaming system
US6754370Aug 14, 2000Jun 22, 2004The Board Of Trustees Of The Leland Stanford Junior UniversityReal-time structured light range scanning of moving scenes
US6791700May 30, 2003Sep 14, 2004Ricoh Company, Ltd.Coordinate inputting/detecting apparatus, method and computer program product designed to precisely recognize a designating state of a designating device designating a position
US6826727Nov 24, 1999Nov 30, 2004Bitstream Inc.Apparatus, methods, programming for automatically laying out documents
US6831664Mar 22, 2002Dec 14, 2004Koninklijke Philips Electronics N.V.Low cost interactive program control system and method
US6871982Jan 22, 2004Mar 29, 2005Digital Optics International CorporationHigh-density illumination system
US6877882Mar 12, 2003Apr 12, 2005Delta Electronics, Inc.Illumination system for a projection system
US6912313May 31, 2001Jun 28, 2005Sharp Laboratories Of America, Inc.Image background replacement method
US7432917 *Jun 16, 2004Oct 7, 2008Microsoft CorporationCalibration of an interactive display system
US20060258397 *May 10, 2005Nov 16, 2006Kaplan Mark MIntegrated mobile application server and communication gateway
US20060294247 *Jun 24, 2005Dec 28, 2006Microsoft CorporationExtending digital artifacts through an interactive surface
Non-Patent Citations
Reference
1"Bodymover Body Movement as a Means to Obtain an Audiovisual, Spatial Experience," 2000ART+COM AG Berlin, http://www.artcom.de/index.php?option=com-acprojects&page=6&id=28&Itemid=144&,details=0&lang=en.
2"EffecTV" Version 0.2.0 released Mar. 27, 2001, available online at .
3"Index of /EffecTV," available online at .
4"R111, The Transformation from Digital Information to Analog Matter," http://www.r111.org.
5"Supreme Particles; R111" http://www.r111.org, 1999, XP002989704.
6"Bodymover Body Movement as a Means to Obtain an Audiovisual, Spatial Experience," 2000ART+COM AG Berlin, http://www.artcom.de/index.php?option=com—acprojects&page=6&id=28&Itemid=144&,details=0&lang=en.
7"EffecTV" Version 0.2.0 released Mar. 27, 2001, available online at <http://web.archive.org/web/20010101-20010625re—http://effectv.sourceforge.net>.
8"Index of /EffecTV," available online at <http://effectv.cvs.sourceforge.net/effectv/EffecTV/?pathrev=rel—0—2—0>.
92001 Symposium on Interactive 3D Graphics program description, ACM SIGGRAPH, held Mar. 19-21, 2001, Research Triangle Park, NC, downloaded from ; cited during opposition of European Application No. 02739710.8, filed Jun. 4, 2002.
102001 Symposium on Interactive 3D Graphics program description, ACM SIGGRAPH, held Mar. 19-21, 2001, Research Triangle Park, NC, downloaded from <http://www.allconferences.com/conferences/2000830092631/>; cited during opposition of European Application No. 02739710.8, filed Jun. 4, 2002.
11Affidavit of Daniel Barthels regarding EffecTV, dated May 15, 2007 (partial machine translation), cited during opposition of European Application No. 02739710.8, filed Jun. 4, 2002.
12Announcement: Workshop on Perceptual User Interfaces, The Banff Rocky Mountain Resort, Banff, Alberta, Canada, Oct. 20-21, 1997, can be found at , cited during opposition of European Application No. 02739.
13Announcement: Workshop on Perceptual User Interfaces, The Banff Rocky Mountain Resort, Banff, Alberta, Canada, Oct. 20-21, 1997, can be found at <http://www.research.microsoft.com/PUIWorkshop/>, cited during opposition of European Application No. 02739.
14ART+COM Bodymover 2000, as downloaded on Aug. 21, 2009 from <http://www.artcom.de/index.php?option=com-acprojects&page=6&id=28&Itemid=144&details=0&lang=en>, cited during opposition of European Application No. 02739710.8, filed Jun. 4, 2002.
15ART+COM Bodymover 2000, as downloaded on Aug. 21, 2009 from <http://www.artcom.de/index.php?option=com—acprojects&page=6&id=28&Itemid=144&details=0&lang=en>, cited during opposition of European Application No. 02739710.8, filed Jun. 4, 2002.
16ARTCOM: "Projekt Bodymover 2000; Koerperbewegung als Mittel zur Schaffung eines audio-visuellen Raum-Erlenbisses" http://www.artcom.de/images/stories/2-pro-bodymover/bodymover-d.pdf, 2000, XP002989289.
17ARTCOM: "Projekt Bodymover 2000; Koerperbewegung als Mittel zur Schaffung eines audio-visuellen Raum-Erlenbisses" http://www.artcom.de/images/stories/2—pro—bodymover/bodymover—d.pdf, 2000, XP002989289.
18Article 96(2) Communication dated Feb. 25, 2005 in European Application No. 02739710.8.
19Article 96(2) Communication dated Mar. 31, 2004 in European Application No. 02739710.8.
20Brown, Matthew, et al. "Multi-Image Matching using Multi-Scale Oriented Patches," Technical Report, Dec. 2004, pp. 1-48, available online at .
21Brown, Matthew, et al. "Multi-Image Matching using Multi-Scale Oriented Patches," Technical Report, Dec. 2004, pp. 1-48, available online at <ftp://ftp.research.rnicrosoft.com/pub/tr/TR-2004-133.pdf>.
22Brown, Matthew, et al., "Multi-Image Matching using Multi-Scale Oriented Patches," Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Conference Publication Date: Jun. 20-25, 2005, 8 pgs.
23Buxton, Bill, "Multi-Touch Systems That I Have Known and Loved," accessed Mar. 21, 2007, .
24Buxton, Bill, "Multi-Touch Systems That I Have Known and Loved," accessed Mar. 21, 2007, <http://billbuxton.com/multitouchOverview.html>.
25Communication dated Dec. 10, 2008 from Patentanwalt attaching article by Katy Bachman, entitled "Reactrix Up for Sale," cited during opposition of European Application No. 02739710.8, filed Jun. 4, 2002.
26Crouser, P.D., et al., "Unattenuated tracer particle extraction through time-averaged, background image subtraction with outlier rejection," Experiments in Fluids, 22, 1997, 220-228, Springer-Verlag.
27Dachselt, Raimund, et al., "CONTIGRA: An XML-Based Architecture for Component-Oriented 3D Applications, 3D Technologies for the World Wide Web, Proceedings of the Seventh International Conference on 3D Technology," ACM, Feb. 24-28, 2002, pp. 155-163.
28Davis, J.W. and Bobick, A.F., "SIDEshow: a Silhouette-based Interactive Dual-screen Environment," Aug. 1998, MIT Media Lab Tech Report No. 457.
29Decision revoking the European Patent in European Application No. 02739710.8 dated Dec. 28, 2009.
30Demarest, Ken, "Sand," 2000, Mine Control, art installation, available online at .
31Demarest, Ken, "Sand," 2000, Mine Control, art installation, available online at <http://www.mine-control.com>.
32EffecTV Software Source: effect module, dated May 20, 2001 (German); cited during opposition of European Application No. 02739710.8, filed Jun. 4, 2002.
33Elgammal, Ahmed et al., "Non-parametric Model for Background Subtraction," Jun. 2000, European Conference on Computer Vision, Lecture Notes on Computer Science, vol. 1843, pp. 751-767.
34Experience Microsoft Surface, downloaded from <http://www.nnicrosoft.conn/surface/Pages/Product/Specifications.aspx> on Sep. 24, 2009.
35Extended Search Report for European Application No. 06010825.5, filed Jun. 4, 2002, dated Jul. 10, 2006.
36Foerterer, Holger, "Fluidum," 1999, art installation, description available online at .
37Foerterer, Holger, "Fluidum," 1999, art installation, description available online at <http://www.foerterer.com/fluidum>.
38Foeterer, Holger, "Helikopter," 2001, art installation, description available online at .
39Foeterer, Holger, "Helikopter," 2001, art installation, description available online at <http://www.foerterer.com/helikopter>.
40Freeman, William et al., "Computer vision for interactive computer graphics," May-Jun. 1998, IEEE Computer Graphics and Applications, vol. 18, No. 3, pp. 41-53.
41Frisken, Sarah F. et al., "Adaptively Sampled Distance Fields: A General Representation of Shape for Computer Graphics," Jul. 23-28, 2000, Proceedings Of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 249-254.
42Fujihata, Masaki, "Beyond Pages," 1995, art installation, description available online at .
43Fujihata, Masaki, "Beyond Pages," 1995, art installation, description available online at <http://http://on1.zkm.de/zkm/werke/BeyondPages>.
44Goetz, Frank, et al., "An XML-based Visual Shading Language for Vertex and Fragment Shaders," 3D Technologies for the World Wide Web, Proceedings of Ninth International Conference on 3D Technology; ACM, Apr. 5-8, 2004; pp. 87-97.
45GroundFX Document, GestureTek (Very Vivid, Inc.), description available online at .
46GroundFX Document, GestureTek (Very Vivid, Inc.), description available online at <http://www.gesturetek.com/groundfx>.
47Haller, Michael et al., "Coeno-Storyboard: An Augmented Surface for Storyboard Presentations," Mensch & Computer 2005, Sep. 4-7, 2005, Linz, Austria.
48Han, Jefferson Y., "Low-Cost Multi-Touch Sensing Through Frustrated Total Internal Reflection," Oct. 23-26, 2005, ACM Symposium on User Interface Software and Technology (UIST).
49Harville, Michael et al., "Foreground Segmentation Using Adaptive Mixture Models in Color and Depth," 2001, Proc. of IEE Workshop on Detection and Recognition of Events in Video, pp. 3-11.
50Hemmer, Raphael Lozano, "Body Movies," 2002, art project/installation, description available online at .
51Hemmer, Raphael Lozano, "Body Movies," 2002, art project/installation, description available online at <http://wvvw.lozano-hemmer.com/eproyecto.html>.
52Hoff, Kenneth E. III et al, "Fast and Simple 2D Geometric Proximity Queries Using Graphics Hardware," Mar. 19-21, 2001, Proc. Of the 2001 Symposium on Interactive 3D Graphics, pp. 145-148.
53International Preliminary Examination Report for PCT/US2002/017843, filed Jun. 4, 2002.
54International Preliminary Report on Patentability for PCT/US2004/035477, filed Oct. 25, 2004.
55International Preliminary Report on Patentability for PCT/US2004/035478, filed Oct. 25, 2004.
56International Preliminary Report on Patentability for PCT/US2004/041318, filed Dec. 9, 2004.
57International Preliminary Report on Patentability for PCT/US2004/041319, filed Dec. 9, 2004.
58International Preliminary Report on Patentability for PCT/US2004/041320, filed Dec. 9, 2004.
59International Preliminary Report on Patentability for PCT/US2005/008984, filed Mar. 18, 2005.
60International Preliminary Report on Patentability for PCT/US2006/030720, filed on Aug. 4, 2006.
61International Preliminary Report on Patentability for PCT/US2008/059900, filed on Apr. 10, 2008.
62International Preliminary Report on Patentability for PCT/US2008/10750, filed Sep. 15, 2008.
63International Search Report for PCT/US03/40321, filed Dec. 15, 2003.
64International Search Report for PCT/US2002/017843, filed Jun. 4, 2002, dated Feb. 5, 2003.
65International Search Report for PCT/US2004/035477, filed Oct. 25, 2004.
66International Search Report for PCT/US2004/035478, filed Oct. 25, 2004.
67International Search Report for PCT/US2004/041318, filed Dec. 9, 2004.
68International Search Report for PCT/US2004/041319, filed Dec. 9, 2004.
69International Search Report for PCT/US2004/041320, filed Dec. 9, 2004.
70International Search Report for PCT/US2005/008984, filed Mar. 18, 2005.
71International Search Report for PCT/US2006/030720, filed Aug. 4, 2006.
72International Search Report for PCT/US2008/059900, filed Apr. 10, 2008.
73International Search Report for PCT/US2008/10750, filed Sep. 15, 2008.
74Invitation to Pay Additional Fees and Partial international Search Report on Patentability for PCT/US2004/035478, filed Oct. 25, 2004.
75Ivars Peterson, "Artificial reality; combining a person's live video image with computer graphics suggests novel ways of working and playing with computers" Science News, Jun. 22, 1985.
76Jabri, Sumer et al., "Detection and Location of People in Video Images Using Adaptive Fusion of Color and Edge Information;" presented at the Int. Conf. Pattern Recognition, Barcelona, Spain, 2000.
77Jeff Kahn, "Intelligent Room with a View," www.realtimearts.net.
78Joyce, Arthur W. III, et al., "Implementation and capabilities of a virtual interaction system," Sep. 10-11, 1998, Proceedings 2nd European Conference on Disability, Virtual Reality and Associated Technologies, Skovde, Sweden, pp. 237-245.
79 *Jun Rekimoto; SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces; 2002.
80Katz, Itai et al., "A Multi-Touch Surface Using Multiple Cameras," Oct. 3, 2007, Advanced Concepts for Intelligent Vision Systems, vol. 4678/2007.
81Keays, Bill, "metaField Maze," 1998, exhibited at Siggraph'99 Emerging Technologies and Ars Electronica 1999, description available online at .
82Keays, Bill, "Using High-Bandwidth Input/Output in Interactive Art," Jun. 1999, Master's Thesis, Massachusetts Institute of Technology, School of Architecture and Planning.
83Keays, Bill, "metaField Maze," 1998, exhibited at Siggraph'99 Emerging Technologies and Ars Electronica 1999, description available online at <http://www.billkeays.com/metaFieldInfosheet1A.pdf>.
84Kjeldesn, Rick et al., "Dynamically Reconfigurable Vision-Based User Interfaces," Apr. 2003, 3rd International Conference on Vision Systems (ICVVS '03), Graz, Austria, pp. 6-12.
85Kjeldsen, R. et al., "Interacting with Steerable Projected Displays," 2002, Proc. of the 5th International Conference on Automatic Face and Gesture Recognition, Washington, D.C.
86Kreuger, Myron, "Videoplace," 1969 and subsequent, summary available online at .
87Kreuger, Myron, "Videoplace-An Artificial Reality," Apr. 1985, Conference on Human Factors in Computing Systems, San Francisco, California, pp. 35-40.
88Kreuger, Myron, "Videoplace," 1969 and subsequent, summary available online at <http://www.jtnimoy.com/itp/newmediahistory/videoplace>.
89Kreuger, Myron, "Videoplace—An Artificial Reality," Apr. 1985, Conference on Human Factors in Computing Systems, San Francisco, California, pp. 35-40.
90Kurapati, Kaushal et al., "A Multi-Agent TV Recommender," 2001, Workshop on Personalization in Future TV, pp. 1-8, XP02228385.
91Lantagne, Michel, et al., "VIP: Vision tool for comparing Images of People," Vision Interface, Jun. 11-13, 2003, pp. 1-8.
92Leibe, Bastian et al., "Toward Spontaneous Interaction with the Perceptive Workbench, a Semi-Immersive Virtual Environment," Nov./Dec. 2000, IEEE Computer Graphics and Applications, vol. 20, No. 6, pp. 54-65.
93Lengyel, Jed et al., "Real-Time Robot Motion Planning Using Rasterizing Computer Graphics Hardware," Aug. 1990, ACM SIGGRAPH Computer Graphics, vol. 24, Issue 4, pp. 327-335.
94Letter dated May 16, 2007 from Christian Zuckschwerdt regarding EffecTV, (partial machine translation), cited during opposition of European Application No. 02739710.8, filed Jun. 4, 2002.
95Letter of the opponent O2 dated May 28, 2010 in European Application No. 02739710.8, filed Jun. 4, 2002.
96Levin, Golan "Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers," Aug. 2006, AI & Society, vol. 20, Issue 4, pp. 462-482.
97Lin, Mingxiu et al., "A New Approach for Vision-based Rear Vehicle Tracking," Key Laboratory of Integrated Automation of Process Industry, Ministry of Education, Northeastern University, Shenyang, Liaoning Province, China, held May 23-25, 2007, pp. 107-111.
98Livingston, Mark Alan, "Vision-based Tracking with Dynamic Structured Light for Video See-through Augmented Reality," 1998, Ph.D. Dissertation, University of North Carolina at Chapel Hill, cited on Jun. 18, 2007 during opposition of European Application No. 02739710.8, filed Jun. 4, 2002.
99MacIver, Malcolm, et al., "Body Electric," Apr. 15-Jun. 29, 2003, art installation, description available online at <http://www.neurornech.northwestern.edu/uropatagiurn/#ArtSci>.
100Malik, Shahzad et al., "Visual Touchpad: A Two-Handed Gestural Input Device," Oct. 13-15, 2004, International Conference on Multimodal Interfaces (ICMI '04).
101Mandala Systems, "Video Gesture Control System Concept," 1986, description available online at .
102Mandala Systems, "Video Gesture Control System Concept," 1986, description available online at <http://www.vividgroup.com/tech.html>.
103Maria Langer, "Mac OS×10.2: Visual QuickStart Guide," Sep. 17, 2002, Peachpit Press, p. 111.
104Mathieu Lamarre, et al., "Background subtraction using competing models in the block-DCT domain," 2002, IEEE Comput Soc US, vol. 1, pp. 299-302.
105Microsoft Surface multi-touch interface table unveiled, May 30, 2007, downloaded from <http://www.dancewithshadows.com/tech/microsoft-surface.asp>.
106Microsoft Surface Web Page, downloaded from <http://www.microsoft.com/surface/Pages/Product/WhatIs.aspx> on Sep. 24, 2009.
107Microsoft Surface, downloaded from <http://en.wikipedia.org/wiki/Microsoft—surface> on Sep. 24, 2009.
108Mitsubishi DiamondTouch, <http://www.merl.com/projects/DiamondTouch/> visited Mar. 21, 2007.
109Mo, Zhenyao "SmartCanvas: A Gesture-Driven Intelligent Drawing Desk System," Jan. 9-12, 2005, Proceedings of Intelligent User Interfaces (IUI '05).
110Morano, Raymond A. et al., "Structured Light Using Pseudorandom Codes," Mar. 1998, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, No. 3.
111Morris, T. et al., "Real-Time Fingertip Detection for Hand Gesture Recognition," Sep. 9-11, 2002, Advanced Concepts for Intelligent Vision Systems (ACIVS '04), Ghent University, Belgium.
112Muench, Wolfgang, "Bubbles", 1999, Prix Ars Electronica Catalog 1999, Springer-Verlag, Berlin, Germany; available online at .
113Muench, Wolfgang, "Bubbles", 1999, Prix Ars Electronica Catalog 1999, Springer-Verlag, Berlin, Germany; available online at <http://hosting.zkm.de/wmuench/bub/text>.
114Notice of Opposition in European Application No. 02739710.8 dated Aug. 23, 2010.
115Notice of Opposition in European Application No. 02739710.8 dated May 14, 2007.
116Observation by third party Michael Saup dated Jan. 17, 2005, cited during opposition of European Application No. 02739710.8, filed Jun. 4, 2002.
117Observation by third party Petra Trefzger dated Jan. 17, 2005, cited during opposition of European Application No. 02739710.8, filed Jun. 4, 2002.
118Observation by third party Simon Penny dated Jan. 17, 2005, cited during opposition of European Application No. 02739710.8, filed Jun. 4, 2002.
119Paradiso, Joseph et al., "New Sensor and Music Systems for Large Interactive Surfaces," 2000, Proc. of the Interactive Computer Music Conference, Berlin, Germany, pp. 277-280.
120Penny, et al., "Traces: Wireless Full Body Tracking in the Cave," Dec. 99, Japan, ICAT Virtual Reality Conference, http://turing.ace.uci.edu/pennytexts/traces/.
121Penny, Simon and Bernhardt, Andre, "Fugitive II," 2004, Australian Center for the Moving Image, art installation, description available online at .
122Penny, Simon and Bernhardt, Andre, "Fugitive II," 2004, Australian Center for the Moving Image, art installation, description available online at <http://www.acmi.net.au/fugitive.jsp?>.
123Penny, Simon et al., "Body Electric," 2003, art installation, description available online at .
124Penny, Simon et al., "Body Electric," 2003, art installation, description available online at <http://www.neuromech.northwestern.edu/uropatagium/#ArtSci>.
125Pinhanez, C. et al., "Ubiquitous Interactive Graphics," 2002, IBM Research Report RC22495, available at .
126Pinhanez, C. et al., "Ubiquitous Interactive Graphics," 2002, IBM Research Report RC22495, available at <http://www.research.ibm.com/ed/publications/rc22495.pdf>.
127Pinhanez, C., "The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces," 2001, Proc. of the UbiComp 2001 Conference, Ubiquitous Computing Lecture Notes in Computer Science, Springer-Verlag, Berlin, Germany, pp. 315-331.
128Plasma, 3 pp, http://www.particles.de/paradocs/plasma/index.html.
129Provision of the minutes in European Application No. 02739710.8 dated Dec. 28, 2009.
130Reactrix, Inc. website, Mar. 28, 2003, <http://web.archive.org/web/20030328234205/http://www.reactrix.com> and <http://web.archive.org/web/20030328234205/http://www.reactrix.conn/webdemo.php>.
131Rekimoto, J. and Matsushita, N., "Perceptual Surfaces: Towards a Human and Object Sensitive Interactive Display," 1997, Proc. of the Workshop on Perceptual User Interfaces, Banff, Canada, pp. 30-32.
132Ringel, M. et al., "Barehands: Implement-Free Interaction with a Wall-Mounted Display," 2001, Proc. of the 2001 ACM CHI Conference on Human Factors in Computing Systems (Extended Abstracts), p. 367-368.
133Rogala, Miroslav, "Lovers Leap," 1994, art installation, Dutch Electronic Arts Festival,description available online at .
134Rogala, Miroslav, "Lovers Leap," 1994, art installation, Dutch Electronic Arts Festival,description available online at <http://http://wayback.v2.nl/DEAF/persona/rogala.html>.
135Rokeby, David, "Very Nervous System (VNS)," Mar. 1995, Wired Magazine, available online at ; sold as software at .
136Rokeby, David, "softVNS 2 real time video processing and tracking software for Max;" SoftVNS 2 downloads, as downloaded from <http://homepage.mac.com/davidrokeby/softVNS.html> on Mar. 16, 2007.
137Rokeby, David, "Very Nervous System (VNS)," Mar. 1995, Wired Magazine, available online at <http://www.wired.com/wired/archive/3.03/rokeby.html>; sold as software at <http://homepage.mac.com/davidrokeby/softVNS.html>.
138Sato, Yoichi, et al., "Fast Tracking of Hands and Fingertips in Infrared Images for Augmented Desk Interface," Mar. 2000, 4th International Conference on Automatic Face-and Gesture-Recognition, Grenoble, France.
139Schneider, John K., "Improved Fingerprint System Using Rolled and Multi-segmented Techniques," U.S. Appl. No. 60/575,952, filed Jun. 1, 2004, pp. 1-6.
140Screenshots of Reactrix Product Demo Video, Mar. 28, 2003, <http://web.archive.org/web/20030407174258/http://www.reactrix.corn/demo/reactrix—demo.wmv>.
141Sester, Marie, "Access," 2001, Interaction '99 Biennial Catalog, Gifu, Japan, available online at .
142Sester, Marie, "Access," 2001, Interaction '99 Biennial Catalog, Gifu, Japan, available online at <http://www.accessproject.net/concept.html>.
143Simon Penny, "Fugitive," 1995-7, http://wwvv.ace.uci.edu/penny/works/fugitive/fugitive.html.
144Snibbe, Scott, "Boundary Functions," 1998, art installation, description available online at .
145Snibbe, Scott, "Screen Series," 2002-2003, art installation, description available online at .
146Snibbe, Scott, "Boundary Functions," 1998, art installation, description available online at <http://snibbe.com/scott/bf/index.htm>.
147Snibbe, Scott, "Screen Series," 2002-2003, art installation, description available online at <http://snibbe.com/scott/screen/index.html>.
148Sonneck, Georg, et al., "Optimized One-to-One Personalization of Web Applications using a Graph Based Model," IEEE-22, Apr. 26, 2003, 9 pgs.
149Sparacino, Flavia et al., "Media in performance: interactive spaces for dance, theater, circus and museum exhibits," 2000, IBM Systems Journal, vol. 39, No. 3-4, pp. 479-510.
150Sparacino, Flavia, "(Some) computer vision based interfaces for interactive art and entertainment installations," 2001, INTER-FACE Body Boundaries, Anomalie digital-arts, No. 2, Paris, France.
151Sparacino, Flavia, "(Some) computer vision based interfaces for interactive art and entertainment installations," 2001, INTER—FACE Body Boundaries, Anomalie digital—arts, No. 2, Paris, France.
152Stauffer, Chris and W. Eric L. Grimson, "Learning Patterns of Activity Using Real-Time Tracking," Aug. 2000, IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 22, No. 8, pp. 747-757.
153Summons to Attend Oral Proceedings in European Application No. 02739710.8, dated Aug. 12, 2005.
154Summons to Attend Oral Proceedings in European Application No. 02739710.8, dated Jun. 12, 2009.
155Supreme Particles, "Plasma/Architexture," 1994, available online at <http://www.particles.de/paradocs/plasma/plasma—e.html>, downloaded on May 21, 2007.
156Tan, P, et al., "Highlight Removal by Illumination-Constrained Inpainting," Ninth IEEE International Conference on Computer Vision, Oct. 13-16, 2003.
157The History of Microsoft Surface, downloaded from <http://www.microsoft.com/presspass/presskits/surfacecomputing/docs/SurfaceHistoryBG.doc> on Sep. 24, 2009.
158Torr, P.H.S. et al., "The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix," Sep./Oct. 1997, International Journal of Computer Vision, vol. 24, No. 3, pp. 271-300.
159Toth, Daniel et al., "Illumination-Invariant Change Detection," Apr. 2-4, 2000, 4th IEEE Southwest Symposium on Image Analysis and Interpretation, p. 3.
160Trefzger, Petra, "Vorwerk," 2000, art installation, description available online at .
161Trefzger, Petra, "Vorwerk," 2000, art installation, description available online at <http://www.petracolor.de>.
162Utterback, Camille and Achituv, Romy, "Text Rain," 1999, art installation, available online at .
163Utterback, Camille and Achituv, Romy, "Text Rain," 1999, art installation, available online at <http://www.camilleutterback.com/textrain.html>.
164Vogt, Florian et al., "Highlight Substitution in Light Fields," IEEE International Conference on Image Processing, Sep. 22-25, 2002.
165Wang, Junxian, et al., "Specular reflection removal for human detection under aquatic environment," Jun. 27-Jul. 2, 2004 IEEE Conference on Computer and Pattern Recognition Workshop (CVPRW04) vol. 8, p. 130.
166Wellner, Pierre, "Interacting with paper on the DigitalDesk," Jul. 1993, Communications of the ACM, Special issue on computer augmented environments: back to the real world, vol. 36, Issue 7, pp. 87-96.
167Wellner, Pierre, "Digital Desk Calculator:Tangible Manipulation on a Desktop Display" Proceedings of the Symposium on User Interface Software and Technol (UIST), Hilton Head, S. Carolina, Nov. 11-13, 1991.
168Wilson, Andrew, "PlayAnywhere: A Compact Interactive Tabletop Projection-Vision System," ACM Symposium on User Interface Software and Technology (UIST), Oct. 23-27, 2005, Seattle, Washington, U.S.A.
169Written Opinion for PCT/US2002/017843, filed Jun. 4, 2002, dated Feb. 5, 2003.
170Written Opinion of the International Searching Authority for PCT/US2004/035477, filed Oct. 25, 2004.
171Written Opinion of the International Searching Authority for PCT/US2004/035478, filed Oct. 25, 2004.
172Written Opinion of the International Searching Authority for PCT/US2004/041318, filed Dec. 9, 2004.
173Written Opinion of the International Searching Authority for PCT/US2004/041319, filed Dec. 9, 2004.
174Written Opinion of the International Searching Authority for PCT/US2004/041320, filed Dec. 9, 2004.
175Written Opinion of the International Searching Authority for PCT/US2005/008984, filed Mar. 18, 2005.
176Written Opinion of the International Searching Authority for PCT/US2006/030720, filed Aug. 4, 2006.
177Written Opinion of the International Searching Authority for PCT/US2008/059900, filed Apr. 10, 2008.
178 *Yang Xiao; Throughput and Delay Limits of IEEE 802.11; Aug. 2002.
Referenced by
Citing PatentFiling datePublication dateApplicantTitle
US8625845Feb 16, 2010Jan 7, 2014Quantum Signal, LlcOverlaying virtual content onto video stream of people within venue based on analysis of the people within the video stream
Classifications
U.S. Classification348/61
International ClassificationH04N9/47
Cooperative ClassificationA63F2300/1093, A63F2300/6045, H04N21/441, H04N21/47815, H04N21/4784, H04N21/4223, H04N21/41407
Legal Events
DateCodeEventDescription
Jul 3, 2012CCCertificate of correction
Jun 2, 2009ASAssignment
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DHANDO INVESTMENTS, INC.;REEL/FRAME:022766/0934
Effective date: 20090409
Owner name: INTELLECTUAL VENTURES HOLDING 67 LLC, NEVADA
May 27, 2009ASAssignment
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:REACTRIX (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC;REEL/FRAME:022741/0627
Owner name: DHANDO INVESTMENTS, INC., DELAWARE
Effective date: 20090409
May 19, 2009ASAssignment
Owner name: REACTRIX (ASSIGNMENT FOR THE BENEFIT OF CREDITORS)
Effective date: 20090406
Free format text: CONFIRMATORY ASSIGNMENT;ASSIGNOR:REACTRIX SYSTEMS, INC.;REEL/FRAME:022707/0688
May 17, 2007ASAssignment
Effective date: 20031001
Owner name: OLYMPUS CORPORATON, JAPAN
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OLYMPUS OPTICAL CO., LTD.;REEL/FRAME:019346/0439
Dec 4, 2006ASAssignment
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BELL, MATTHEW;REEL/FRAME:018649/0660
Owner name: REACTRIX SYSTEMS, INC., CALIFORNIA
Effective date: 20061204