Search Images Maps Play YouTube News Gmail Drive More »
Advanced Patent Search | Web History | Sign in

Patents

An image-based information retrieval system is disclosed that includes a mobile telephone and a remote server. The mobile telephone has a built-in camera and a communication link for transmitting an image from the built-in camera to the remote server. The remote server has an optical character recognition engine for generating a first confidence value based on an image from the mobile telephone, an object recognition engine for generating a second confidence value based on an image from the mobile telephone, a face recognition engine for generating a third confidence value based on an image from the mobile telephone, and an integrator module for receiving the first, second, and third confidence values and generating a recognition output.

Citations

Cited PatentFiling dateIssue dateOriginal AssigneeTitle
US5884247Oct 31, 1996Mar 16, 1999Dialect CorporationMethod and apparatus for automated language translation
US6023241Nov 13, 1998Feb 8, 2000Intel CorporationDigital multimedia navigation player/recorder
US6148105Apr 22, 1999Nov 14, 2000Hitachi, Ltd.Character recognizing and translating system and voice recognizing and translating system
US6208626Dec 24, 1998Mar 27, 2001Real-time satellite communication system using separate control and data transmission paths
US6272231Nov 6, 1998Aug 7, 2001Eyematic Interfaces, Inc.Wavelet-based facial motion capture for avatar animation
US6301370Dec 4, 1998Oct 9, 2001Eyematic Interfaces, Inc.Face recognition from video images
US6470264May 19, 2000Oct 22, 2002Portable information-providing apparatus
US6504571May 18, 1998Jan 7, 2003International Business Machines CorporationSystem and methods for querying digital image archives using recorded parameters
US20010032070Dec 28, 2000Apparatus and method for translating visual text
US20020101568Jan 30, 2002Interactive data view and command system
US20020184203Jun 13, 2002LTU TechnologiesProcess for electronically marketing goods or services on networks of the internet type
US20020187774May 14, 2002Product order method and system
US20030044608Feb 26, 2002FUJI XEROX CO., LTD.Nanowire, method for producing the nanowire, nanonetwork using the nanowires, method for producing the nanonetwork, carbon structure using the nanowire, and electronic device using the nanowire
US20030164819Mar 4, 2002Portable object identification and translation system
US20030198368Apr 22, 2003Samsung Electronics Co., Ltd.Method for verifying users and updating database, and face verification system using the same
US20040004616Jul 3, 2003Mobile equipment with three dimensional display function
US20050041862Nov 6, 2003MOBILE PHONE SYSTEM WITH A CARD CHARACTER RECOGNITION FUNCTION
US20050185060Feb 20, 2004Image base inquiry system for search engines for mobile telephones with integrated camera
US20060012677May 13, 2005Image-based search engine for mobile phones with camera
US20060026202Oct 22, 2003Mobile resemblance estimation

Referenced by

Citing PatentFiling dateIssue dateOriginal AssigneeTitle
US7907940Apr 30, 2010Mar 15, 2011Jumptap, Inc.Presentation of sponsored content based on mobile transaction event
US7970389Apr 16, 2010Jun 28, 2011JumpTap, Inc.Presentation of sponsored content based on mobile transaction event
US8027879Oct 30, 2007Sep 27, 2011JumpTap, Inc.Exclusivity bidding for mobile sponsored content
US8041717Jul 30, 2010Oct 18, 2011JumpTap, Inc.Mobile advertisement syndication
US8050675Sep 24, 2010Nov 1, 2011JumpTap, Inc.Managing sponsored content based on usage history
US8051169Apr 13, 2007Nov 1, 2011Digimarc CorporationMethods and systems useful in linking from objects to remote resources
US8098894Jun 20, 2008Jan 17, 2012YAHOO! Inc.Mobile imaging device as navigator
US8099434Apr 29, 2010Jan 17, 2012Jumptap, Inc.Presenting sponsored content on a mobile communication facility
US8103545Nov 5, 2005Jan 24, 2012Jumptap, Inc.Managing payment for sponsored content presented to mobile communication facilities
US8121618Feb 24, 2010Feb 21, 2012Digimarc CorporationIntuitive computing methods and systems
US8131271Oct 30, 2007Mar 6, 2012Jumptap, Inc.Categorization of a mobile user profile based on browse behavior
US8156128Jun 12, 2009Apr 10, 2012Jumptap, Inc.Contextual mobile content placement on a mobile communication facility
US8175585Sep 18, 2011May 8, 2012Jumptap, Inc.System for targeting advertising content to a plurality of mobile communication facilities
US8180332Sep 18, 2011May 15, 2012Jumptap, Inc.System for targeting advertising content to a plurality of mobile communication facilities
US8189964Dec 7, 2009May 29, 2012Google Inc.Matching an approximately located query image against a reference image set
US8195133Oct 30, 2007Jun 5, 2012Jumptap, Inc.Mobile dynamic advertisement creation and placement
US8195513Nov 12, 2011Jun 5, 2012Jumptap, Inc.Managing payment for sponsored content presented to mobile communication facilities
US8200205Jul 14, 2011Jun 12, 2012Jumptap, Inc.Interaction analysis and prioritzation of mobile content
US8209344Jul 19, 2010Jun 26, 2012Jumptap, Inc.Embedding sponsored content in mobile applications
US8229914May 8, 2006Jul 24, 2012Jumptap, Inc.Mobile content spidering and compatibility determination
US8238671Dec 7, 2009Aug 7, 2012Google Inc.Scene classification for place recognition
US8238888Mar 23, 2011Aug 7, 2012Jumptap, Inc.Methods and systems for mobile coupon placement

Claims

1. A method for updating object representations in an image database, the method comprising:

receiving an image of an object from a client device associated with a user, the receiving of the image constituting a first user query for information related to the object;

recognizing the object using an image recognition engine and an image database, the image database storing object identifiers in association with objects;

associating, from the image database, an object identifier with the recognized object;

transmitting to the client device associated with the user, information related to the recognized object;
receiving an indication of whether the user accepted the transmitted information as being relevant to the object; and
responsive to a computed confidence measure of the recognition of the object exceeding a given threshold, storing the image of the object in the image database in association with the object identifier;
wherein the confidence measure is computed at least in part based on the indication that the user accepted the transmitted information as being relevant to the object.

2. The method of claim 1, wherein the confidence measure is computed at least based in part on an amount of time that the client device displays the transmitted information.

3. The method of claim 1, wherein the confidence measure is computed at least based in part on whether a second user query for information related to the object is received within a predetermined amount of time of the first user query.

4. The method of claim 1, further comprising identifying a web page address related to the recognized object and storing the web page address in association with the object identifier.

5. The method of claim 1, further comprising

identifying an audio stream related to the recognized object and storing the audio stream in association with the object identifier.

6. The method of claim 1, wherein the recognized object comprises text, the method further comprising translating the text and storing the translated text in association with the object identifier.

7. The method of claim 1, wherein recognizing the object comprises at least one of: performing optical character recognition, performing object recognition, and performing facial recognition.

8. The method of claim 7, wherein performing object recognition comprises performing rigid texture object recognition.

9. The method of claim 7, wherein performing object recognition comprises performing articulate object recognition.

10. The method of claim 1, wherein the image of the object is obtained using a built-in camera of the client device.

11. A recognition computer server system for updating object representations in an image database, the recognition computer server system adapted to perform actions comprising:

receiving an image of an object from a client device associated with a user, the receiving of the image constituting a first user query for information related to the object;

recognizing the object using an image recognition engine and an image database, the image database storing object identifiers in association with objects;

associating, from the image database, an object identifier with the recognized object;

transmitting to the client device associated with the user, information related to the recognized object;
receiving an indication of whether the user accepted the transmitted information as being relevant to the object; and
responsive to a computed confidence measure of the recognition of the object exceeding a given threshold, storing the image of the object in the image database in association with the object identifier;
wherein the confidence measure is computed at least in part based on the indication that the user accepted the transmitted information as being relevant to the object.

12. The recognition computer server system of claim 11, wherein the confidence measure is computed at least based in part on an amount of time that the client device displays the transmitted information.

13. The recognition computer server system of claim 11, wherein the confidence measure is computed at least based in part on whether a second user query for information related to the object is received within a predetermined amount of time of the first user query.

14. The recognition computer server system of claim 11, the actions of the recognition computer server system further comprising identifying a web page address related to the recognized object and storing the web page address in association with the object identifier.

15. The recognition computer server system of claim 11, the actions of the recognition computer server system further comprising identifying an audio stream related to the recognized object and storing the audio stream in association with the object identifier.

16. The recognition computer server system of claim 11, wherein the recognized object comprises text, the method further comprising translating the text and storing the translated text in association with the object identifier.

17. The recognition computer server system of claim 11, wherein recognizing the object comprises at least one of: performing optical character recognition, performing object recognition, and performing facial recognition.

18. The recognition computer server system of claim 17, wherein performing object recognition comprises performing rigid texture object recognition.

19. The recognition computer server system of claim 17, wherein performing object recognition comprises performing articulate object recognition.

20. The recognition computer server system of claim 11, wherein the image of the object is obtained using a built-in camera of the client device.