|Publication number||US20110019919 A1|
|Application number||US 12/721,477|
|Publication date||Jan 27, 2011|
|Filing date||Mar 10, 2010|
|Priority date||Feb 15, 2004|
|Also published as||EP1747508A2, EP1747508A4, EP1749260A2, EP1749260A4, EP1756704A2, EP1756704A4, EP1756729A2, EP1756729A4, EP1759272A2, EP1759272A4, EP1759273A2, EP1759273A4, EP1759274A2, EP1759274A4, EP1759275A2, EP1759275A4, EP1759276A2, EP1759276A4, EP1759277A2, EP1759277A4, EP1759281A2, EP1759281A4, EP1761841A2, EP1761841A4, EP1763842A2, EP1763842A4, EP1880301A2, EP1880301A4, EP2490152A1, US7421155, US7437023, US7593605, US7596269, US7599580, US7599844, US7606741, US7702624, US7706611, US7707039, US7742953, US7818215, US7831912, US8005720, US8019648, US8064700, US8214387, US8442331, US8447144, US8515816, US8521772, US8619147, US8799303, US8831365, US20050234851, US20060023945, US20060026078, US20060026140, US20060029296, US20060036462, US20060036585, US20060041538, US20060041590, US20060041828, US20060047639, US20060050996, US20060061806, US20060078207, US20060087683, US20060119900, US20060294094, US20070011140, US20100177970, US20100183246, US20110044547, US20110085211, US20110154507, US20120041941, US20120297277, US20130132367, US20130201527, WO2005096750A2, WO2005096750A3, WO2005096755A2, WO2005096755A3, WO2005098596A2, WO2005098596A3, WO2005098597A2, WO2005098597A3, WO2005098598A2, WO2005098598A3, WO2005098599A2, WO2005098599A3, WO2005098600A2, WO2005098600A3, WO2005098601A2, WO2005098601A3, WO2005098602A2, WO2005098602A3, WO2005098603A2, WO2005098603A3, WO2005098604A2, WO2005098604A3, WO2005098605A2, WO2005098605A3, WO2005098606A2, WO2005098606A3, WO2005098607A2, WO2005098607A3, WO2005098610A2, WO2005098610A3, WO2005114380A2, WO2005114380A3|
|Publication number||12721477, 721477, US 2011/0019919 A1, US 2011/019919 A1, US 20110019919 A1, US 20110019919A1, US 2011019919 A1, US 2011019919A1, US-A1-20110019919, US-A1-2011019919, US2011/0019919A1, US2011/019919A1, US20110019919 A1, US20110019919A1, US2011019919 A1, US2011019919A1|
|Inventors||Martin T. King, Clifford A. Kushler, James Quentin Stafford-Fraser|
|Original Assignee||King Martin T, Kushler Clifford A, James Quentin Stafford-Fraser|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (3), Referenced by (6), Classifications (78), Legal Events (2)|
|External Links: USPTO, USPTO Assignment, Espacenet|
The use of printed books and documents (hereafter referred to as simply “documents”) has been commonplace for many hundreds of years. Over the centuries, various tools and strategies have evolved to try to make more effective use of printed documents. These range from handwritten (or typed) notes on the contents of documents (either on the document itself or in a separate but related document), to highlighting passages in a document deemed to be of greater significance, to manually copying passages from a document (or using a scanning copier, despite the fact that copyrights are often so infringed), to the simple act of including a printed index at the end of a document to facilitate locating information on a specific topic. Many new tools and strategies are needed now that a document can be accessed in an electronic, searchable format such as a file on a local computer or a web page that can be accessed with a browser.
The relatively recent innovation of providing a searchable electronic copy of a document that can be accessed using a standard personal computer is quite powerful in increasing the ease with which the desired contents can be accessed and utilized. When a traditional index is provided in such a context, once an entry is found, a single click of the mouse can take the user directly to the desired entry in the electronic text. Once a relevant entry has been found, its location can be retained as a “bookmark” and filed according to the user's choice, making future access to the location in the electronic document quick and easy.
It is a problem that these very useful tools for working with electronic documents cannot be used with the vast existing reserve of printed books and documents. Even though there are tremendous advantages that accrue with access to an electronic version of a document, these are obviously only available when such an electronic version is available (and a computer is available to access the electronic document). Even in those instances where such an electronic version is available, this still does nothing to enhance the actual use of the paper document itself. Furthermore, when newer revisions and updated versions of either the paper or the electronic version of a document become available, the owner of a previous version generally has little recourse but to go and purchase a new, updated copy of the material.
As is well known in the art, by using traditional methods for document processing (such as, for example, a flatbed scanner combined with appropriate computer software for optical character recognition), a user can create an electronic version of a paper document. However, in addition to the fact that such a task is laborious, time-consuming, and generally error-prone, it usually involves infringement of the copyright held by the author of the textbook in question. Further, even when an electronic version of a document is thus created, it is still subject to the limitations mentioned above—a computer is required to make any use of the additional features offered, and no additional utility is provided for the paper document itself. Despite the prevalence of computers, and despite the advantages conveyed by searchable electronic versions of documents, the continued widespread preference for creating and using paper documents is a clear indication of how attractive they remain to the average user. The portability, convenience, ease of viewing, and even the “feel” of paper documents clearly retain a powerful appeal to most individuals.
Therefore, there exists a need to allow users to easily navigate between printed and electronic versions of documents. There also exists a need to allow users to easily access electronic document versions or links of a paper document or article.
Systems and methods for quickly and easily getting information about, or included in, a paper document into a public or private digital page are described. An example system includes a scanner that generates scan information of at least a portion of a paper document and a processing system in data communication with the scanner over a network. The processing system stores digital content corresponding to a plurality of paper documents into a database, receives the generated scan information from the scanner, searches the database to identify digital content associated with the received scan information, and sends at least one of a portion of the identified digital content or an address associated with the identified digital content to a network-accessible location being associated with the user, if results of that database search are positive. In one embodiment, the network-accessible location is a web log page associated with the user.
In another embodiment of the disclosed innovations, a blogger could scan some text from a paper document with a portable scanning device. The scanning device could either perform optical character recognition (OCR) on the scanned image or transmit either the raw image data or a partially processed version of the image data to a computer for remote OCR processing. The computer would submit at least a portion of the text to a search engine that would locate an electronic version of the paper document and return a hyperlink to the computer. The computer could then modify a predetermined blog page by adding an entry having at least a portion of the scanned text followed by a hyperlink to the electronic document. By optionally including a portion of the scanned text in the blog entry, the hyperlink can be put in context without requiring the blogger to type any explanatory text.
The computer 106 may include a memory containing computer executable instructions for processing an order request from scanning device 102 by obtaining an order. An example of an order could include an identifier (such as a serial number of the scanning device 102 or an identifier that uniquely identifies the user of the scanner), scanning context information and/or scanned information that serves as the basis for a search of one or more document databases 112 to uniquely identify the digital document corresponding to the document 104 being scanned. The computer 106 also includes a processor and memory. In alternative embodiments, operating environment 100 may include more or less components.
In other embodiments, the system 100 includes a wireless device 118, a vendor server 120 and an aggregator server 126. The servers 120 and 126 are coupled to each other via various sorts of networks (e.g., the Internet 130 or wireless network 132). Regardless of the manner by which the devices are coupled to each other, the scanning device 102, the computer 106, the wireless device 118, the account server 108, the document server 110, the vendor server 120 and the aggregator server 126 may be operable in accordance with well-known commercial transaction and communication protocols. In various embodiments, the functions and capabilities of the scanning device 102, the computer 106, and the wireless device 118 may be wholly or partially integrated into one device. Thus, the terms scanning device, computer and wireless device, could refer to the same device depending upon whether the device incorporates functions or capabilities corresponding to the roles of the scanning device 102, the computer 106 and the wireless device 118.
Additionally, in various embodiments, the computer 106 and the account server 108 may be wholly or partially integrated. Thus, the terms computer and account server, as used herein, for the purpose of this specification, including the claims, shall be interpreted with the meaning of an appropriately equipped device, operating in accordance with either a computer or an account server role.
In accordance with another embodiment, an operating environment 100 includes a document server 110 that has speech recognition capabilities. In this environment, no scanning device 102 is required, and in lieu of scanning a portion of a rendered document, the user reads aloud the portion of the document and the document server 110 performs speech recognition of the spoken text portion to generate the search query to be processed. For example, the user may place a telephone call from wireless device 118 directly to an access number for document server 110, and in response to automated prompts, reads aloud the portion of the rendered document. Because the ultimate task of the server is to identify a document within its database corresponding to the spoken text (that may be assumed to occur within the known corpus of text within the database), the task of correctly recognizing the spoken words is vastly easier than the task of correctly recognizing spoken text when no such information is available to constrain the search domain. This speech-recognition-based approach also has the advantage that it can be implemented using the currently available technology infrastructure, and does not require a user base of individuals who possess a scanning device 102. Thus, in the following disclosure, functions described as being performed by a scanner can alternatively be performed using a speech-recognition-based approach. The unique user identity associated with the scanner may equivalently be associated with, for example, a cellular phone used to call document server 110.
As an example of one use of the scanner 102, a reader may scan some text from a newspaper article with scanner 102. The text is scanned as a bit-mapped image via scan port 150. The logic 172 causes the bit-mapped image to be stored in memory 180. The logic 172 may also perform optical character recognition (OCR) or other post-scan processing on the bit-mapped image to convert it to text or an intermediate form of processed image data. The scanner 102 may then upload the bit-mapped image (or text or processed image data, if post-scan processing has been performed by the logic 172) to the computer 106 via the interface 178.
The scanner 102 further includes a velocity sensor 182 to sense velocity aspects of a scan action (e.g. how fast and in what direction a scan action occurs), an acceleration sensor 184 to detect acceleration aspects of a scan action, and a temperature sensor 188. Of course, not all scanner embodiments may include each of these features, and some embodiments may include additional features not found in the exemplary embodiment.
If there are results from the search, then the process 200 determines if the results are to go to one or more of a public or private location associated with the operator of the scanning device 102, see decision block 216. The results of the search, whether they be a link to a network-based location of the found results (e.g., a hyperlink) or an actual document (or portion thereof) identified in the search, are sent to a public location, at a block 220. The public location associated with the user can be in a number of different formats. A web log (blog) is one example of a public location that receives the results of the search. In one embodiment, the blog is automated to automatically post the results of the search in various formats. Blogs are described in more detail below. If the results of the search determined at the decision block 216 go to a private location, then a private location associated with the user receives the results of the search, see block 218. Whether the search results go to a public or private location associated with the user, various information of the search and the user may be recorded for later use, see block 224. The information recorded may be used, for example, to establish or modify a ranking within the document database 112 of any of the information or associated documents that were scanned and searched, and also to provide various demographic information with regard to the searcher (e.g., location, age, sex, etc.) and the items scanned by the searcher (which may be used by the document server 110 to create other useful databases).
A blog is an online journal (the contraction of “web log”) or a website. A blog usually shows the following primary characteristics:
frequently updated with new content;
content unit is a “post” or an “entry”—it may not necessarily be text but also pictures, sounds, videos, etc.;
posts are dated;
full posts or summaries are displayed on the blog home page with the last or freshest ones on top—that posts are listed in reverse chronologic order makes it very easy to see if a blog has been updated recently, or appears to be stalled, it is therefore an incentive (along with dated posts) for authors to publish frequently in order to keep the content fresh; and
posts are accessible through a permanent link and/or chronological archives (daily/weekly/monthly, or a linear previous/next navigation).
A blog may show the following secondary characteristics, which are not necessarily distinctive of blogs but are instrumental in their adoption:
the publication process is supported by a microcontent or personal publishing system—the emergence of those free or cheap systems which help people without knowledge of web technologies to easily publish content on the web has been the key factor in the spread of blogs outside the web-savvy, geek community;
a news feed is available for use with a news aggregator;
visitors may comment on posts, with or without registration, and their comments may appear publicly along with the post. At any time, a blog author may decide on a post-by-post basis if comments are allowed (most blogs allow comments while most web sites do not). Because most blogs allow comments, a blog may provide a newsfeed that includes visitor comments to improve interaction between publishers and their audience;
posts may be classified by categories;
each post may display a list of external links that point to it allowing readers to discover more sources around a particular topic—techniques known as TrackBacks, Pingbacks and Referrer tracking allow for the automatic creation of such back links between two websites;
display a list of other blogs (blogolist) and websites of interest—this is a great way to discover new blogs and also gives a better idea of who are the authors by seeing who they link to; and
each time a blog is updated, the blog may “ping” (i.e. signal to) a server that indexes and publishes a list of recently updated blogs (e.g. daypop).
In another embodiment, the article includes an icon 300 or other type of graphic image or text that when highlighted by the scanner 102 automatically sends any of the results of the search directly to the blog associated with the user. Of course, the control icon 300 does not necessarily have to be on the paper document that includes the article. The control icon 300 may be scanned from any document. For example, the user may carry a wallet-sized card with various control icons that the user may scan to cause the system 100 to perform certain actions. For example, the user may scan a control icon 300 which causes the text from the next scan to be submitted to a search engine and the search results automatically posted to a predetermined blog.
While the system has been illustrated and described, as noted above, many changes can be made without departing from its spirit and scope. Accordingly, the scope of the invention is not limited by such illustration and description. Instead, the invention should be determined entirely by reference to the claims that follow.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US6671684 *||Sep 1, 2000||Dec 30, 2003||Ricoh Co., Ltd.||Method and apparatus for simultaneous highlighting of a physical version of a document and an electronic version of a document|
|US7185275 *||Feb 27, 2001||Feb 27, 2007||International Business Machines Corporation||Method and computer system for enabling a user to construct a web-site navigation|
|US7392475 *||May 23, 2003||Jun 24, 2008||Microsoft Corporation||Method and system for automatic insertion of context information into an application program module|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US8600196||Jul 6, 2010||Dec 3, 2013||Google Inc.||Optical scanners, such as hand-held optical scanners|
|US8899481||Mar 6, 2013||Dec 2, 2014||Symbol Technologies, Inc.||Apparatus for and method of automatically integrating an auxiliary reader in a point-of-transaction system having a workstation reader|
|US9075779||Apr 22, 2013||Jul 7, 2015||Google Inc.||Performing actions based on capturing information from rendered documents, such as documents under copyright|
|US9081799||Dec 6, 2010||Jul 14, 2015||Google Inc.||Using gestalt information to identify locations in printed information|
|US20060023945 *||Apr 1, 2005||Feb 2, 2006||King Martin T||Search engines and systems with handheld document data capture devices|
|WO2013113955A1 *||Feb 3, 2012||Aug 8, 2013||Kato Capital Group, S.L.||Device and method for creating links|
|International Classification||G06K9/46, G06F17/30, G06F7/00, G06Q10/00, G06Q30/00, G06F17/24|
|Cooperative Classification||H04N1/34, H04N1/32128, G06Q30/00, G06Q20/102, H04N1/2187, H04N2201/3263, G06F17/241, G06F17/3002, G06Q30/06, G06Q30/0601, G06Q30/0241, G06F17/30637, G06F17/30011, G06Q20/4012, H04N2201/3266, G06F17/30879, H04N1/2166, G06K9/00, G06F17/2235, G06K9/685, G06Q10/10, Y10S707/99931, G06F17/30038, H04N1/0036, G06Q30/0623, G06F17/30619, G06Q30/0207, H04N1/00381, G06Q10/00, H04N2201/0081, H04N1/00326, H04N2201/3215, H04N1/00374, G06Q30/02, H04N2201/3277, H04N1/107, Y10S707/99934, G06K9/228, H04N1/00204, G06F17/30047, Y10S707/99945, G06K2209/01, H04N2201/3249, G06Q30/0643, G06F17/30864, G06F17/243, G06K9/2063, G06K9/2054, H04N2201/3253, G06Q30/0603, G06Q30/04, G06F17/30029, G06Q20/12, H04N1/00244, H04N1/00363, G06Q30/0641, G06F17/218, G06Q30/0283, G06Q40/04, G06F17/2247, G06F17/30876, G06K9/72, Y10S707/99936, G07F17/40, G06Q50/22, G06K17/0016, H04N2201/3278, G06F17/30026, Y10S707/99943, G06K9/00442|
|Feb 3, 2011||AS||Assignment|
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KING, MARTIN T.;KUSHLER, CLIFFORD A.;STAFFORD-FRASER, JAMES QUENTIN;SIGNING DATES FROM 20090219 TO 20090225;REEL/FRAME:025738/0197
Owner name: EXBIBLIO B.V., NETHERLANDS
|Feb 9, 2011||AS||Assignment|
Owner name: GOOGLE INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:EXBIBLIO B.V.;REEL/FRAME:025779/0251
Effective date: 20110105