In the creation of the index file, one index record is allocated to each set consisting of one retrieval key and the initial and final positions in the motion image of one frame to which the retrieval key is allocated, and information on this set is stored therein. In the query processing, for a query specified by a Boolean expression of retrieval keys, records whose keywords match any of the retrieval keys included in the query are retrieved from the index file. Thereafter, all the initial and final positions of the matching records are arranged along a time axis. For each of intervals defined by those positions, a truth table is created in which the allocation of the retrieval keys included in the query is expressed by truth values, and the logical condition of the query is evaluated based on the table. |
Citations|
| US4937743 | Sep 10, 1987 | Jun 26, 1990 | IntelliMED Corporation | Method and system for scheduling, monitoring and dynamically managing resources | | US4965753 | Feb 23, 1990 | Oct 23, 1990 | CAE-Link Corporation, Link Flight | System for constructing images in 3-dimension from digital data to display a changing scene in real time in computer image generators | | US4979050 | Dec 2, 1983 | Dec 18, 1990 | Lex Computer and Management Corporation | Video composition method for assembling video segments | | US5182677 | Apr 24, 1990 | Jan 26, 1993 | Sony Corporation | Editing system and method of editing wherein a common scene is recorded asynchronously different media | | US5267334 | Jan 21, 1993 | Nov 30, 1993 | Apple Computer, Inc. | Encoding/decoding moving images with forward and backward keyframes for forward and reverse display | | US5267351 | Dec 22, 1989 | Nov 30, 1993 | Avid Technology, inc. | Media storage and retrieval system | | US5317729 | Oct 24, 1990 | May 31, 1994 | International Business Machines Corporation | Method for the storage of multi-versioned data with retrieval based on searched query | | US5339166 | Oct 30, 1992 | Aug 16, 1994 | Telediffusion de France | Motion-dependent image classification for editing purposes |
Referenced by|
| US5550965 | Dec 27, 1993 | Aug 27, 1996 | Lucent Technologies Inc. | Method and system for operating a data processor to index primary data in real time with iconic table of contents | | US5561796 | Mar 14, 1995 | Oct 1, 1996 | Sharp Kabushiki Kaisha Real World Computing Partnership | Apparatus for searching for speech and moving images | | US5600775 | Aug 26, 1994 | Feb 4, 1997 | emotion, inc. | Method and apparatus for annotating full motion video and other indexed data structures | | US5628009 | Sep 22, 1995 | May 6, 1997 | Fujitsu Limited | Information retrieval system using hierarchical data-management function | | US5644694 | Dec 14, 1994 | Jul 1, 1997 | Cyberflix Inc. | Apparatus and method for digital movie production | | US5680159 | Dec 8, 1994 | Oct 21, 1997 | Interactive Sales Systems | Interactive display system using a laser disk player replaying video frames in response to touch force control monitor | | US5717869 | Nov 3, 1995 | Feb 10, 1998 | Xerox Corporation | Computer controlled display system using a timeline to control playback of temporal data representing collaborative activities | | US5727204 | Jun 7, 1995 | Mar 10, 1998 | Hughes Electronics | Database organization for rapid multi-set membership determination | | US5758180 | Apr 15, 1993 | May 26, 1998 | Sony Corporation Sony Electronics, Inc. | Block resizing function for multi-media editing which moves other blocks in response to the resize only as necessary | | US5760767 | Oct 26, 1995 | Jun 2, 1998 | Sony Corporation Sony Electronics, Inc. | Method and apparatus for displaying in and out points during video editing | | US5768514 | Nov 28, 1995 | Jun 16, 1998 | Canon Kabushiki Kaisha | Cooperative activity system and method | | US5786814 | Nov 3, 1995 | Jul 28, 1998 | Xerox Corporation | Computer controlled display system activities using correlated graphical and timeline interfaces for controlling replay of temporal data representing collaborative activities | | US5794249 | Dec 21, 1995 | Aug 11, 1998 | Hewlett-Packard Company | Audio/video retrieval system that uses keyword indexing of digital recordings to display a list of the recorded text files, keywords and time stamps associated with the system | | US5818436 | Apr 7, 1997 | Oct 6, 1998 | Kabushiki Kaisha Toshiba | Apparatus and method for playing back continuous data | | US5822524 | Jul 21, 1995 | Oct 13, 1998 | Infovalue Computing, Inc. | System for just-in-time retrieval of multimedia files over computer networks by transmitting data packets at transmission rate determined by frame size | | US5826206 | Mar 12, 1996 | Oct 20, 1998 | Training Inovations Group, LLC | Debriefing systems and methods for retrieving and presenting multiple datastreams with time indication marks in time synchronism | | US5832495 | Jul 8, 1996 | Nov 3, 1998 | Survivors of the Shoah Visual History Foundation | Method and apparatus for cataloguing multimedia data | | US5852528 | Dec 27, 1996 | Dec 22, 1998 | Sony Corporation | Video information recording method which uses a comparison of event information in two recorded information packets | | US5874986 | Jun 26, 1996 | Feb 23, 1999 | AT&T Corp | Method for communicating audiovisual programs over a communications network | | US5878410 | Sep 13, 1996 | Mar 2, 1999 | Microsoft Corporation | File system sort order indexes | | US5893110 | Aug 16, 1996 | Apr 6, 1999 | Silicon Graphics, Inc. | Browser driven user interface to a media asset database | | US5969755 | Feb 5, 1997 | Oct 19, 1999 | Texas Instruments Incorporated | Motion based event detection system and method | | US6003024 | Nov 5, 1997 | Dec 14, 1999 | Amazon. com | System and method for selecting rows from dimensional databases | | US6008802 | Jan 5, 1998 | Dec 28, 1999 | Intel Corporation | Method and apparatus for automatically performing a function based on the reception of information corresponding to broadcast data | | US6032156 | Apr 1, 1998 | Feb 29, 2000 | | System for automated generation of media | | US6118923 | May 5, 1997 | Sep 12, 2000 | Intel Corporation | Method and apparatus for deferred selective viewing of televised programs | | US6160950 | Jul 15, 1997 | Dec 12, 2000 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for automatically generating a digest of a program | | US6166733 | Sep 4, 1998 | Dec 26, 2000 | Fujitsu Limited | Index indicator, index display method and recording medium storing index indicator program | | US6192357 | Nov 3, 1998 | Feb 20, 2001 | Platinum Technology, Inc. | Method and apparatus for optimizing query generation by selectively utilizing attributes or key values | | US6195498 | Nov 28, 1997 | Feb 27, 2001 | Canon Kabushiki Kaisha | Image reproducing apparatus capable of changing reproducing speed | | US6212527 | Nov 2, 1998 | Apr 3, 2001 | Survivors of the Shoah Visual History Foundation | Method and apparatus for cataloguing multimedia data | | US6233573 | Dec 13, 1999 | May 15, 2001 | Amazon.com, Inc. | System and method for selecting rows from dimensional databases having temporal dimention | | US6263507 | Dec 5, 1996 | Jul 17, 2001 | Interval Research Corporation | Browser for use in navigating a body of information, with particular application to browsing information represented by audiovisual data | | US6271892 | Jun 2, 1994 | Aug 7, 2001 | Lucent Technologies Inc. | Method and apparatus for compressing a sequence of information-bearing frames having at least two media | | US6324535 | Dec 2, 1999 | Nov 27, 2001 | Amazon.com, Inc. | Method and apparatus for producing sequenced queries | | US6329994 | Mar 14, 1997 | Dec 11, 2001 | Zapa Digital Arts Ltd. | Programmable computer graphic objects | | US6331861 | Feb 23, 1999 | Dec 18, 2001 | Gizmoz Ltd. | Programmable computer graphic objects | | US6366930 | Apr 9, 1997 | Apr 2, 2002 | Computer Associates Think, Inc. | Intelligent data inventory & asset management systems method and apparatus | | US6424370 | Oct 8, 1999 | Jul 23, 2002 | Texas Instruments Incorporated | Motion based event detection system and method | | US6442543 | Dec 18, 2000 | Aug 27, 2002 | Amazon.com, Inc. | Method and apparatus for changing temporal database information | | US6502088 | Jul 8, 1999 | Dec 31, 2002 | International Business Machines Corporation | Method and system for improved access to non-relational databases | | US6549911 | Feb 16, 2001 | Apr 15, 2003 | Survivors of the Shoah Visual History Foundation | Method and apparatus for cataloguing multimedia data | | US6574638 | Sep 12, 2000 | Jun 3, 2003 | Survivors of the Shoah Visual History Foundation | Method and apparatus for cataloguing multimedia data using surveying data | | US6581071 | Sep 12, 2000 | Jun 17, 2003 | Survivors of the Shoah Visual History Foundation | Surveying system and method | | US6609134 | Feb 1, 2000 | Aug 19, 2003 | Hyundai Electronics Industries | Apparatus and method for retrieving moving picture using tree-structured moving picture index descriptor | | US6678417 | Nov 30, 1999 | Jan 13, 2004 | International Business Machines Corporation | Dictionary based video compression | | US6847982 | Jan 25, 2002 | Jan 25, 2005 | Computer Associates Think, Inc. | Intelligent data inventory and asset management system method and apparatus | | US6880171 | Jun 25, 1999 | Apr 12, 2005 | Interval Research Corporation | Browser for use in navigating a body of information, with particular application to browsing information represented by audiovisual data | | US6937764 | Aug 28, 2003 | Aug 30, 2005 | Hitachi, Ltd. | Method and apparatus for detecting local features of video, and recording medium storing the method | | US7085844 | Aug 31, 2001 | Aug 1, 2006 | | Method and apparatus for random play technology | | US7110047 | Nov 18, 2002 | Sep 19, 2006 | Koninklijke Philips Electronics N.V. | Significant scene detection and frame filtering for a visual indexing system using dynamic thresholds | | US7137062 | Dec 28, 2001 | Nov 14, 2006 | International Business Machines Corporation | System and method for hierarchical segmentation with latent semantic indexing in scale space | | US7143351 | Jul 6, 2000 | Nov 28, 2006 | NEC Corporation | Image display device and displaying method | | US7184593 | Jul 26, 2005 | Feb 27, 2007 | Hitachi, Ltd. | Method and apparatus for detecting local features of video, and recording medium storing the method | | US7225198 | Jul 30, 2001 | May 29, 2007 | Turbo Data Laboratories, Inc. | Data compiling method | | US7225219 | Nov 29, 2000 | May 29, 2007 | Broadspider Networks, Inc. | Distributed caching architecture for computer networks | | US7269516 | May 15, 2002 | Sep 11, 2007 | PsychoGenics, Inc. Carnegie Mellon University | Systems and methods for monitoring behavior informatics | | US7480446 | Feb 20, 2004 | Jan 20, 2009 | Vulcan Patents LLC | Variable rate video playback with synchronized audio | | US7565681 | Apr 13, 2005 | Jul 21, 2009 | Vulcan Patents LLC | System and method for the broadcast dissemination of time-ordered data | | US7580798 | Apr 27, 2007 | Aug 25, 2009 | Psychogenics, Inc. Carnegie Mellon University | Method for predicting treatment classes using animal behavior informatics | | US7765462 | Mar 26, 2004 | Jul 27, 2010 | Verizon Laboratories Inc. | Facilitation of hypervideo by automatic IR techniques utilizing text extracted from multimedia document in response to user requests | | US7779342 | Apr 3, 2003 | Aug 17, 2010 | Verizon Laboratories Inc. | Hypervideo: information retrieval at user request | | US7802177 | Jan 24, 2006 | Sep 21, 2010 | Verizon Laboratories | Hypervideo: information retrieval using time-related multimedia | | US7849475 | Jul 8, 2004 | Dec 7, 2010 | Interval Licensing LLC | System and method for selective recording of information | | US7882135 | Jul 31, 2009 | Feb 1, 2011 | Psychogenics, Inc. | Method for predicting treatment classes using behavior informatics | | US8046818 | Feb 19, 2009 | Oct 25, 2011 | Interval Licensing LLC | System and method for the broadcast dissemination of time-ordered data | | US8176515 | Mar 5, 2007 | May 8, 2012 | Interval Licensing LLC | Browser for use in navigating a body of information, with particular application to browsing information represented by audiovisual data | | US8238722 | Nov 4, 2008 | Aug 7, 2012 | Interval Licensing LLC | Variable rate video playback with synchronized audio | | USRE38284 | Dec 5, 1997 | Oct 21, 2003 | Information Presentation Solutions Development, Inc. | Computer-assisted interactive method and apparatus for making a multi-media presentation | | USRE41493 | Jul 10, 2003 | Aug 10, 2010 | NTech Properties, Inc. | System for automated generation of media | | USRE42683 | Feb 28, 2002 | Sep 6, 2011 | Ntech Properties, Inc. | System for automated generation of media |
Claims1. A computer-implemented method for allocating retrieval keys to frame intervals that form portions of an entire sequence of frames that constitute a stored motion image and updating an index file of motion image frame intervals on a storage medium, said index file comprising records that contain information on initial and final positions of said intervals in said motion image as well as information on said retrieval keys, said method comprising the steps of: - a. receiving as input a designation of one of said retrieval keys as a currently designated retrieval key;
- b. receiving as input a designation of initial and final positions of one of said intervals;
- c. extracting, from said index file, records that contain information on said currently designated retrieval key, in response to the designation of said initial and final positions;
- d. checking for the existence of any overlaps between said initial and final positions of said designated interval and the intervals defined by said extracted records;
- e. if any overlaps are detected in step (d), updating said index file so that it does not include any records associated with intervals that cause an overlap, but includes a record that contains information indicating initial and final positions of an interval that includes all the intervals that cause the overlaps, as well as information on the currently designated retrieval key;
- f. if no overlaps are detected in step (d), inserting into said index file a record that contains information on said designated initial and final positions as well as on said currently designated retrieval key; and
- g. iterating steps (b) through (f) until the designation of a new retrieval key is received as input.
2. A computer system for allocating retrieval keys to frame intervals that form portions of an entire sequence of frames that constitute a stored motion image and for updating an index file of motion image frame intervals on a storage device, said index file comprising records having information on initial and final positions of said intervals in said motion image as well as related information on said retrieval keys, said system comprising: - a. buffer means for receiving as input a designation of one retrieval key as a currently designated retrieval key;
- b. means for receiving as input a record having a designation of initial and final positions of one of said frame intervals;
- c. means for adding records received by said receiving means having information on frame intervals with designated initial and final positions related to said currently designated retrieval key to said buffer means that can be accessed faster than said storage device;
- d. means for iterating the operation of said adding means until the addition of frame ,intervals for said currently designated retrieval key is complete; and
- e. means for updating the contents of said buffer means to eliminate any overlaps of intervals defined by records related to the same retrieval key in said buffer means, said updating means for each record in said buffer means comprising:
- f. means for extracting, from said index file, records that contain frame interval information on the same retrieval key as said each buffer record; means for checking for the existence of any overlaps
- g. means for checking for the existence of any overlaps between the initial and final positions of an interval defined by said each buffer record and intervals defined by said extracted index file records for the same retrieval key;
- h. means, responsive to the detection of any overlaps, for updating said index file so that it does not include any records related to the same retrieval key with intervals that cause an overlap, but includes a record that contains information indicating the initial and final positions of an interval that includes all the intervals that cause tile overlaps, as well as information on said same related retrieval key; and
- i. means, responsive to the detection of no overlaps for inserting said each buffer record into said index file.
3. A computer-implemented method for allocating retrieval keys to frame intervals that form portions of an entire sequence of frames that constitute a stored motion image and updating an index file of motion image frame intervals on an external storage device, said index file comprising records that contain information on initial and final positions of said intervals in said motion image as well as information on said retrieval keys, said method comprising the steps of: - a. creating a temporary file in which records are sorted according to their retrieval keys, each record of which stores one keyword and information on initial and final positions of one interval to which said keyword is allocated;
- b. extracting, from said temporary file, records that contain identical keywords and placing them in a buffer that can be accessed faster than said external storage device;
- c. updating the contents of said buffer to eliminate any overlaps of initial and final positions of intervals defined by records in said buffer, said updating comprising for each record in said buffer,
- d. extracting, from said index file, records that contain information on an identical retrieval key as that of said buffer record;
- e. checking for the existence of any overlaps between intervals defined by said buffer record and intervals defined by said extracted records;
- f. if any overlaps are detected in step (e), updating said index file so that it does not include any records associated with intervals that cause an overlap, but includes a record that contains information indicating initial and final positions of an interval that includes all intervals that cause overlaps, as well as information on said identical retrieval key; and
- g. if no overlaps are detected in step (e), inserting said buffer record into said index file.
4. A computer-implemented method for allocating retrieval keys of frame intervals that form portions of an entire sequence of frames that constitute a stored motion image and updating an index file of motion image frame intervals on a storage medium, said index file comprising records that contain information on initial and final positions of said intervals in said motion image as well as information on said retrieval keys, said method comprising the steps of: - a. receiving an instruction for release of a retrieval key allocation, wherein the instruction includes a retrieval key and initial and final positions of an interval as parameters;
- b. extracting from said index file, records that contain information on said retrieval key of said instruction;
- c. checking for the existence of any overlaps between intervals defined by said extracted records and said interval of said instruction;
- d. if any intervals defined by said extracted records are completely included in said interval of said instruction, deleting records defining such intervals from said index file; and
- e. if there are any overlaps between intervals defined by said extracted records and said interval of said instruction, updating said index file so that initial and final positions defining such intervals are changed so as to eliminate the overlaps.
5. A computer-implemented method for retrieving frame sequences, that constitute portions of a stored motion image, by the use of an index file maintained on a storage medium, wherein each record in said index file contains one keyword and information on initial and final positions in said motion image of one frame sequence interval for which said keyword is allocated, said method comprising the steps of: - a. receiving a query specified by a Boolean expression of retrieval keys related to said keywords;
- b. extracting, from said index file, records that contain information with a keyword related to any retrieval key included in said query; and
- c. dividing the whole interval of said motion image into a plurality of candidate intervals on the basis of initial and final positions stored in said extracted records and the initial and final positions of said whole interval of said motion image, and evaluating said Boolean expression according to whether a keyword related to a retrieval key has been allocated to each candidate interval to determine the candidate intervals to which all retrieval keys included in said query have been allocated.
6. A method as set forth in claim 5, wherein, in said index file, there are no overlaps between frame sequence intervals defined by initial and final positions of records that contain identical information on a keyword related to a retrieval key. 7. A method as set forth in claim 5, wherein, in step (c), the evaluation of said Boolean expression is sequentially performed for consecutive candidate intervals. 8. A computer system for retrieving records associated with frame sequences that constitute a motion image, said records being stored in an index file and each having a retrieval key and information on the initial and final positions of a respective frame sequence interval within the whole interval constituting said motion image, said system comprising: - a. means for inputting a record retrieving query specified by a Boolean expression of retrieval keys;
- b. means for extracting, from said index file, records that contain information on any retrieval key included in said query; and
- c. a means for dividing the whole interval constituting said motion image into a plurality of candidate intervals on the basis of initial and final positions stored in said extracted records and the initial and final positions of said whole interval constituting said motion image; and
- d. query processing means for evaluating said Boolean expression according to whether a retrieval key has been allocated to each candidate interval and determining the candidate intervals to which all retrieval keys included in said query have been allocated, and including the records corresponding to said determined intervals in a retrieval result.
9. A system as recited in claim 8, further comprising: - means for storing and displaying a motion image; and display control means for controlling said means for storing and displaying so as to display an image of at least one frame of a sequence included in an interval determined as a retrieval result by said query processing means.
10. A system as set forth in claim 8 further comprising: - a means for storing still images of representative frames in frame sequence intervals selected from the whole interval constituting said motion image;
- a display control means; and
- a display means; and
- wherein said display control means extracts, from said means for storing still images of representative frames, still images of the representative frames included in an interval determined as a retrieval result by said query processing means and transfers them to said display means.
11. A computer-implemented method for creating an index file on a storage medium, said index file comprising index records for retrieving frame sequences that form portions of an entire sequence of frames that constitute a stored motion image, said method comprising the steps of: - creating frame sequence record sets, each record set comprising:
- indices of the initial and final positions of the interval of a respective frame sequence in said sequence of motion image frames; and
- a retrieval key allocated to the respective frame sequence;
- allocating an index record to each record set and storing each set in said allocated index record;
- storing said index records in said index file;
- updating said index file by consolidating index records therein having
- record sets with the same retrieval key and indices defining initial and final positions which overlap,
- said consolidating comprising combining said record sets with overlapping indices into a single record set defining a frame sequence interval having initial and final positions indicative of the extremes of said indices.
12. A method as set forth in claim 11 further comprising the step of retrieving frame sequences from said index file using said retrieval keys to identify the index records sought. 13. A method as set forth in claim 12 wherein said retrieving step is achieved with Boolean logic. 14. A method as set forth in claim 12 wherein said retrieving step further comprises the steps of: - storing still images of representative frames in frame sequence intervals selected from the entire motion image sequence;
- extracting from said stored still images, a still image of the representative frame in a retrieved frame sequence from said index records sought; and displaying said extracted still image.
15. A computer system for creating an index file on a storage medium, said index file comprising index records for retrieving frame sequences that form portions of an entire sequence of frames that constitute a stored motion image, comprising: - means for creating frame sequence record sets, each record set comprising:
- indices of the initial and final positions of the interval of a respective frame sequence in said sequence of motion image frames; and
- a retrieval key allocated to the respective frame sequence;
- means for allocating an index record to each record set and storing each set in said allocated index record;
- means for storing said index records in said index file;
- means for updating said index file by consolidating index records therein having record sets with the same retrieval key and indices defining initial and final positions which overlap, said updating means comprising:
- means for combining said record sets with overlapping indices into a single record set defining a frame sequence interval having initial and final positions indicative of the extremes of said indices.
16. The system set forth in claim 15 further comprising means for retrieving frame sequences from said index file using said retrieval keys to identify the index records sought. 17. The system set forth in claim 16 wherein said retrieving means comprises means for executing Boolean logic. 18. The system set forth in claim 16 wherein said retrieving means comprises: - means for storing still images of representative frames in frame sequence intervals selected from the entire motion image sequence;
- means for extracting from said stored still images, a still image of the representative frame in a retrieved frame sequence from said index records sought; and
- means for displaying said extracted still image.
|