WO1995025996A1 - Method for computer-assisted media processing - Google Patents

Method for computer-assisted media processing Download PDF

Info

Publication number
WO1995025996A1
WO1995025996A1 PCT/US1995/003563 US9503563W WO9525996A1 WO 1995025996 A1 WO1995025996 A1 WO 1995025996A1 US 9503563 W US9503563 W US 9503563W WO 9525996 A1 WO9525996 A1 WO 9525996A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
media content
content
media
database
Prior art date
Application number
PCT/US1995/003563
Other languages
French (fr)
Inventor
Alan Brown
Terry Timko
Bo Ferger
Original Assignee
Visual F/X, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Visual F/X, Inc. filed Critical Visual F/X, Inc.
Priority to AU21050/95A priority Critical patent/AU2105095A/en
Priority to EP95913804A priority patent/EP0752128B1/en
Priority to DE69524948T priority patent/DE69524948T2/en
Priority to CA002186140A priority patent/CA2186140C/en
Publication of WO1995025996A1 publication Critical patent/WO1995025996A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/41Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99941Database schema or data structure
    • Y10S707/99944Object-oriented database structure
    • Y10S707/99945Object-oriented database structure processing

Definitions

  • the present invention relates to systems for the computer-assisted processing of media content, and particularly to systems for processing media content that is stored and organized in a database management system.
  • Davis contemplates a mechanism that is not interactive on-the-fly, but that instead requires subdividing predetermined scenes into fixed segments at some point prior to execution time (perhaps by a systems administrator) .
  • the approach in Davis offers the advantage of database management, it inherently introduces an inflexible storage structure for media content; this rigid structure may cause potentially unacceptable inefficiency and time delay due to the unnecessary communication and processing of media content that is irrelevant to the end-user.
  • the present invention provides a method for computer-assisted media processing that achieves the aforementioned objective, as well as other advantageous results.
  • the method is applied to a database of stored media content which is organized in portions or "clips" that are indexed by a plurality of attributes (such as keywords or other characteristics) .
  • portions of content that are likely to be of interest to the end-user are obtained by specifying a set of desired attribute values, and then searching within the database (using the indices) for content clips whose corresponding attributes match the desired values.
  • a list of these matching clips is displayed to the end-user.
  • a single, representative key frame from each clip is displayed on-screen in a grid, to help the end-user survey the search results.
  • the end-user may also quickly preview a low-resolution version of the matching clips.
  • the end-user then defines selected content by choosing one or more of the listed clips, and by further designating beginning and ending frames ("in” and "out” frames) for specific segments within those chosen clips, for further processing.
  • the end-user then chooses a particular media processing functions to be performed upon the selected content, and the function is thereupon performed.
  • the computer processes that actually carry out the desired functions are identified and provided with access to the selected content (in the form of keys) in a manner that is conveniently transparent to the end-user.
  • the media processing functions that may be selected by the end-user include playing the selected content on a monitor or similar output device; modifying the selected content; saving a "bookmark" in the form of keys identifying the selected content.
  • the end- user may also select the function of collaborating with at least one other user, by transmitting to the other user an electronic message containing the keys identifying the selected content, and further including verbal instructions for processing tasks to be performed by the other user upon the selected content.
  • a list of the selected content is then displayed for the other user, along with the first user's instructions.
  • the receiving user then surveys the list and selects content for further processing in much the same manner as described in the original, single-user embodiment.
  • Fig. 1 is a block diagram providing an architectural overview of a computer-based media processing system in accordance with the present invention.
  • Fig. 2 is a flow diagram illustrating the overall sequence of operations performed in using the media processing system of Fig. 1 to process media content in accordance with the present invention.
  • Fig. 3 illustrates key structural aspects of the media database component of the system of Fig. 1, in accordance with the present invention.
  • Fig. 4 illustrates a portion of the structure of a preferred graphical user interface for implementing the browser interface that is part of the system of Fig. 1
  • Fig. 5 is a flow diagram illustrating the sequence of operations performed in using the media processing system of Fig. 1 to select specific media content for further processing in accordance with the present invention.
  • Fig. 6 is a flow diagram illustrating the sequence of operations performed in using the media processing system of Fig. 1 to transfer selected media content to an output device in accordance with the present invention.
  • Fig. 7 is a flow diagram illustrating the sequence of operations performed in using the media processing system of Fig. 1 to modify selected media content in accordance with the present invention.
  • Fig. 8 is a flow diagram illustrating the sequence of operations performed in using the media processing system of Fig. 1 to electronically transmit annotated, selected media content between two or more collaborating users in accordance with the present invention.
  • Fig. 1 is a block diagram providing an architectural overview of such a system.
  • An end-user preferably interacts with the system by means of workstation 2.
  • workstation 2 preferably a high performance workstation manufactured by Silicon Graphics, Inc., of Mountain View, California, running the IREX variant of the UNIX operating system is used for this purpose, but any other digital processing means supporting a reasonable level of graphical interaction (such as a suitably equipped Apple Macintosh computer) may also be used.
  • workstation 2 preferably executes software creating a graphical user interface that allows the end user to interactively and conveniently survey his choices at any given moment, and input various commands and selections.
  • the system of Fig. 1 includes a media database 6.
  • the content stored and managed by the database typically includes portions or "clips" of motion picture footage, animation, video, still images, schematics, audio, or other media content.
  • This media content is preferably stored digitally in a plurality of data storage devices 8a-n, which may be physically situated at a plurality of locations (i.e., a distributed environment).
  • database management information associated with each portion of content, such as tables or indices of descriptive keywords and other relational attributes, data format specifications, and low-resolution versions of the underlying media content to facilitate previewing of selected content portions by end-users.
  • Media database 6 also preferably includes a relational database management system engine 10 to allow for the search and retrieval of media content that corresponds to specific keywords or attribute values specified by the end user.
  • a relational database management system engine 10 to allow for the search and retrieval of media content that corresponds to specific keywords or attribute values specified by the end user.
  • the system of Fig. 1 also includes a plurality of hardware devices (such as tape, film, or monitors) for printing or displaying selected media content.
  • the devices 12a-n are each associated with driver software that operates to control the device.
  • the system of Fig. 1 similarly includes a plurality of software applications 14a-n for performing image processing, on-line editing, communication between collaborating users (e-mail) , or other tasks and functions involved in processing media content.
  • applications 14a-n are preferably associated with and controlled by software drivers.
  • software represented by browser 4 ties together the various components of the system.
  • browser 4 includes software responsible for running the graphical user interface.
  • Browser 4 allows the user to specify search criteria descriptive of the particular media content that he or she wishes to view or work with, such as specific keywords or other attribute values. Browser 4 also initiates searches based on the end-user's criteria by invoking RDBMS engine 10, and conveys the results of each search to the end-user. Browser 4 allows the user to designate selected media content for further processing, and invokes an appropriate application or device driver (12a-n or 14a-n) to carry out the user's requests, and provides the driver with a key to directly access the selected content in media database 6. Browser 4 is thus connected to practically every aspect of the system.
  • the end-user specifies search criteria descriptive of the particular portions of underlying media content that he or she wishes to view or work with. These criteria may preferably be expressed in terms of descriptive keywords (such as "forest” or “sunset”) , common attribute values (such as ⁇ background, character, or prop? ⁇ ), or the like. Table 1 discloses an exemplary set of attributes and other search criteria that we have found to be preferable for these purposes, at least in the context of a system for production of televised animation:
  • groups One especially noteworthy aspect of the preferred search criteria is the notion of "groups.”
  • groups As discussed further below, when the end-user has identified a particular collection of media content that he or she would like to be able to collectively reference in the future, the end- user is permitted to enter a group name for the collection. The entered name is then stored on the "group" attribute list for each record corresponding to the selected collection of content. From that point on, the defined group name may be included among search criteria, to identify the particular content so designated.
  • the group attribute facility effectively allows the end-user to adaptively modify the structure of the database in desired fashion.
  • Browser 4 preferably controls workstation 2 so as to provide a convenient graphical interface for input by the end-user of the foregoing search criteria; an on-screen form or menu of items to be interactively completed or selected by the end-user works well for this purpose, as will be apparent to those of skill in the art.
  • browser 4 invokes RDBMS engine 10, causing engine 10 to perform a search of media database 6 based on the specified search criteria.
  • RDBMS implementation and operation are well-known in the art. For example, a detailed and comprehensive discussion of RDBMS theory and application is provided in C.J. Date, "An Introduction To Database Systems," Volumes l and 2, 4th Edition, Addison Wesley (1986) . Therefore, only a brief description of pertinent points is provided herein.
  • each clip or portion of content in media database 6 is associated with certain management information such as key words and attribute values. This association is illustrated in Fig. 3.
  • Content Table 50 contains a plurality of content records; the exemplary structure of such records is illustrated in Content Record 58.
  • Content Record 58 contains a plurality of fields: one such field (say, field 58a) contains a "key" or pointer to a portion or clip of content in media database 6 (stored somewhere in devices 8a-n) that is associated with this record; the key preferably incorporates not only the address of the clip, but also any permission information that may be necessary to obtain access to the clip.
  • Another field points to a compressed, "preview” version of the clip; digital implementation of such compressed previews is well- known in the art (e.g., using video compression standards such as Apple QuicktimeTM) .
  • Another field points to storage of a representative frame (or "key frame") selected in advance from the clip. The function and purpose of the preview and key frame information will be explained below.
  • Other fields (say, fields 58d, 58e, and possibly others) store or identify the various keywords and other attribute values associated with the corresponding clip.
  • an index is created, in the form of a table or B-tree, linking each keyword or attribute value to the specific content records matching that value.
  • Keyword Index 54 is shown in Fig. 3 as containing a plurality of keyword entries 56a-n; each entry contains pointers to all of the content records in Content Table 50 that have a matching keyword. Similar indices are built and stored for each of the various attributes used to index the database. In this way, a "many- to-many" relationship between content and attributes is established. In other words, many different keywords (e.g., "forest”) may correspond to a given portion of content, while many portions of content (e.g., various clips which all involve forest settings) may correspond to the same keyword.
  • RDBMS engine 10 deals with management information; underlying content is generally accessed by interested applications directly through keys according to the invention, not through the RDBMS engine. Because of this distinction, certain aspects of the system, such as indexed searching for content based on criteria, focus on management information, and see content only through the structure of Content Table 50 and related indices. Yet, at the same time, other aspects of the system, such as the designation and processing of selected content, access content directly via keys, and can therefore define selected content in a more flexible and adaptive manner — as discussed in the sections that follow.
  • Fig. 4 depicts an exemplary graphical user interface screen display 60 for this purpose.
  • Key-frame grid 62 is a rectangular grid; each element of the grid contains a single key-frame chosen to represent a portion of the media content.
  • the management information associated with each portion of content in media database 6 includes a predefined key ⁇ frame.
  • each portion of content identified in the search of step 22 is represented at step 24 by the display of a corresponding key-frame within grid 62.
  • the end-user selects the particular media content that he or she wishes to process further.
  • Fig. 4 depicts an exemplary graphical user interface screen display 60 for the selection process
  • Fig. 5 describes the process in greater detail.
  • the end-user preferably investigates portions of content that may be of interest by previewing such content. This is accomplished by using a mouse or similar interactive pointing device to select any key-frame in grid 62 corresponding to content that the end- user is tentatively interested in pursuing further. In the case of full-motion media, a relatively low- resolution, compressed version of the corresponding media content is then immediately played on-screen in a pop-up window for the end-user.
  • the management information associated with each portion of content preferably includes such a compressed preview version.
  • the end-user decides, at step 72, that he or she would like to process some or all of the previewed content further.
  • the end-user again uses a mouse or similar interactive pointing device to point and drag the appropriate key-frame from grid 62 to accumulator 64.
  • the end-user designates the specific segment within the previewed content that is to be selected for further processing. More specifically, the end-user identifies the individual starting and ending frames ("in-frame" and "out-frame") of the segment within the chosen clip of content that is of interest.
  • the designation of in and out frames may preferably and conveniently be accomplished as follows.
  • a preview of the clip is again played on-screen in a pop-up window.
  • the preview is played more slowly, in "flip-book” fashion, so that the user can click on displayed in-frame and out-frame buttons to interactively identify the beginning and end points of the desired segment of content.
  • browser 4 is responsible for controlling the graphical user interaction.
  • browser 4 examines the database management information record corresponding to the clip, and formulates and stores the key necessary to address and access that selected segment of content.
  • the end-user is allowed to adaptively designate any segment of media content that is contained within any item of content included in the list.
  • the end-user can specify the particular media content that he or she is interested in at a finer level of granularity than is reflected by the fixed structure of the database.
  • the process of selecting content is iterative in nature; the user may select and deposit in accumulator 64 as many portions of content (represented by key-frames in grid 62) as desired for further processing.
  • step 28 the end-user chooses a particular function to be performed with the media content that has been selected.
  • browser 4 preferably controls workstation 2 so as to permit the end-user to interactively indicate this choice.
  • Graphical user interface 60 shown in Fig. 4 preferably includes an array of function buttons or icons 66 corresponding to each available processing function; to select a particular function, the user may simply click on the appropriate button or icon.
  • the function chosen by the end-user may typically involve such media production tasks as printing content on an output device (step 30) , modifying or editing a particular portion of content (step 32) , or collaborating with another end-user (step 38) .
  • the end-user may also create and store an electronic "bookmark" designating a selected segment of content (step 40) for future reference, or may create a new attribute to be associated in database 6 with a group of selected media content so that the selected content may be retrieved in the future as a group (step 40)
  • Fig. 6 illustrates the carrying out of production tasks involving printing selected content on an output device.
  • browser 4 identifies the appropriate hardware device (and associated driver routine) 12 for carrying out the requested function.
  • browser 4 invokes the identified driver 12, providing it with keys to access the selected content.
  • Browser 4 also provides the driver with any additional database management information that may be necessary, such as format specifications for the selected content.
  • driver 12 uses the keys to access the selected content, for processing by the associated device. If the content is in a data format that is not compatible with target device 12, then at steps 88-90 driver 12 converts the format of the selected content as needed.
  • driver 12 preferably includes Host Independent Image Protocol ("HUP") interface software licensed by ASDG Incorporated.
  • HUP Host Independent Image Protocol
  • driver 12 actually sends the selected content to associated device 12, for printing as requested.
  • HUP Host Independent Image Protocol
  • Fig. 7 illustrates the carrying out of production tasks such as modifying or editing a particular portion of content according to the principles of the current invention.
  • browser 4 interrogates RDBMS engine 10 to find out if the selected content has already been "checked out” and is currently being modified by a second user of the system. If the content has been checked out, then our first user cannot be permitted to modify the content at this time, and at step 99 he or she is returned to the choice point of Fig. 2, step 44, to select an alternative course of action. As is well known in the art, this precaution is necessary to avoid corruption of database content.
  • browser 4 identifies the appropriate application program (and associated driver routine) 14 for carrying out the requested function.
  • browser 4 invokes the identified driver 14, providing it with keys to access the selected content.
  • Browser 4 also provides the driver with any additional database management information that may be necessary, such as format specifications for the selected content.
  • driver 14 uses the keys to access the selected content, for processing by the associated application.
  • driver 14 can access the precise segment of content needed (i.e., as defined in part by the in- frames and out-frames selected by the end-user) , as reflected in the key, rather than automatically accessing the entire clip as organized in the database.
  • driver 14 converts the format of the selected content as needed, as discussed above with regard to Fig. 6.
  • driver 14 actually invokes associated application 14, which modifies the content as requested.
  • application 14 will itself be an interactive program (such as a "paint" utility, or an on-line editing tool) , and so the end-user will directly control the processing performed at step 110.
  • the end-user is preferably given the opportunity, at step 34 in Fig. 2, to decide whether or not to permanently save the content as modified. If the end-user does elect to save the modifications, then step 36 updates database 6 appropriately. This update should include an opportunity for the end-user to modify the keyword or other attribute values associated with the modified content, since the modifications may have directly changed some of those attributes.
  • Browser 4 preferably controls this interaction, again by providing a suitable, on-screen, interactive menu or form.
  • E. Collaboration In a preferred embodiment of the invention, a given end-user may collaborate with one or more other users in processing the contents of media database 6 (step 38) .
  • browser 4 controls workstation 2 to enable first end-user ("userl") to input textual instructions corresponding to each portion of selected content, and intended for a second end- user ("user2") .
  • browser 4 (preferably using the underlying operating system electronic mail routines) transmits an electronic message ("e- mail") to user2; the message contains pointers to the management information and keys associated with each portion of selected content defined by userl, and also contains userl's textual instructions for each portion of selected content. After sending the message, userl can then proceed to other work (step 124) .
  • browser 16 (associated with user2 and workstation 18) notifies user2 that he or she has been sent an e-mail, and user2 elects to receive the e-mail.
  • browser 16 controls workstation 18 so as to display a list of the selected content identified in the e-mail message. Preferably, this display is provided by browser 16 in the same fashion as the display of search results described earlier in connection with Fig. 4: i.e., using the grid of key frames.
  • userl's instructions for each portion of content are also displayed.
  • user2 can proceed to select and process specific content in the same fashion described earlier for the single-user embodiment: i.e., at step 132, user2 selects specific content to be processed according to the steps of Fig. 5, and then continues on at step 28 of Fig. 2.
  • userl and user2 can conveniently and efficiently collaborate by exchanging information and instructions that are highly specific to particular portions of content that are of joint interest.
  • an end-user may preferably define and store an electronic "bookmark" designating a selected segment of content (step 40) for future reference.
  • browser 4 controls workstation 18 (or a separate monitor) to play the selected content for the end-user.
  • decision step 152 the end-user may continue viewing as long as desired. If the end-user desires to mark a particular point in the media content (e.g., so that the end-user may temporarily stop viewing the current content and resume viewing later on at the same point, or for other reference purposes) , he or she may elect to insert an electronic bookmark.
  • browser 4 creates a modified key for the content being viewed, with a new beginning frame corresponding to the position in the content that the end-user wishes to mark.
  • Browser 4 stores the key, at step 156, for future reference by the end- user.
  • the end-user may then preferably elect to either stop viewing the current content — in which case, the system returns to the main choice point of Fig. 2, step 44 — or to continue further.
  • the group function corresponds to step 49, and is a relatively straightforward step: if the end-user selects the "group” function button, then browser 4 controls workstation 2 so as to graphically prompt the end- user for a group name, which could preferably be any text string.
  • the database "group” index i.e., the table or tree for groups
  • the end-user may decide at step 44 whether to perform additional processing functions with the selected content (i.e., return to step 28), whether to select different media content for processing
  • step 26 i.e., return to step 26
  • step 20 whether to define and commence a new search (i.e., return to step 20).

Abstract

A system for computer-assisted processing of media by an end-user is disclosed. The system preferably includes a relational database management system (RDBMS) containing media content. The RDBMS structure allows users to effectively search an extensive database and identify desired content. At the same time, the adaptive designation of 'in-frame' and 'out-frame' pointers allows users to efficiently view, modify, annotate, store, and/or distribute to other users only the specific segments of content that are of interest. This highly desirable combination of features reflects the untraditional, open architecture of the system disclosed in accordance with the present invention.

Description

METHOD FOR COMPUTER-ASSISTED MEDIA PROCESSING
RELATE BACK - 35 U.S.C. 120
This is a continuation of application serial no. 08/216,587 filed March 21, 1994.
FIELD OF THE INVENTION
The present invention relates to systems for the computer-assisted processing of media content, and particularly to systems for processing media content that is stored and organized in a database management system.
BACKGROUND OF THE INVENTION
Since the 1970,s, computers have played increasingly important roles in the processing of media content. For example, computer-based systems have been used for the storage and retrieval of content from image databases; for the on-line editing of stored video clips; and for the electronic modification of digitized images, video, and animation. However, to the best of our knowledge, no system to date has successfully integrated the diverse (and sometimes seemingly incompatible) set of capabilities that would be desirable in an optimal computer-based system for processing full-motion video and animation. More specifically, the on-line editing products that are currently available on the market, such as Adobe Premiere™, generally lack the sophisticated search and retrieval capability that is necessary where the end-user doing the editing or image processing must select his content from a very large database of possibly unfamiliar video content, such as is often the case for the animation production work like Adobe done in large animation studios. Instead, products Premiere™ typically provide only simple file directory mechanism for storing and retrieving content. Such products essentially assume that the end-user is only working with a relatively small collection of source content, is relatively familiar with that content, and does not need any significant assistance in seeking out and identifying the content that is to be edited and processed. As noted, this assumption is problematic with respect to major animation studios. Similarly, products like Adobe Premiere™ generally do not offer the database management capabilities required to maintain data integrity in a multi-user environment, where several users may attempt to concurrently process the same set of content. On the other hand, U.S. Patent No. 5,091,849
(Davis, et al . ) does disclose a computer-based video production system that includes a distributed database of video content and supports multiple users. However, Davis follows a very traditional relational database management systems ("RDBMS") approach, and therefore organizes and accesses video content strictly in terms of a fixed, hierarchical structure (i.e.. production / sequence / scene) . The consequence is that an end-user who wishes to process or work with even a small fragment from a particular scene is forced to access and download all data files storing, information for that scene. See Davis at column 18, line 25 through column 21, line 45, regarding the acquisition of image data files.
There is a brief discussion in Davis of a "special set of rules" for providing "limited read- write" access to portions of a scene database file that is expected to be concurrently accessed by multiple users (column 12, lines 15-30, and column 24, lines 63-67) . However, from the few details provided, it appears that Davis contemplates a mechanism that is not interactive on-the-fly, but that instead requires subdividing predetermined scenes into fixed segments at some point prior to execution time (perhaps by a systems administrator) . Thus, while the approach in Davis offers the advantage of database management, it inherently introduces an inflexible storage structure for media content; this rigid structure may cause potentially unacceptable inefficiency and time delay due to the unnecessary communication and processing of media content that is irrelevant to the end-user. What is needed is a computer-based media processing system that successfully and efficiently incorporates the powerful search capabilities, data integrity, and other benefits of a multi-user RDBMS system, yet simultaneously gives end-users the freedom to interactively organize, structure, and access media content on-the-fly.
SUMMARY OF THE INVENTION
The present invention provides a method for computer-assisted media processing that achieves the aforementioned objective, as well as other advantageous results. The method is applied to a database of stored media content which is organized in portions or "clips" that are indexed by a plurality of attributes (such as keywords or other characteristics) .
According to the method, portions of content that are likely to be of interest to the end-user are obtained by specifying a set of desired attribute values, and then searching within the database (using the indices) for content clips whose corresponding attributes match the desired values. A list of these matching clips is displayed to the end-user. In a preferred embodiment, a single, representative key frame from each clip is displayed on-screen in a grid, to help the end-user survey the search results. Preferably, the end-user may also quickly preview a low-resolution version of the matching clips. The end-user then defines selected content by choosing one or more of the listed clips, and by further designating beginning and ending frames ("in" and "out" frames) for specific segments within those chosen clips, for further processing. The end-user then chooses a particular media processing functions to be performed upon the selected content, and the function is thereupon performed. In a preferred embodiment, the computer processes that actually carry out the desired functions are identified and provided with access to the selected content (in the form of keys) in a manner that is conveniently transparent to the end-user. Preferably, the media processing functions that may be selected by the end-user include playing the selected content on a monitor or similar output device; modifying the selected content; saving a "bookmark" in the form of keys identifying the selected content. In a further preferred embodiment, the end- user may also select the function of collaborating with at least one other user, by transmitting to the other user an electronic message containing the keys identifying the selected content, and further including verbal instructions for processing tasks to be performed by the other user upon the selected content. A list of the selected content is then displayed for the other user, along with the first user's instructions. The receiving user then surveys the list and selects content for further processing in much the same manner as described in the original, single-user embodiment.
BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a block diagram providing an architectural overview of a computer-based media processing system in accordance with the present invention.
Fig. 2 is a flow diagram illustrating the overall sequence of operations performed in using the media processing system of Fig. 1 to process media content in accordance with the present invention.
Fig. 3 illustrates key structural aspects of the media database component of the system of Fig. 1, in accordance with the present invention.
Fig. 4 illustrates a portion of the structure of a preferred graphical user interface for implementing the browser interface that is part of the system of Fig. 1 Fig. 5 is a flow diagram illustrating the sequence of operations performed in using the media processing system of Fig. 1 to select specific media content for further processing in accordance with the present invention. Fig. 6 is a flow diagram illustrating the sequence of operations performed in using the media processing system of Fig. 1 to transfer selected media content to an output device in accordance with the present invention. Fig. 7 is a flow diagram illustrating the sequence of operations performed in using the media processing system of Fig. 1 to modify selected media content in accordance with the present invention.
Fig. 8 is a flow diagram illustrating the sequence of operations performed in using the media processing system of Fig. 1 to electronically transmit annotated, selected media content between two or more collaborating users in accordance with the present invention.
DETAILED DESCRIPTION OF THE INVENTION A. System Overview We begin with a broad overview of a computer- based media processing system designed in accordance with the present invention. Fig. 1 is a block diagram providing an architectural overview of such a system. An end-user preferably interacts with the system by means of workstation 2. Preferably, a high performance workstation manufactured by Silicon Graphics, Inc., of Mountain View, California, running the IREX variant of the UNIX operating system is used for this purpose, but any other digital processing means supporting a reasonable level of graphical interaction (such as a suitably equipped Apple Macintosh computer) may also be used. As discussed below, workstation 2 preferably executes software creating a graphical user interface that allows the end user to interactively and conveniently survey his choices at any given moment, and input various commands and selections.
The system of Fig. 1 includes a media database 6. The content stored and managed by the database typically includes portions or "clips" of motion picture footage, animation, video, still images, schematics, audio, or other media content. This media content is preferably stored digitally in a plurality of data storage devices 8a-n, which may be physically situated at a plurality of locations (i.e., a distributed environment). Also included in media database 6 and stored in storage devices 8a-n is database management information associated with each portion of content, such as tables or indices of descriptive keywords and other relational attributes, data format specifications, and low-resolution versions of the underlying media content to facilitate previewing of selected content portions by end-users.
Media database 6 also preferably includes a relational database management system engine 10 to allow for the search and retrieval of media content that corresponds to specific keywords or attribute values specified by the end user. The structure and operation of media database 6 and its components is discussed in greater detail below.
The system of Fig. 1 also includes a plurality of hardware devices (such as tape, film, or monitors) for printing or displaying selected media content. As shown in Fig. 1, the devices 12a-n are each associated with driver software that operates to control the device. The system of Fig. 1 similarly includes a plurality of software applications 14a-n for performing image processing, on-line editing, communication between collaborating users (e-mail) , or other tasks and functions involved in processing media content. Again, applications 14a-n are preferably associated with and controlled by software drivers. As depicted in Fig. 1, software represented by browser 4 ties together the various components of the system. For example, browser 4 includes software responsible for running the graphical user interface. Browser 4 allows the user to specify search criteria descriptive of the particular media content that he or she wishes to view or work with, such as specific keywords or other attribute values. Browser 4 also initiates searches based on the end-user's criteria by invoking RDBMS engine 10, and conveys the results of each search to the end-user. Browser 4 allows the user to designate selected media content for further processing, and invokes an appropriate application or device driver (12a-n or 14a-n) to carry out the user's requests, and provides the driver with a key to directly access the selected content in media database 6. Browser 4 is thus connected to practically every aspect of the system.
B. Searching The Database
Referring to Fig. 2, at step 20, the end-user specifies search criteria descriptive of the particular portions of underlying media content that he or she wishes to view or work with. These criteria may preferably be expressed in terms of descriptive keywords (such as "forest" or "sunset") , common attribute values (such as {background, character, or prop?}), or the like. Table 1 discloses an exemplary set of attributes and other search criteria that we have found to be preferable for these purposes, at least in the context of a system for production of televised animation:
TABLE 1 Show: Episode:
Scene: Take:
{Motion Picture or Television?}
{Short, Opening, Closing, Trailer, Commercial, or
Series?}
{Animation or Live Footage?}
{Background, Prop, or Character?}
{Motion or Still?}
Keywords:
Groups:
Executive producer: Producer:
Producer: Director: Artist: Creator:
Writer: FX Supervisor:
Worker: Actor:
One especially noteworthy aspect of the preferred search criteria is the notion of "groups." As discussed further below, when the end-user has identified a particular collection of media content that he or she would like to be able to collectively reference in the future, the end- user is permitted to enter a group name for the collection. The entered name is then stored on the "group" attribute list for each record corresponding to the selected collection of content. From that point on, the defined group name may be included among search criteria, to identify the particular content so designated. Thus, the group attribute facility effectively allows the end-user to adaptively modify the structure of the database in desired fashion. Browser 4 preferably controls workstation 2 so as to provide a convenient graphical interface for input by the end-user of the foregoing search criteria; an on-screen form or menu of items to be interactively completed or selected by the end-user works well for this purpose, as will be apparent to those of skill in the art.
At step 22, browser 4 invokes RDBMS engine 10, causing engine 10 to perform a search of media database 6 based on the specified search criteria. RDBMS implementation and operation are well-known in the art. For example, a detailed and comprehensive discussion of RDBMS theory and application is provided in C.J. Date, "An Introduction To Database Systems," Volumes l and 2, 4th Edition, Addison Wesley (1986) . Therefore, only a brief description of pertinent points is provided herein.
As noted briefly above, each clip or portion of content in media database 6 is associated with certain management information such as key words and attribute values. This association is illustrated in Fig. 3. Content Table 50 contains a plurality of content records; the exemplary structure of such records is illustrated in Content Record 58. Content Record 58 contains a plurality of fields: one such field (say, field 58a) contains a "key" or pointer to a portion or clip of content in media database 6 (stored somewhere in devices 8a-n) that is associated with this record; the key preferably incorporates not only the address of the clip, but also any permission information that may be necessary to obtain access to the clip. Another field (say, field 58b) points to a compressed, "preview" version of the clip; digital implementation of such compressed previews is well- known in the art (e.g., using video compression standards such as Apple Quicktime™) . Another field (say, field 58c) points to storage of a representative frame (or "key frame") selected in advance from the clip. The function and purpose of the preview and key frame information will be explained below. Other fields (say, fields 58d, 58e, and possibly others) store or identify the various keywords and other attribute values associated with the corresponding clip.
In addition, an index is created, in the form of a table or B-tree, linking each keyword or attribute value to the specific content records matching that value. For example. Keyword Index 54 is shown in Fig. 3 as containing a plurality of keyword entries 56a-n; each entry contains pointers to all of the content records in Content Table 50 that have a matching keyword. Similar indices are built and stored for each of the various attributes used to index the database. In this way, a "many- to-many" relationship between content and attributes is established. In other words, many different keywords (e.g., "forest") may correspond to a given portion of content, while many portions of content (e.g., various clips which all involve forest settings) may correspond to the same keyword.
The implementation and operation of a relational database using B-tree structures is very well-known in the art. We have found the library of RDBMS B-tree routines and structures licensed by the C-Tree company, Cambridge, Massachusetts to offer good performance and functionality for these purposes. An important feature of media database 6 according to the present invention is the clear distinction between management information and underlying content. RDBMS engine 10, for example, deals with management information; underlying content is generally accessed by interested applications directly through keys according to the invention, not through the RDBMS engine. Because of this distinction, certain aspects of the system, such as indexed searching for content based on criteria, focus on management information, and see content only through the structure of Content Table 50 and related indices. Yet, at the same time, other aspects of the system, such as the designation and processing of selected content, access content directly via keys, and can therefore define selected content in a more flexible and adaptive manner — as discussed in the sections that follow.
C. Selection of Content
After the database search has been performed, the results of that search are communicated to the end-user in step 24. Browser 4 controls workstation 2 so as to display a list of the portions of media content that satisfy the user's specified search criteria. Fig. 4 depicts an exemplary graphical user interface screen display 60 for this purpose. Key-frame grid 62 is a rectangular grid; each element of the grid contains a single key-frame chosen to represent a portion of the media content. As noted above, the management information associated with each portion of content in media database 6 includes a predefined key¬ frame. Thus, each portion of content identified in the search of step 22 is represented at step 24 by the display of a corresponding key-frame within grid 62.
At step 26, the end-user selects the particular media content that he or she wishes to process further. Fig. 4 depicts an exemplary graphical user interface screen display 60 for the selection process, and Fig. 5 describes the process in greater detail. At step 70, the end-user preferably investigates portions of content that may be of interest by previewing such content. This is accomplished by using a mouse or similar interactive pointing device to select any key-frame in grid 62 corresponding to content that the end- user is tentatively interested in pursuing further. In the case of full-motion media, a relatively low- resolution, compressed version of the corresponding media content is then immediately played on-screen in a pop-up window for the end-user. As noted previously, the management information associated with each portion of content preferably includes such a compressed preview version.
Suppose the end-user decides, at step 72, that he or she would like to process some or all of the previewed content further. In that case, at step 74 the end-user again uses a mouse or similar interactive pointing device to point and drag the appropriate key-frame from grid 62 to accumulator 64. Next, at step 76, in an important aspect of the present invention, the end-user designates the specific segment within the previewed content that is to be selected for further processing. More specifically, the end-user identifies the individual starting and ending frames ("in-frame" and "out-frame") of the segment within the chosen clip of content that is of interest. The designation of in and out frames may preferably and conveniently be accomplished as follows. After a chosen clip has been added to the accumulator, and in response to the end-user's command, a preview of the clip is again played on-screen in a pop-up window. However, this time the preview is played more slowly, in "flip-book" fashion, so that the user can click on displayed in-frame and out-frame buttons to interactively identify the beginning and end points of the desired segment of content.
As stated previously, browser 4 is responsible for controlling the graphical user interaction. When the end-user chooses a particular clip and designates an in-frame and out-frame, browser 4 examines the database management information record corresponding to the clip, and formulates and stores the key necessary to address and access that selected segment of content. In this way, the end- user is allowed to adaptively designate any segment of media content that is contained within any item of content included in the list. In other words, the end-user can specify the particular media content that he or she is interested in at a finer level of granularity than is reflected by the fixed structure of the database.
As shown at step 78, the process of selecting content is iterative in nature; the user may select and deposit in accumulator 64 as many portions of content (represented by key-frames in grid 62) as desired for further processing.
D. Processing of Selected Content At step 28, the end-user chooses a particular function to be performed with the media content that has been selected. Again, browser 4 preferably controls workstation 2 so as to permit the end-user to interactively indicate this choice. Graphical user interface 60 shown in Fig. 4 preferably includes an array of function buttons or icons 66 corresponding to each available processing function; to select a particular function, the user may simply click on the appropriate button or icon. The function chosen by the end-user may typically involve such media production tasks as printing content on an output device (step 30) , modifying or editing a particular portion of content (step 32) , or collaborating with another end-user (step 38) . According to the present invention, the end-user may also create and store an electronic "bookmark" designating a selected segment of content (step 40) for future reference, or may create a new attribute to be associated in database 6 with a group of selected media content so that the selected content may be retrieved in the future as a group (step
42) . The details of each such function or task are discussed below, in this section and the subsequent sections.
Fig. 6 illustrates the carrying out of production tasks involving printing selected content on an output device. At step 82, browser 4 identifies the appropriate hardware device (and associated driver routine) 12 for carrying out the requested function. Next, at step 84, browser 4 invokes the identified driver 12, providing it with keys to access the selected content. Browser 4 also provides the driver with any additional database management information that may be necessary, such as format specifications for the selected content. At step 86, driver 12 uses the keys to access the selected content, for processing by the associated device. If the content is in a data format that is not compatible with target device 12, then at steps 88-90 driver 12 converts the format of the selected content as needed. For this purpose, driver 12 preferably includes Host Independent Image Protocol ("HUP") interface software licensed by ASDG Incorporated. In any case, at step 92, driver 12 actually sends the selected content to associated device 12, for printing as requested.
Similarly, Fig. 7 illustrates the carrying out of production tasks such as modifying or editing a particular portion of content according to the principles of the current invention. First, at step 98, browser 4 interrogates RDBMS engine 10 to find out if the selected content has already been "checked out" and is currently being modified by a second user of the system. If the content has been checked out, then our first user cannot be permitted to modify the content at this time, and at step 99 he or she is returned to the choice point of Fig. 2, step 44, to select an alternative course of action. As is well known in the art, this precaution is necessary to avoid corruption of database content. If the selected content is not currently checked out, however, then at step 100, browser 4 identifies the appropriate application program (and associated driver routine) 14 for carrying out the requested function. Next, at step 102, browser 4 invokes the identified driver 14, providing it with keys to access the selected content. Browser 4 also provides the driver with any additional database management information that may be necessary, such as format specifications for the selected content.
Note that browser 4 does not itself actually access the underlying content. This eliminates any redundant copying or transmission of content data to or from browser 4; browser 4 can work entirely in terms of keys and management information, which improves efficiency greatly. At step 104, driver 14 uses the keys to access the selected content, for processing by the associated application. By accessing content directly by means of keys, instead of requesting content through RDBMS engine 10, driver 14 can access the precise segment of content needed (i.e., as defined in part by the in- frames and out-frames selected by the end-user) , as reflected in the key, rather than automatically accessing the entire clip as organized in the database.
Once again, if the selected content is in a data format that is not compatible with target application 14, then at steps 106-108 driver 14 converts the format of the selected content as needed, as discussed above with regard to Fig. 6. In any case, at step 110 driver 14 actually invokes associated application 14, which modifies the content as requested. Typically, application 14 will itself be an interactive program (such as a "paint" utility, or an on-line editing tool) , and so the end-user will directly control the processing performed at step 110. After the desired modifications are complete, the end-user is preferably given the opportunity, at step 34 in Fig. 2, to decide whether or not to permanently save the content as modified. If the end-user does elect to save the modifications, then step 36 updates database 6 appropriately. This update should include an opportunity for the end-user to modify the keyword or other attribute values associated with the modified content, since the modifications may have directly changed some of those attributes. Browser 4 preferably controls this interaction, again by providing a suitable, on-screen, interactive menu or form.
E. Collaboration (E-mail) In a preferred embodiment of the invention, a given end-user may collaborate with one or more other users in processing the contents of media database 6 (step 38) . The details of this technique are now explained with reference to Fig. 8. At step 120, browser 4 controls workstation 2 to enable first end-user ("userl") to input textual instructions corresponding to each portion of selected content, and intended for a second end- user ("user2") . At step 122, browser 4 (preferably using the underlying operating system electronic mail routines) transmits an electronic message ("e- mail") to user2; the message contains pointers to the management information and keys associated with each portion of selected content defined by userl, and also contains userl's textual instructions for each portion of selected content. After sending the message, userl can then proceed to other work (step 124) .
Meanwhile, at step 126, browser 16 (associated with user2 and workstation 18) notifies user2 that he or she has been sent an e-mail, and user2 elects to receive the e-mail. At step 128, browser 16 controls workstation 18 so as to display a list of the selected content identified in the e-mail message. Preferably, this display is provided by browser 16 in the same fashion as the display of search results described earlier in connection with Fig. 4: i.e., using the grid of key frames. Under control of user2 (preferably using a mouse to point and click on key frames of interest) , userl's instructions for each portion of content are also displayed. At that point, user2 can proceed to select and process specific content in the same fashion described earlier for the single-user embodiment: i.e., at step 132, user2 selects specific content to be processed according to the steps of Fig. 5, and then continues on at step 28 of Fig. 2. In this way, userl and user2 can conveniently and efficiently collaborate by exchanging information and instructions that are highly specific to particular portions of content that are of joint interest.
F. Reference Functions
Another application of the present invention is that an end-user may preferably define and store an electronic "bookmark" designating a selected segment of content (step 40) for future reference. The details of this technique are now explained with reference to Fig. 9. If this function is chosen, then at step 150, browser 4 controls workstation 18 (or a separate monitor) to play the selected content for the end-user. As shown in decision step 152, the end-user may continue viewing as long as desired. If the end-user desires to mark a particular point in the media content (e.g., so that the end-user may temporarily stop viewing the current content and resume viewing later on at the same point, or for other reference purposes) , he or she may elect to insert an electronic bookmark. In that case, at step 154, browser 4 creates a modified key for the content being viewed, with a new beginning frame corresponding to the position in the content that the end-user wishes to mark. Browser 4 stores the key, at step 156, for future reference by the end- user. As shown in step 158, the end-user may then preferably elect to either stop viewing the current content — in which case, the system returns to the main choice point of Fig. 2, step 44 — or to continue further.
One special function that may be requested by the end-user with respect to selected content is the "group" function, which creates a new attribute to be permanently associated in the database with the selected content. The group function corresponds to step 49, and is a relatively straightforward step: if the end-user selects the "group" function button, then browser 4 controls workstation 2 so as to graphically prompt the end- user for a group name, which could preferably be any text string. The database "group" index (i.e., the table or tree for groups) is then updated to contain the newly created group item, and pointers to the selected content in that group. In this way, selected content may conveniently and efficiently be retrieved in the future by the end- user as a group, simply by specifying the new group name as part of the end-user's search criteria.
G. Iteration
It is envisioned that the system will be used in an iterative manner. Thus, as shown in Fig. 2 , after a particular chosen task has been performed, the end-user may decide at step 44 whether to perform additional processing functions with the selected content (i.e., return to step 28), whether to select different media content for processing
(i.e., return to step 26), or whether to define and commence a new search (i.e., return to step 20).
The invention has been described in an exemplary and preferred manner, but is not limited thereto. Those skilled in the art will recognize that a number of modifications and improvements can be made to various aspects of the invention without departure from the essential spirit and scope. The scope of the invention is limited only as described in the following claims:

Claims

We claim:
1. A method for computer-assisted media processing by an end-user, for use with a database of stored media content, said content being indexed by a plurality of attributes, said method comprising the steps of: specifying, under control of said end-user, a set of desired values for one or more of said attributes; searching within said database for one or more matching portions of media content corresponding to said set of desired attribute values, each of said portions comprising a plurality of frames; displaying, to said end-user, a list identifying said matching portions of media content; designating, under control of said end-user, one or more of said matching portions of media content; further designating, under control of said end-user, one or more beginning frames and one or more ending frames for said one or more designated portions of media content, thereby defining selected media content; requesting, under control of said end-user, one or more media processing functions to be performed upon said selected media content; performing said media processing functions upon said selected media content.
2. The method of claim 1, wherein said step of displaying a list identifying said matching portions of media content further includes the step of previewing, under control of said end-user, a relatively low-resolution version of one or more of said matching portions of media content.
3. The method of claim 1, wherein said step of displaying a list identifying particular portions of media content further includes the step of displaying, for each one of said particular portions of media content, a single key frame of media content taken from said portion.
4. The method of claim 1, wherein said step of performing said media processing functions further includes the following steps: identifying, in a manner that is transparent to said end-user, one or more computer processes for performing said media processing functions; and providing, in a manner that is transparent to said end-user, said computer processes with one or more keys identifying said selected media content by address.
5. The method of claim 1, wherein said step of performing one or more media processing functions includes playing said selected media content on a media output device.
6. The method of claim 1, wherein said step of performing one or more media processing functions includes modifying said selected media content.
7. The method of claim 6 further including the step of updating said database to reflect said modifying of said selected media content.
8. The method of claim 1, wherein said step of performing one or more media processing functions includes storing one or more keys identifying said selected media content.
9. The method of claim 1, wherein said step of performing one or more media processing functions further includes the following steps: transmitting an electronic message from said first end-user to at least one collaborating end- user, said message identifying said selected media content, said message further including one or more instructions for processing tasks to be performed by said collaborating end-user upon said selected media content; displaying, under control of said collaborating end-user, a list identifying said selected media content; and displaying, under control of said collaborating end-user, said one or more instructions.
10. The method of claim 1, further including the following steps: specifying, under control of said end-user, one or more new attributes to be associated with said selected media content; updating, in a manner transparent to said end-user, said database to include said new attributes.
PCT/US1995/003563 1994-03-21 1995-03-21 Method for computer-assisted media processing WO1995025996A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
AU21050/95A AU2105095A (en) 1994-03-21 1995-03-21 Method for computer-assisted media processing
EP95913804A EP0752128B1 (en) 1994-03-21 1995-03-21 Method for computer-assisted media processing
DE69524948T DE69524948T2 (en) 1994-03-21 1995-03-21 COMPUTER SUPPORTED MULTIMEDIA PROCEDURE
CA002186140A CA2186140C (en) 1994-03-21 1995-03-21 Method for computer-assisted media processing

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US21658794A 1994-03-21 1994-03-21
US08/216,587 1994-03-21
US08/330,706 US5553281A (en) 1994-03-21 1994-10-28 Method for computer-assisted media processing
US08/330,706 1994-10-28

Publications (1)

Publication Number Publication Date
WO1995025996A1 true WO1995025996A1 (en) 1995-09-28

Family

ID=26911132

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1995/003563 WO1995025996A1 (en) 1994-03-21 1995-03-21 Method for computer-assisted media processing

Country Status (6)

Country Link
US (1) US5553281A (en)
EP (1) EP0752128B1 (en)
AU (1) AU2105095A (en)
CA (1) CA2186140C (en)
DE (1) DE69524948T2 (en)
WO (1) WO1995025996A1 (en)

Families Citing this family (117)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0773050A (en) * 1993-09-01 1995-03-17 Fujitsu Ltd Control system for data transmission/reception between programs
JPH07271865A (en) * 1994-04-01 1995-10-20 Mitsubishi Corp Method for managing copyright of data base
US7036019B1 (en) 1994-04-01 2006-04-25 Intarsia Software Llc Method for controlling database copyrights
US5748980A (en) * 1994-05-27 1998-05-05 Microsoft Corporation System for configuring a computer system
US5787246A (en) * 1994-05-27 1998-07-28 Microsoft Corporation System for configuring devices for a computer system
US6763454B2 (en) 1994-05-27 2004-07-13 Microsoft Corp. System for allocating resources in a computer system
US5655148A (en) * 1994-05-27 1997-08-05 Microsoft Corporation Method for automatically configuring devices including a network adapter without manual intervention and without prior configuration information
US7302415B1 (en) 1994-09-30 2007-11-27 Intarsia Llc Data copyright management system
US6424715B1 (en) 1994-10-27 2002-07-23 Mitsubishi Corporation Digital content management system and apparatus
EP0715241B1 (en) 1994-10-27 2004-01-14 Mitsubishi Corporation Apparatus for data copyright management system
US5675788A (en) * 1995-09-15 1997-10-07 Infonautics Corp. Method and apparatus for generating a composite document on a selected topic from a plurality of information sources
US5659742A (en) * 1995-09-15 1997-08-19 Infonautics Corporation Method for storing multi-media information in an information retrieval system
US8595502B2 (en) 1995-09-29 2013-11-26 Intarsia Software Llc Data management system
US5727197A (en) * 1995-11-01 1998-03-10 Filetek, Inc. Method and apparatus for segmenting a database
US5819286A (en) * 1995-12-11 1998-10-06 Industrial Technology Research Institute Video database indexing and query method and system
US7266686B1 (en) 1996-05-09 2007-09-04 Two-Way Media Llc Multicasting method and apparatus
US6374260B1 (en) * 1996-05-24 2002-04-16 Magnifi, Inc. Method and apparatus for uploading, indexing, analyzing, and searching media content
DE19621828A1 (en) * 1996-05-31 1997-12-04 Sel Alcatel Ag Procedure for identifying program compatibility
US6266691B1 (en) * 1996-06-28 2001-07-24 Fujitsu Limited Conference support system with user operation rights and control within the conference
WO1998003928A1 (en) * 1996-07-23 1998-01-29 Lextron Systems, Inc. Integrated services on intranet and internet
US5893110A (en) * 1996-08-16 1999-04-06 Silicon Graphics, Inc. Browser driven user interface to a media asset database
US6073241A (en) * 1996-08-29 2000-06-06 C/Net, Inc. Apparatus and method for tracking world wide web browser requests across distinct domains using persistent client-side state
US7448062B1 (en) * 1996-10-18 2008-11-04 Microsoft Corporation Seamless playback of multiple clips of media data across a data network
US5774666A (en) * 1996-10-18 1998-06-30 Silicon Graphics, Inc. System and method for displaying uniform network resource locators embedded in time-based medium
US5905988A (en) * 1996-11-13 1999-05-18 Imaginon Method and apparatus for database transformation and adaptive playback
US5867667A (en) * 1997-03-24 1999-02-02 Pfn, Inc. Publication network control system using domain and client side communications resource locator lists for managing information communications between the domain server and publication servers
US5884035A (en) * 1997-03-24 1999-03-16 Pfn, Inc. Dynamic distributed group registry apparatus and method for collaboration and selective sharing of information
US5892915A (en) * 1997-04-25 1999-04-06 Emc Corporation System having client sending edit commands to server during transmission of continuous media from one clip in play list for editing the play list
US6199104B1 (en) 1997-04-28 2001-03-06 Sabre Inc. Server-based host monitor
US6286029B1 (en) 1997-04-28 2001-09-04 Sabre Inc. Kiosk controller that retrieves content from servers and then pushes the retrieved content to a kiosk in the order specified in a run list
US6356934B1 (en) 1997-04-28 2002-03-12 Sabre Inc. Intermediate server having control program for storing content accessed during browsing sessions and playback program for asynchronously replaying browsing sessions
US6275848B1 (en) 1997-05-21 2001-08-14 International Business Machines Corp. Method and apparatus for automated referencing of electronic information
US20050169121A1 (en) * 1997-07-09 2005-08-04 Keller Peter J. Optical storage device
WO1999003101A1 (en) * 1997-07-09 1999-01-21 Advanced Audio Devices, Llc Optical storage device
US6278994B1 (en) 1997-07-10 2001-08-21 International Business Machines Corporation Fully integrated architecture for user-defined search
US6253196B1 (en) 1997-07-10 2001-06-26 International Business Machines Corporation Generalized model for the exploitation of database indexes
US6219662B1 (en) 1997-07-10 2001-04-17 International Business Machines Corporation Supporting database indexes based on a generalized B-tree index
US6192358B1 (en) 1997-07-10 2001-02-20 Internatioanal Business Machines Corporation Multiple-stage evaluation of user-defined predicates
US6285996B1 (en) 1997-07-10 2001-09-04 International Business Machines Corp. Run-time support for user-defined index ranges and index filters
US6266663B1 (en) 1997-07-10 2001-07-24 International Business Machines Corporation User-defined search using index exploitation
US6321231B1 (en) 1997-08-11 2001-11-20 Marshall, O'toole, Gerstein, Murray & Borun Data management and order delivery system
US5974415A (en) * 1997-11-10 1999-10-26 International Business Machines System and method for computer-aided heuristic adaptive attribute matching
JPH11146325A (en) 1997-11-10 1999-05-28 Hitachi Ltd Video retrieval method, device therefor, video information generating method and storage medium storing its processing program
US5970491A (en) * 1997-11-10 1999-10-19 International Business Machines Corporation System and method of storage management for an electronic mail system
US6064380A (en) * 1997-11-17 2000-05-16 International Business Machines Corporation Bookmark for multi-media content
US20050028194A1 (en) * 1998-01-13 2005-02-03 Elenbaas Jan Hermanus Personalized news retrieval system
US6144991A (en) * 1998-02-19 2000-11-07 Telcordia Technologies, Inc. System and method for managing interactions between users in a browser-based telecommunications network
US6209939B1 (en) 1998-03-16 2001-04-03 Michael K. Wacker On-site media trailer
US6728947B1 (en) 1998-06-05 2004-04-27 R. R. Donnelley & Sons Company Workflow distributing apparatus and method
US6389425B1 (en) 1998-07-09 2002-05-14 International Business Machines Corporation Embedded storage mechanism for structured data types
JP2000148718A (en) * 1998-11-16 2000-05-30 Canon Inc Information processing method, information processor, information processing system, multimedia presentation system, file updating method, multimedia presentation method, and storage medium
US7117452B1 (en) 1998-12-15 2006-10-03 International Business Machines Corporation System and method for customizing workspace
AU4185800A (en) * 1999-03-30 2000-10-16 Tivo, Inc. Multimedia program bookmarking system
US7130879B1 (en) * 1999-08-10 2006-10-31 Alexandre Dayon System for publishing, organizing, accessing and distributing information in a computer network
JP2001125908A (en) * 1999-10-26 2001-05-11 Sony Corp Input device and method
US6704722B2 (en) * 1999-11-17 2004-03-09 Xerox Corporation Systems and methods for performing crawl searches and index searches
JP2001169266A (en) * 1999-12-07 2001-06-22 Sony Corp Information storage system, server device and information management method
US6549962B1 (en) * 1999-12-21 2003-04-15 Hewlett-Packard Company Demonstration page method and apparatus
US7730113B1 (en) 2000-03-07 2010-06-01 Applied Discovery, Inc. Network-based system and method for accessing and processing emails and other electronic legal documents that may include duplicate information
US7693866B1 (en) 2000-03-07 2010-04-06 Applied Discovery, Inc. Network-based system and method for accessing and processing legal documents
US20020091736A1 (en) * 2000-06-23 2002-07-11 Decis E-Direct, Inc. Component models
US7490092B2 (en) 2000-07-06 2009-02-10 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevance intervals
KR20040041082A (en) * 2000-07-24 2004-05-13 비브콤 인코포레이티드 System and method for indexing, searching, identifying, and editing portions of electronic multimedia files
US6476826B1 (en) * 2000-08-22 2002-11-05 Vastvideo, Inc. Integrated system and method for processing video
US8191103B2 (en) * 2000-08-30 2012-05-29 Sony Corporation Real-time bookmarking of streaming media assets
US20020040311A1 (en) * 2000-10-04 2002-04-04 John Douglass Web browser page rating system
US7890989B1 (en) 2000-10-24 2011-02-15 Sony Corporation Automated context-sensitive updating on content in an audiovisual storage system
EP1346295A4 (en) 2000-11-15 2005-01-12 Mark Frigon Method and apparatus for processing objects in online images
US7870592B2 (en) 2000-12-14 2011-01-11 Intertainer, Inc. Method for interactive video content programming
US20020083006A1 (en) * 2000-12-14 2002-06-27 Intertainer, Inc. Systems and methods for delivering media content
US7647373B2 (en) * 2001-03-13 2010-01-12 Eplus Capital, Inc. System and process for network collaboration through embedded annotation and rendering instructions
US6925469B2 (en) * 2001-03-30 2005-08-02 Intertainer, Inc. Digital entertainment service platform
US20020143782A1 (en) * 2001-03-30 2002-10-03 Intertainer, Inc. Content management system
US20020143647A1 (en) * 2001-03-30 2002-10-03 Intertainer, Inc. Subscriber management system
US20030009371A1 (en) * 2001-07-03 2003-01-09 Ravi Gauba Interactive decision-making scenarios in an audio/video broadcast
KR100438697B1 (en) * 2001-07-07 2004-07-05 삼성전자주식회사 Reproducing apparatus and method for providing bookmark information thereof
US7064688B2 (en) * 2001-07-09 2006-06-20 Good Technology, Inc. System and method for compressing data on a bandwidth-limited network
US20030009595A1 (en) * 2001-07-09 2003-01-09 Roger Collins System and method for compressing data using field-based code word generation
CA2353026A1 (en) 2001-07-13 2003-01-13 Sygenics Inc. Adaptive data architecture
US20030028871A1 (en) * 2001-07-20 2003-02-06 Annie Wang Behavior profile system and method
US8515773B2 (en) 2001-08-01 2013-08-20 Sony Corporation System and method for enabling distribution and brokering of content information
US20030025720A1 (en) * 2001-08-03 2003-02-06 Clement Lau System and method for common interest analysis among multiple users
US7962622B2 (en) * 2001-08-07 2011-06-14 Motorola Mobility, Inc. System and method for providing provisioning and upgrade services for a wireless device
US7243163B1 (en) * 2001-08-07 2007-07-10 Good Technology, Inc. System and method for full wireless synchronization of a data processing apparatus with a messaging system
US7155483B1 (en) 2001-08-07 2006-12-26 Good Technology, Inc. Apparatus and method for conserving bandwidth by batch processing data transactions
US7743119B2 (en) 2001-08-07 2010-06-22 Motorola, Inc. System and method for mapping identification codes
US7596565B2 (en) * 2001-08-07 2009-09-29 Good Technology System and method for maintaining wireless file folders at a wireless device
US20030074447A1 (en) * 2001-10-16 2003-04-17 Rafey Richter A. Intuitive mapping between explicit and implicit personalization
US7315848B2 (en) * 2001-12-12 2008-01-01 Aaron Pearse Web snippets capture, storage and retrieval system and method
US20030112276A1 (en) * 2001-12-19 2003-06-19 Clement Lau User augmentation of content
US6779064B2 (en) * 2002-01-24 2004-08-17 Hewlett-Packard Development Company, L.P. System, method, and computer program product for on-line replacement of a host bus adapter
US7447799B2 (en) * 2002-04-24 2008-11-04 Good Technology, Inc. System and method for automatically updating a wireless device
US9813514B2 (en) 2002-06-12 2017-11-07 Good Technology Holdings Limited Information repository system including a wireless device and related method
US8516034B1 (en) 2002-07-08 2013-08-20 Good Technology Software, Inc System and method for modifying application behavior based on network bandwidth
CN100343836C (en) * 2002-09-18 2007-10-17 松下电器产业株式会社 Information acquiring device and information providing device
US20040095377A1 (en) * 2002-11-18 2004-05-20 Iris Technologies, Inc. Video information analyzer
US20040237107A1 (en) * 2003-05-19 2004-11-25 Staples Mathew L. Media distribution systems and methods
US20060282462A1 (en) * 2003-08-13 2006-12-14 Koninklijke Philips Electronics N.V. Context-of-use-independent content systems
US20050202386A1 (en) * 2004-03-15 2005-09-15 Jehan Clements Flip-over storytelling book publishing system, method, and kit
US20050289163A1 (en) * 2004-06-03 2005-12-29 Eric Gordon Occasion for media objects
US9948989B1 (en) * 2004-07-21 2018-04-17 Cox Communications, Inc. Interactive media content listing search and filtering system for a media content listing display system such as an electronic programming guide
US8768844B2 (en) 2004-10-06 2014-07-01 Sony Corporation Method and system for content sharing and authentication between multiple devices
US7620392B1 (en) 2006-02-27 2009-11-17 Good Technology, Inc. Method and system for distributing and updating software in wireless devices
US20070276810A1 (en) * 2006-05-23 2007-11-29 Joshua Rosen Search Engine for Presenting User-Editable Search Listings and Ranking Search Results Based on the Same
US8966371B2 (en) * 2006-09-11 2015-02-24 Apple Inc. Metadata for providing media content
US20090083312A1 (en) * 2007-09-20 2009-03-26 O'neil Kevin P Document composition system and method
US8713016B2 (en) 2008-12-24 2014-04-29 Comcast Interactive Media, Llc Method and apparatus for organizing segments of media assets and determining relevance of segments to a query
US9442933B2 (en) * 2008-12-24 2016-09-13 Comcast Interactive Media, Llc Identification of segments within audio, video, and multimedia items
US11531668B2 (en) * 2008-12-29 2022-12-20 Comcast Interactive Media, Llc Merging of multiple data sets
US8176043B2 (en) 2009-03-12 2012-05-08 Comcast Interactive Media, Llc Ranking search results
US20100262931A1 (en) * 2009-04-10 2010-10-14 Rovi Technologies Corporation Systems and methods for searching a media guidance application with multiple perspective views
US8533223B2 (en) * 2009-05-12 2013-09-10 Comcast Interactive Media, LLC. Disambiguation and tagging of entities
US9892730B2 (en) 2009-07-01 2018-02-13 Comcast Interactive Media, Llc Generating topic-specific language models
US8423555B2 (en) 2010-07-09 2013-04-16 Comcast Cable Communications, Llc Automatic segmentation of video
US10467289B2 (en) 2011-08-02 2019-11-05 Comcast Cable Communications, Llc Segmentation of video according to narrative theme
CN107967115A (en) * 2011-12-31 2018-04-27 诺基亚技术有限公司 It is shown element
US11823476B2 (en) 2021-05-25 2023-11-21 Bank Of America Corporation Contextual analysis for digital image processing

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5101364A (en) * 1990-02-09 1992-03-31 Massachusetts Institute Of Technology Method and facility for dynamic video composition and viewing
US5200993A (en) * 1991-05-10 1993-04-06 Bell Atlantic Network Services, Inc. Public telephone network including a distributed imaging system
US5231578A (en) * 1988-11-01 1993-07-27 Wang Laboratories, Inc. Apparatus for document annotation and manipulation using images from a window source
US5278946A (en) * 1989-12-04 1994-01-11 Hitachi, Ltd. Method of presenting multimedia data in a desired form by comparing and replacing a user template model with analogous portions of a system
US5317508A (en) * 1991-10-24 1994-05-31 Matsushita Electric Industrial Co., Ltd. Image editing apparatus

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4979050A (en) * 1983-12-02 1990-12-18 Lex Computer And Management Corporation Video composition method for assembling video segments
US4538188A (en) * 1982-12-22 1985-08-27 Montage Computer Corporation Video composition method and apparatus
US4717971A (en) * 1984-08-24 1988-01-05 Eastman Kodak Company Partitioned editing method for a collection of video still pictures
US4817050A (en) * 1985-11-22 1989-03-28 Kabushiki Kaisha Toshiba Database system
US5010478A (en) * 1986-04-11 1991-04-23 Deran Roger L Entity-attribute value database system with inverse attribute for selectively relating two different entities
US5226161A (en) * 1987-08-21 1993-07-06 Wang Laboratories, Inc. Integration of data between typed data structures by mutual direct invocation between data managers corresponding to data types
US5091849A (en) * 1988-10-24 1992-02-25 The Walt Disney Company Computer image production system utilizing first and second networks for separately transferring control information and digital image data
US5109482A (en) * 1989-01-11 1992-04-28 David Bohrman Interactive video control system for displaying user-selectable clips
US5241671C1 (en) * 1989-10-26 2002-07-02 Encyclopaedia Britannica Educa Multimedia search system using a plurality of entry path means which indicate interrelatedness of information
US5267351A (en) * 1989-12-22 1993-11-30 Avid Technology, Inc. Media storage and retrieval system
US5237648A (en) * 1990-06-08 1993-08-17 Apple Computer, Inc. Apparatus and method for editing a video recording by selecting and displaying video clips
US5261093A (en) * 1990-11-05 1993-11-09 David Saroff Research Center, Inc. Interactive relational database analysis with successive refinement steps in selection of ouput data from underlying database
US5263167A (en) * 1991-11-22 1993-11-16 International Business Machines Corporation User interface for a relational database using a task object for defining search queries in response to a profile object which describes user proficiency
JPH05282379A (en) * 1992-02-06 1993-10-29 Internatl Business Mach Corp <Ibm> Method and device for retrieval of dynamic image
US5325297A (en) * 1992-06-25 1994-06-28 System Of Multiple-Colored Images For Internationally Listed Estates, Inc. Computer implemented method and system for storing and retrieving textual data and compressed image data

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5231578A (en) * 1988-11-01 1993-07-27 Wang Laboratories, Inc. Apparatus for document annotation and manipulation using images from a window source
US5278946A (en) * 1989-12-04 1994-01-11 Hitachi, Ltd. Method of presenting multimedia data in a desired form by comparing and replacing a user template model with analogous portions of a system
US5101364A (en) * 1990-02-09 1992-03-31 Massachusetts Institute Of Technology Method and facility for dynamic video composition and viewing
US5200993A (en) * 1991-05-10 1993-04-06 Bell Atlantic Network Services, Inc. Public telephone network including a distributed imaging system
US5317508A (en) * 1991-10-24 1994-05-31 Matsushita Electric Industrial Co., Ltd. Image editing apparatus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP0752128A4 *

Also Published As

Publication number Publication date
US5553281A (en) 1996-09-03
DE69524948T2 (en) 2003-01-30
CA2186140A1 (en) 1995-09-28
EP0752128A1 (en) 1997-01-08
EP0752128A4 (en) 1998-05-20
DE69524948D1 (en) 2002-02-14
AU2105095A (en) 1995-10-09
EP0752128B1 (en) 2002-01-09
CA2186140C (en) 2002-01-01

Similar Documents

Publication Publication Date Title
CA2186140C (en) Method for computer-assisted media processing
US20220342892A1 (en) Methods and systems for managing data
US6393469B1 (en) Method and apparatus for publishing hypermedia documents over wide area networks
US8135727B2 (en) Methods and systems for managing data
US5544354A (en) Multimedia matrix architecture user interface
US8983929B2 (en) Methods and systems for managing data
US7613689B2 (en) Methods and systems for managing data
US8914322B2 (en) Methods and systems for managing composite data files
RU2376630C2 (en) File system for displaying different types of elements and from different physical locations
US7962449B2 (en) Trusted index structure in a network environment
US20100050080A1 (en) Systems and methods for specifying frame-accurate images for media asset management
US8452751B2 (en) Methods and systems for managing data
Hjelsvold et al. Integrated video archive tools
Lee et al. User interface issues for browsing digital video
KR20000015066A (en) System for managing video data
Mostefaoui et al. Distributed video documents indexing and content-based retrieving
Dochev et al. Multimedia Data Management-Characteristics and Requirements

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AM AT AU BB BG BR BY CA CH CN CZ DE DK EE ES FI GB GE HU JP KE KG KP KR KZ LK LR LT LU LV MD MG MN MW MX NL NO NZ PL PT RO RU SD SE SG SI SK TJ TT UA UG UZ VN

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): KE MW SD SZ UG AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2186140

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 1995913804

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1995913804

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWG Wipo information: grant in national office

Ref document number: 1995913804

Country of ref document: EP