CA2202539A1 - Method and apparatus for creating a searchable digital video library and a system and method of using such a library - Google Patents

Method and apparatus for creating a searchable digital video library and a system and method of using such a library

Info

Publication number
CA2202539A1
CA2202539A1 CA002202539A CA2202539A CA2202539A1 CA 2202539 A1 CA2202539 A1 CA 2202539A1 CA 002202539 A CA002202539 A CA 002202539A CA 2202539 A CA2202539 A CA 2202539A CA 2202539 A1 CA2202539 A1 CA 2202539A1
Authority
CA
Canada
Prior art keywords
audio data
library
stamps
creating
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002202539A
Other languages
French (fr)
Other versions
CA2202539C (en
Inventor
Michael L. Mauldin
Michael A. Smith
Scott M. Stevens
Howard D. Wactlar
Michael G. Christel
D. Raj Reddy
Takeo Kanade
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Carnegie Mellon University
Original Assignee
Michael L. Mauldin
Michael A. Smith
Scott M. Stevens
Howard D. Wactlar
Michael G. Christel
D. Raj Reddy
Carnegie Mellon University
Takeo Kanade
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Michael L. Mauldin, Michael A. Smith, Scott M. Stevens, Howard D. Wactlar, Michael G. Christel, D. Raj Reddy, Carnegie Mellon University, Takeo Kanade filed Critical Michael L. Mauldin
Publication of CA2202539A1 publication Critical patent/CA2202539A1/en
Application granted granted Critical
Publication of CA2202539C publication Critical patent/CA2202539C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7834—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using audio features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7844—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using original textual content or text extracted from visual content or transcript of audio data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/785—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using colour or luminescence
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording

Abstract

An apparatus and method of creating a digital library (36) from audio data (18) and video images (20). The method includes the steps of transcribing the audio data and marking the transcribed audio data with a first set of time-stamps (27) and indexing (38) the transcribed audio data. The method also includes the steps of digitizing the video data and marking the digitized video data with a second set of time-stamps (31) related to the first set of time-stamps and segmenting the digitized video data into paragraphs (33) according to a set of rules (37).
The steps of storing the indexed audio data and the digitized video data with their respective sets of time-stamps is also provided. The method also includes the step of passing the transcribed audio data through a natural language interpreter (29) before indexing the transcribed audio data (30).
A method and apparatus for searching the digital library is disclosed.
CA002202539A 1994-10-14 1995-10-12 Method and apparatus for creating a searchable digital video library and a system and method of using such a library Expired - Fee Related CA2202539C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US08/324,076 1994-10-14
US08/324,076 US5835667A (en) 1994-10-14 1994-10-14 Method and apparatus for creating a searchable digital video library and a system and method of using such a library
PCT/US1995/013573 WO1996012239A1 (en) 1994-10-14 1995-10-12 Method and apparatus for creating a searchable digital video library and a system and method of using such a library

Publications (2)

Publication Number Publication Date
CA2202539A1 true CA2202539A1 (en) 1996-04-25
CA2202539C CA2202539C (en) 2004-09-28

Family

ID=23261961

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002202539A Expired - Fee Related CA2202539C (en) 1994-10-14 1995-10-12 Method and apparatus for creating a searchable digital video library and a system and method of using such a library

Country Status (6)

Country Link
US (1) US5835667A (en)
EP (1) EP0786114B1 (en)
JP (1) JPH10507554A (en)
CA (1) CA2202539C (en)
DE (1) DE69503914T2 (en)
WO (1) WO1996012239A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3944234A1 (en) * 2020-07-24 2022-01-26 Atos Global IT Solutions and Services Private Limited Method for processing a video file comprising audio content and visual content comprising text content

Families Citing this family (282)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6182069B1 (en) * 1992-11-09 2001-01-30 International Business Machines Corporation Video query system and method
US5793980A (en) 1994-11-30 1998-08-11 Realnetworks, Inc. Audio-on-demand communication system
US7349976B1 (en) 1994-11-30 2008-03-25 Realnetworks, Inc. Audio-on-demand communication system
US7690043B2 (en) * 1994-12-19 2010-03-30 Legal Igaming, Inc. System and method for connecting gaming devices to a network for remote play
WO1996027983A1 (en) 1995-03-07 1996-09-12 Interval Research Corporation System and method for selective recording of information
EP0834139A4 (en) * 1995-06-07 1998-08-05 Int Language Engineering Corp Machine assisted translation tools
US5794249A (en) * 1995-12-21 1998-08-11 Hewlett-Packard Company Audio/video retrieval system that uses keyword indexing of digital recordings to display a list of the recorded text files, keywords and time stamps associated with the system
US5983237A (en) * 1996-03-29 1999-11-09 Virage, Inc. Visual dictionary
JP3198980B2 (en) * 1996-10-22 2001-08-13 松下電器産業株式会社 Image display device and moving image search system
US5914719A (en) * 1996-12-03 1999-06-22 S3 Incorporated Index and storage system for data provided in the vertical blanking interval
US6263507B1 (en) 1996-12-05 2001-07-17 Interval Research Corporation Browser for use in navigating a body of information, with particular application to browsing information represented by audiovisual data
US5893062A (en) 1996-12-05 1999-04-06 Interval Research Corporation Variable rate video playback with synchronized audio
US6021434A (en) * 1997-03-12 2000-02-01 Siemens Corporate Research, Inc. System for digital video browsing using telephone and fax
US6148304A (en) * 1997-03-19 2000-11-14 Microsoft Corporation Navigating multimedia content using a graphical user interface with multiple display regions
GB9705999D0 (en) * 1997-03-22 1997-05-07 Philips Electronics Nv Video signal analysis and storage
GB2323946B (en) * 1997-04-04 2002-04-17 Sony Uk Ltd Database accessing method and apparatus
US6115035A (en) * 1997-07-21 2000-09-05 Mediaone Group, Inc. System and method for automated audio/video archive and distribution
US7295752B1 (en) 1997-08-14 2007-11-13 Virage, Inc. Video cataloger system with audio track extraction
US6360234B2 (en) 1997-08-14 2002-03-19 Virage, Inc. Video cataloger system with synchronized encoders
US6567980B1 (en) 1997-08-14 2003-05-20 Virage, Inc. Video cataloger system with hyperlinked output
US6463444B1 (en) 1997-08-14 2002-10-08 Virage, Inc. Video cataloger system with extensibility
EP0903676A3 (en) * 1997-09-17 2002-01-02 Sun Microsystems, Inc. Identifying optimal thumbnail images for video search hitlist
US6044378A (en) * 1997-09-29 2000-03-28 International Business Machines Corporation Method and system for a federated digital library by managing links
US6321374B1 (en) 1997-11-07 2001-11-20 International Business Machines Corporation Application-independent generator to generate a database transaction manager in heterogeneous information systems
JPH11146325A (en) 1997-11-10 1999-05-28 Hitachi Ltd Video retrieval method, device therefor, video information generating method and storage medium storing its processing program
US6256636B1 (en) * 1997-11-26 2001-07-03 International Business Machines Corporation Object server for a digital library system
US7596755B2 (en) 1997-12-22 2009-09-29 Ricoh Company, Ltd. Multimedia visualization and integration environment
US6363380B1 (en) * 1998-01-13 2002-03-26 U.S. Philips Corporation Multimedia computer system with story segmentation capability and operating program therefor including finite automation video parser
US6216131B1 (en) * 1998-02-06 2001-04-10 Starfish Software, Inc. Methods for mapping data fields from one data set to another in a data processing environment
US6377995B2 (en) * 1998-02-19 2002-04-23 At&T Corp. Indexing multimedia communications
US6560281B1 (en) * 1998-02-24 2003-05-06 Xerox Corporation Method and apparatus for generating a condensed version of a video sequence including desired affordances
US6351765B1 (en) * 1998-03-09 2002-02-26 Media 100, Inc. Nonlinear video editing system
JP4462654B2 (en) * 1998-03-26 2010-05-12 ソニー株式会社 Video material selection device and video material selection method
US6112172A (en) * 1998-03-31 2000-08-29 Dragon Systems, Inc. Interactive searching
US6393147B2 (en) * 1998-04-13 2002-05-21 Intel Corporation Color region based recognition of unidentified objects
US20020036694A1 (en) * 1998-05-07 2002-03-28 Merril Jonathan R. Method and system for the storage and retrieval of web-based educational materials
US7689898B2 (en) * 1998-05-07 2010-03-30 Astute Technology, Llc Enhanced capture, management and distribution of live presentations
US6789228B1 (en) * 1998-05-07 2004-09-07 Medical Consumer Media Method and system for the storage and retrieval of web-based education materials
US6473095B1 (en) * 1998-07-16 2002-10-29 Koninklijke Philips Electronics N.V. Histogram method for characterizing video content
US6833865B1 (en) * 1998-09-01 2004-12-21 Virage, Inc. Embedded metadata engines in digital capture devices
US6198511B1 (en) * 1998-09-10 2001-03-06 Intel Corporation Identifying patterns in closed caption script
US6622171B2 (en) 1998-09-15 2003-09-16 Microsoft Corporation Multimedia timeline modification in networked client/server systems
US6415326B1 (en) 1998-09-15 2002-07-02 Microsoft Corporation Timeline correlation between multiple timeline-altered media streams
JP3252282B2 (en) 1998-12-17 2002-02-04 松下電器産業株式会社 Method and apparatus for searching scene
US6246803B1 (en) 1998-12-27 2001-06-12 The University Of Kansas Real-time feature-based video stream validation and distortion analysis system using color moments
US6397181B1 (en) * 1999-01-27 2002-05-28 Kent Ridge Digital Labs Method and apparatus for voice annotation and retrieval of multimedia data
US6377296B1 (en) * 1999-01-28 2002-04-23 International Business Machines Corporation Virtual map system and method for tracking objects
US6462754B1 (en) * 1999-02-22 2002-10-08 Siemens Corporate Research, Inc. Method and apparatus for authoring and linking video documents
US6519562B1 (en) * 1999-02-25 2003-02-11 Speechworks International, Inc. Dynamic semantic control of a speech recognition system
CN1343337B (en) * 1999-03-05 2013-03-20 佳能株式会社 Method and device for producing annotation data including phonemes data and decoded word
US6643620B1 (en) * 1999-03-15 2003-11-04 Matsushita Electric Industrial Co., Ltd. Voice activated controller for recording and retrieving audio/video programs
US6535920B1 (en) * 1999-04-06 2003-03-18 Microsoft Corporation Analyzing, indexing and seeking of streaming information
US6378035B1 (en) 1999-04-06 2002-04-23 Microsoft Corporation Streaming information appliance with buffer read and write synchronization
US6463486B1 (en) 1999-04-06 2002-10-08 Microsoft Corporation System for handling streaming information using a plurality of reader modules by enumerating output pins and associated streams of information
US6820144B2 (en) 1999-04-06 2004-11-16 Microsoft Corporation Data format for a streaming information appliance
US6748481B1 (en) 1999-04-06 2004-06-08 Microsoft Corporation Streaming information appliance with circular buffer for receiving and selectively reading blocks of streaming information
US7877774B1 (en) * 1999-04-19 2011-01-25 At&T Intellectual Property Ii, L.P. Browsing and retrieval of full broadcast-quality video
US9171545B2 (en) * 1999-04-19 2015-10-27 At&T Intellectual Property Ii, L.P. Browsing and retrieval of full broadcast-quality video
US6636238B1 (en) * 1999-04-20 2003-10-21 International Business Machines Corporation System and method for linking an audio stream with accompanying text material
US6542882B1 (en) * 1999-04-22 2003-04-01 Gateway, Inc. System and method for providing a database of content having like associations
EP1047075A3 (en) * 1999-04-23 2005-12-28 Sony Corporation Information processing apparatus, information managing method and medium
WO2000072186A2 (en) * 1999-05-25 2000-11-30 Swtv Production Services, Inc. Method and apparatus for creating digital archives
KR100624865B1 (en) * 1999-06-02 2006-09-18 엘지전자 주식회사 Video system based on user profile
US6535848B1 (en) * 1999-06-08 2003-03-18 International Business Machines Corporation Method and apparatus for transcribing multiple files into a single document
CN1193593C (en) * 1999-07-06 2005-03-16 皇家菲利浦电子有限公司 Automatic extraction method of the structure of a video sequence
JP2003503972A (en) * 1999-07-06 2003-01-28 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Automatic extraction of video sequence structure
US7313808B1 (en) * 1999-07-08 2007-12-25 Microsoft Corporation Browsing continuous multimedia content
US7293280B1 (en) 1999-07-08 2007-11-06 Microsoft Corporation Skimming continuous multimedia content
US6442518B1 (en) * 1999-07-14 2002-08-27 Compaq Information Technologies Group, L.P. Method for refining time alignments of closed captions
US6504995B1 (en) * 1999-07-21 2003-01-07 Hewlett-Packard Company Apparatus and method for storing compressed data to a storage device
US6751776B1 (en) * 1999-08-06 2004-06-15 Nec Corporation Method and apparatus for personalized multimedia summarization based upon user specified theme
US7996878B1 (en) * 1999-08-31 2011-08-09 At&T Intellectual Property Ii, L.P. System and method for generating coded video sequences from still media
GB2354105A (en) * 1999-09-08 2001-03-14 Sony Uk Ltd System and method for navigating source content
JP2001101841A (en) * 1999-09-29 2001-04-13 Toshiba Corp Information storage medium on which sound information in which representative pictures are set in reproduction unit are recorded, setting method for representative picture and reproducing method utilizing the representative picture
US7155735B1 (en) 1999-10-08 2006-12-26 Vulcan Patents Llc System and method for the broadcast dissemination of time-ordered data
US7310600B1 (en) 1999-10-28 2007-12-18 Canon Kabushiki Kaisha Language recognition using a similarity measure
US6882970B1 (en) 1999-10-28 2005-04-19 Canon Kabushiki Kaisha Language recognition using sequence frequency
DE60036486T2 (en) 1999-10-28 2008-06-12 Canon K.K. METHOD AND APPARATUS FOR CHECKING PATTERN CONVERSATIONS
US7013283B1 (en) * 1999-11-17 2006-03-14 Sarnoff Corporation System and method for providing programming content in response to an audio signal
US6993245B1 (en) 1999-11-18 2006-01-31 Vulcan Patents Llc Iterative, maximally probable, batch-mode commercial detection for audiovisual content
US7065342B1 (en) 1999-11-23 2006-06-20 Gofigure, L.L.C. System and mobile cellular telephone device for playing recorded music
KR100346264B1 (en) * 1999-12-02 2002-07-26 엘지전자주식회사 Multimedia Feature Description System Using Weight And Reliability
US7453991B1 (en) * 1999-12-08 2008-11-18 At&T Corp. Method and apparatus for voice mail notes
US6928655B1 (en) * 1999-12-16 2005-08-09 Microsoft Corporation Live presentation searching
US7149359B1 (en) 1999-12-16 2006-12-12 Microsoft Corporation Searching and recording media streams
SG96543A1 (en) * 2000-01-06 2003-06-16 Serial System Ltd A method and apparatus for capturing and recording audio and video data on optical storage media
US6757682B1 (en) 2000-01-28 2004-06-29 Interval Research Corporation Alerting users to items of current interest
US6868440B1 (en) * 2000-02-04 2005-03-15 Microsoft Corporation Multi-level skimming of multimedia content using playlists
JP2001229195A (en) * 2000-02-18 2001-08-24 Fujitsu Ltd Video data processing system
US8910199B2 (en) 2000-02-25 2014-12-09 Interval Licensing Llc Targeted television content display
WO2001063916A1 (en) 2000-02-25 2001-08-30 Interval Research Corporation Method and system for selecting advertisements
US7047191B2 (en) * 2000-03-06 2006-05-16 Rochester Institute Of Technology Method and system for providing automated captioning for AV signals
US6299076B1 (en) 2000-03-10 2001-10-09 Jeffrey E. Sloan Steam cleaning system
US7237254B1 (en) 2000-03-29 2007-06-26 Microsoft Corporation Seamless switching between different playback speeds of time-scale modified data streams
US6985966B1 (en) 2000-03-29 2006-01-10 Microsoft Corporation Resynchronizing globally unsynchronized multimedia streams
US6816858B1 (en) * 2000-03-31 2004-11-09 International Business Machines Corporation System, method and apparatus providing collateral information for a video/audio stream
EP1183688B1 (en) 2000-04-05 2011-10-12 Sony Europe Limited Audio/video reproducing apparatus and method
US7962948B1 (en) 2000-04-07 2011-06-14 Virage, Inc. Video-enabled community building
US8171509B1 (en) 2000-04-07 2012-05-01 Virage, Inc. System and method for applying a database to video multimedia
US7222163B1 (en) 2000-04-07 2007-05-22 Virage, Inc. System and method for hosting of video content over a network
US7260564B1 (en) 2000-04-07 2007-08-21 Virage, Inc. Network video guide and spidering
US7302490B1 (en) * 2000-05-03 2007-11-27 Microsoft Corporation Media file format to support switching between multiple timeline-altered media streams
GB0011798D0 (en) * 2000-05-16 2000-07-05 Canon Kk Database annotation and retrieval
US6505153B1 (en) 2000-05-22 2003-01-07 Compaq Information Technologies Group, L.P. Efficient method for producing off-line closed captions
US7281220B1 (en) * 2000-05-31 2007-10-09 Intel Corporation Streaming video programming guide system selecting video files from multiple web sites and automatically generating selectable thumbnail frames and selectable keyword icons
US6882793B1 (en) 2000-06-16 2005-04-19 Yesvideo, Inc. Video processing system
GB0015233D0 (en) 2000-06-21 2000-08-16 Canon Kk Indexing method and apparatus
US7149686B1 (en) * 2000-06-23 2006-12-12 International Business Machines Corporation System and method for eliminating synchronization errors in electronic audiovisual transmissions and presentations
DE60137225D1 (en) * 2000-06-29 2009-02-12 Koninkl Philips Electronics Nv LANGUAGE QUALITY ESTIMATE FOR OFF-LINE LANGUAGE RECOGNITION
US9083788B1 (en) * 2000-07-19 2015-07-14 S.F. Ip Properties 21 Llc Portable communications device
WO2002011428A2 (en) * 2000-07-28 2002-02-07 Koninklijke Philips Electronics N.V. Visualization and playback of television shows at a sub-show level
US6766376B2 (en) 2000-09-12 2004-07-20 Sn Acquisition, L.L.C Streaming media buffering system
US6993246B1 (en) 2000-09-15 2006-01-31 Hewlett-Packard Development Company, L.P. Method and system for correlating data streams
EP1191460A1 (en) * 2000-09-21 2002-03-27 Swisscom AG Method and system for classifying digital audio and video files
US7461099B1 (en) 2000-09-26 2008-12-02 6S, Limited Method and system for archiving and retrieving items based on episodic memory of groups of people
US8701022B2 (en) * 2000-09-26 2014-04-15 6S Limited Method and system for archiving and retrieving items based on episodic memory of groups of people
GB0023930D0 (en) 2000-09-29 2000-11-15 Canon Kk Database annotation and retrieval
GB0027178D0 (en) 2000-11-07 2000-12-27 Canon Kk Speech processing system
JP2002157112A (en) * 2000-11-20 2002-05-31 Teac Corp Voice information converting device
GB0028277D0 (en) 2000-11-20 2001-01-03 Canon Kk Speech processing system
GB0029861D0 (en) * 2000-12-07 2001-01-24 Sony Uk Ltd Replaying video information
US20020108115A1 (en) * 2000-12-11 2002-08-08 The Associated Press News and other information delivery system and method
US7210157B2 (en) * 2000-12-18 2007-04-24 Koninklijke Philips Electronics N.V. Apparatus and method of program classification using observed cues in the transcript information
US6798912B2 (en) 2000-12-18 2004-09-28 Koninklijke Philips Electronics N.V. Apparatus and method of program classification based on syntax of transcript information
KR100422805B1 (en) * 2000-12-26 2004-03-12 한국전자통신연구원 Color and shape search method and apparatus of image data based on natural language with fuzzy concept
JP2002202985A (en) * 2000-12-28 2002-07-19 Pioneer Electronic Corp Device and method for distributing av information, device and method for retrieving av information, av information distribution and retrieval system, and information recording medium
US7072328B2 (en) 2001-01-12 2006-07-04 Voicegenie Technologies Inc. Computer-implemented voice markup language-based server
US20020095330A1 (en) * 2001-01-12 2002-07-18 Stuart Berkowitz Audio Advertising computer system and method
US7379973B2 (en) * 2001-01-12 2008-05-27 Voicegenie Technologies, Inc. Computer-implemented voice application indexing web site
US6826316B2 (en) * 2001-01-24 2004-11-30 Eastman Kodak Company System and method for determining image similarity
US20020108112A1 (en) * 2001-02-02 2002-08-08 Ensequence, Inc. System and method for thematically analyzing and annotating an audio-visual sequence
JP4191932B2 (en) * 2001-03-08 2008-12-03 パナソニック株式会社 Media distribution apparatus and media distribution method
US7248778B1 (en) * 2001-03-16 2007-07-24 Gateway Inc. Automated video editing system and method
US20030088687A1 (en) 2001-12-28 2003-05-08 Lee Begeja Method and apparatus for automatically converting source video into electronic mail messages
US8060906B2 (en) * 2001-04-06 2011-11-15 At&T Intellectual Property Ii, L.P. Method and apparatus for interactively retrieving content related to previous query results
US20030163815A1 (en) * 2001-04-06 2003-08-28 Lee Begeja Method and system for personalized multimedia delivery service
US7039585B2 (en) * 2001-04-10 2006-05-02 International Business Machines Corporation Method and system for searching recorded speech and retrieving relevant segments
US20030033294A1 (en) * 2001-04-13 2003-02-13 Walker Jay S. Method and apparatus for marketing supplemental information
US6662176B2 (en) * 2001-05-07 2003-12-09 Hewlett-Packard Development Company, L.P. Database indexing and rolling storage method for time-stamped normalized event data
CA2386303C (en) 2001-05-14 2005-07-05 At&T Corp. Method for content-based non-linear control of multimedia playback
EP1262881A1 (en) * 2001-05-31 2002-12-04 Project Automation S.p.A. Method for the management of data originating from procedural statements
US7031444B2 (en) * 2001-06-29 2006-04-18 Voicegenie Technologies, Inc. Computer-implemented voice markup system and method
JP4615166B2 (en) * 2001-07-17 2011-01-19 パイオニア株式会社 Video information summarizing apparatus, video information summarizing method, and video information summarizing program
JP4593842B2 (en) * 2001-08-03 2010-12-08 キヤノン株式会社 Moving image retrieval apparatus and control method thereof
US20030033602A1 (en) * 2001-08-08 2003-02-13 Simon Gibbs Method and apparatus for automatic tagging and caching of highlights
US7091989B2 (en) 2001-08-10 2006-08-15 Sony Corporation System and method for data assisted chroma-keying
US7089575B2 (en) * 2001-09-04 2006-08-08 Koninklijke Philips Electronics N.V. Method of using transcript information to identify and learn commercial portions of a program
US20030050777A1 (en) * 2001-09-07 2003-03-13 Walker William Donald System and method for automatic transcription of conversations
JP2003163885A (en) * 2001-11-27 2003-06-06 Sony Corp Data recording method, system, and medium
US20030101104A1 (en) * 2001-11-28 2003-05-29 Koninklijke Philips Electronics N.V. System and method for retrieving information related to targeted subjects
JP4061458B2 (en) * 2001-12-05 2008-03-19 ソニー株式会社 Video data retrieval method, video data retrieval system, video data editing method, and video data editing system
US20030107592A1 (en) * 2001-12-11 2003-06-12 Koninklijke Philips Electronics N.V. System and method for retrieving information related to persons in video programs
US6564144B1 (en) * 2002-01-10 2003-05-13 Navigation Technologies Corporation Method and system using a hand-gesture responsive device for collecting data for a geographic database
US6928407B2 (en) * 2002-03-29 2005-08-09 International Business Machines Corporation System and method for the automatic discovery of salient segments in speech transcripts
US20030187820A1 (en) 2002-03-29 2003-10-02 Michael Kohut Media management system and process
US7466901B2 (en) * 2002-04-17 2008-12-16 Samsung Electronics Co., Ltd. Recording medium containing thumbnail recorded thereon, recording apparatus and method therefor, and reproducing apparatus and method therefor
US7152056B2 (en) * 2002-04-19 2006-12-19 Dow Jones Reuters Business Interactive, Llc Apparatus and method for generating data useful in indexing and searching
JP4174234B2 (en) * 2002-04-26 2008-10-29 キヤノン株式会社 Image processing apparatus and image processing method
US7231351B1 (en) * 2002-05-10 2007-06-12 Nexidia, Inc. Transcript alignment
US20040093263A1 (en) * 2002-05-29 2004-05-13 Doraisamy Malchiel A. Automated Interview Method
US7224981B2 (en) * 2002-06-20 2007-05-29 Intel Corporation Speech recognition of mobile devices
WO2004002144A1 (en) * 2002-06-24 2003-12-31 Matsushita Electric Industrial Co., Ltd. Metadata preparing device, preparing method therefor and retrieving device
US20040006628A1 (en) * 2002-07-03 2004-01-08 Scott Shepard Systems and methods for providing real-time alerting
US20040117188A1 (en) 2002-07-03 2004-06-17 Daniel Kiecza Speech based personal information manager
US20040025191A1 (en) * 2002-07-31 2004-02-05 B. Popular, Inc. System and method for creating and presenting content packages
US7483624B2 (en) * 2002-08-30 2009-01-27 Hewlett-Packard Development Company, L.P. System and method for indexing a video sequence
US10721066B2 (en) 2002-09-30 2020-07-21 Myport Ip, Inc. Method for voice assistant, location tagging, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatags/contextual tags, storage and search retrieval
US7778438B2 (en) 2002-09-30 2010-08-17 Myport Technologies, Inc. Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval
US6996251B2 (en) * 2002-09-30 2006-02-07 Myport Technologies, Inc. Forensic communication apparatus and method
US9684675B2 (en) * 2002-09-30 2017-06-20 Adobe Systems Incorporated Reduction of search ambiguity with multiple media references
US9251649B2 (en) 2002-10-09 2016-02-02 Zynga Inc. System and method for connecting gaming devices to a network for remote play
US20040083090A1 (en) * 2002-10-17 2004-04-29 Daniel Kiecza Manager for integrating language technology components
JP4228662B2 (en) * 2002-11-19 2009-02-25 日本電気株式会社 Video browsing system and method
US7593915B2 (en) * 2003-01-07 2009-09-22 Accenture Global Services Gmbh Customized multi-media services
US20040177317A1 (en) * 2003-03-07 2004-09-09 John Bradstreet Closed caption navigation
DE10311581A1 (en) * 2003-03-10 2004-09-23 Deutsche Telekom Ag Process and system for the automated creation of vocabulary
US20040216173A1 (en) * 2003-04-11 2004-10-28 Peter Horoszowski Video archiving and processing method and apparatus
KR100510138B1 (en) * 2003-05-01 2005-08-26 삼성전자주식회사 Method for selecting reference picture, motion compensation method thereof and apparatus thereof
US20050013589A1 (en) * 2003-07-14 2005-01-20 Microsoft Corporation Adding recording functionality to a media player
US20050038814A1 (en) * 2003-08-13 2005-02-17 International Business Machines Corporation Method, apparatus, and program for cross-linking information sources using multiple modalities
US20050058431A1 (en) * 2003-09-12 2005-03-17 Charles Jia Generating animated image file from video data file frames
US7243110B2 (en) * 2004-02-20 2007-07-10 Sand Technology Inc. Searchable archive
US8886617B2 (en) 2004-02-20 2014-11-11 Informatica Corporation Query-based searching using a virtual table
US7293034B2 (en) * 2004-02-23 2007-11-06 Microsoft Coporation Dynamically customizing a user interface for the aggregation of content
US7624123B2 (en) * 2004-02-26 2009-11-24 Ati Technologies, Inc. Image processing system and method
US20060041926A1 (en) * 2004-04-30 2006-02-23 Vulcan Inc. Voice control of multimedia content
US20050283752A1 (en) * 2004-05-17 2005-12-22 Renate Fruchter DiVAS-a cross-media system for ubiquitous gesture-discourse-sketch knowledge capture and reuse
US20060075354A1 (en) * 2004-10-05 2006-04-06 Elizabeth Harpel Experience digitally recorded book
US7933338B1 (en) 2004-11-10 2011-04-26 Google Inc. Ranking video articles
US7912827B2 (en) * 2004-12-02 2011-03-22 At&T Intellectual Property Ii, L.P. System and method for searching text-based media content
US20060167873A1 (en) * 2005-01-21 2006-07-27 Degenaro Louis R Editor for deriving regular expressions by example
US7870488B2 (en) * 2005-02-10 2011-01-11 Transcript Associates, Inc. Media editing system
WO2006088780A2 (en) * 2005-02-12 2006-08-24 Teresis Media Management, Inc. Methods and apparatuses for assisting the production of media works and the like
US10607305B2 (en) * 2005-03-05 2020-03-31 Jeb C. Griebat Method for questioning jurors
US9020326B2 (en) 2005-08-23 2015-04-28 At&T Intellectual Property Ii, L.P. System and method for content-based navigation of live and recorded TV and video programs
US9042703B2 (en) 2005-10-31 2015-05-26 At&T Intellectual Property Ii, L.P. System and method for content-based navigation of live and recorded TV and video programs
US8156114B2 (en) 2005-08-26 2012-04-10 At&T Intellectual Property Ii, L.P. System and method for searching and analyzing media content
JP4543261B2 (en) * 2005-09-28 2010-09-15 国立大学法人電気通信大学 Playback device
US20070118372A1 (en) * 2005-11-23 2007-05-24 General Electric Company System and method for generating closed captions
US9100723B2 (en) * 2006-03-07 2015-08-04 Samsung Electronics Co., Ltd. Method and system for managing information on a video recording
US7667120B2 (en) * 2006-03-30 2010-02-23 The Tsi Company Training method using specific audio patterns and techniques
US7668721B2 (en) * 2006-05-22 2010-02-23 Microsoft Corporation Indexing and strong verbal content
TWI312945B (en) * 2006-06-07 2009-08-01 Ind Tech Res Inst Method and apparatus for multimedia data management
TW200813760A (en) * 2006-06-20 2008-03-16 There Yugo Inc Multimedia system and method relating thereto
US8739240B2 (en) * 2006-09-12 2014-05-27 At&T Intellectual Property I, L.P. Authoring system for IPTV network
US7881505B2 (en) * 2006-09-29 2011-02-01 Pittsburgh Pattern Recognition, Inc. Video retrieval system for human face content
US9311394B2 (en) * 2006-10-31 2016-04-12 Sony Corporation Speech recognition for internet video search and navigation
EP2126707A2 (en) * 2007-01-17 2009-12-02 Verbal World, Inc. Methods and apparatus for manipulation of primary audio-optical data content and associated secondary data content
US8788938B2 (en) * 2007-01-19 2014-07-22 Hewlett-Packard Development Company, L.P. Web-based video browsing
EP3438883B1 (en) * 2007-06-04 2023-11-29 Enswers Co., Ltd. Method and apparatus for detecting a common section in moving pictures
JP5025353B2 (en) * 2007-07-03 2012-09-12 ニュアンス コミュニケーションズ，インコーポレイテッド Dialog processing apparatus, dialog processing method, and computer program
US8781996B2 (en) 2007-07-12 2014-07-15 At&T Intellectual Property Ii, L.P. Systems, methods and computer program products for searching within movies (SWiM)
US8090580B2 (en) * 2007-10-04 2012-01-03 Oracle International Corporation Systems and methods for maintenance knowledge management
US20090162818A1 (en) * 2007-12-21 2009-06-25 Martin Kosakowski Method for the determination of supplementary content in an electronic device
US8032384B2 (en) * 2008-03-14 2011-10-04 Jay S Rylander Hand held language translation and learning device
US20090249406A1 (en) * 2008-03-31 2009-10-01 Broadcom Corporation Mobile video device with enhanced video navigation
US9202460B2 (en) * 2008-05-14 2015-12-01 At&T Intellectual Property I, Lp Methods and apparatus to generate a speech recognition library
US9077933B2 (en) 2008-05-14 2015-07-07 At&T Intellectual Property I, L.P. Methods and apparatus to generate relevance rankings for use by a program selector of a media presentation system
JP4702577B2 (en) * 2008-06-26 2011-06-15 日本電気株式会社 Content reproduction order determination system, method and program thereof
US8332414B2 (en) 2008-07-01 2012-12-11 Samsung Electronics Co., Ltd. Method and system for prefetching internet content for video recorders
DE102008044635A1 (en) * 2008-07-22 2010-02-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for providing a television sequence
US8140544B2 (en) * 2008-09-03 2012-03-20 International Business Machines Corporation Interactive digital video library
US8259082B2 (en) 2008-09-12 2012-09-04 At&T Intellectual Property I, L.P. Multimodal portable communication interface for accessing video content
US8169483B1 (en) * 2008-10-03 2012-05-01 The United States Of America As Represented By The Secretary Of Agriculture System and method for synchronizing waveform data with an associated video
US20100251291A1 (en) * 2009-03-24 2010-09-30 Pino Jr Angelo J System, Method and Computer Program Product for Processing Video Data
US8769589B2 (en) * 2009-03-31 2014-07-01 At&T Intellectual Property I, L.P. System and method to create a media content summary based on viewer annotations
US9245017B2 (en) * 2009-04-06 2016-01-26 Caption Colorado L.L.C. Metatagging of captions
US10225625B2 (en) 2009-04-06 2019-03-05 Vitac Corporation Caption extraction and analysis
US20110320464A1 (en) * 2009-04-06 2011-12-29 Mitsubishi Electric Corporation Retrieval device
US8768945B2 (en) * 2009-05-21 2014-07-01 Vijay Sathya System and method of enabling identification of a right event sound corresponding to an impact related event
US20100299131A1 (en) * 2009-05-21 2010-11-25 Nexidia Inc. Transcript alignment
US20100332225A1 (en) * 2009-06-29 2010-12-30 Nexidia Inc. Transcript alignment
US8281231B2 (en) * 2009-09-11 2012-10-02 Digitalsmiths, Inc. Timeline alignment for closed-caption text using speech recognition transcripts
US8359401B2 (en) * 2009-11-05 2013-01-22 RJ Intellectual Properties, Inc. Network switch
US8463934B2 (en) 2009-11-05 2013-06-11 Rj Intellectual Properties, Llc Unified system area network and switch
US20130166303A1 (en) * 2009-11-13 2013-06-27 Adobe Systems Incorporated Accessing media data using metadata repository
KR20110114997A (en) * 2010-04-14 2011-10-20 한국전자통신연구원 Method and apparatus of digital broadcasting service using automatic keyword generation
US20110257972A1 (en) * 2010-04-15 2011-10-20 Markus Agevik System and method for location tracking using audio input
US8423555B2 (en) * 2010-07-09 2013-04-16 Comcast Cable Communications, Llc Automatic segmentation of video
US8578300B2 (en) * 2010-12-31 2013-11-05 Verizon Patent And Licensing Inc. Media content user interface systems and methods
US20130334300A1 (en) 2011-01-03 2013-12-19 Curt Evans Text-synchronized media utilization and manipulation based on an embedded barcode
US20120209606A1 (en) * 2011-02-14 2012-08-16 Nice Systems Ltd. Method and apparatus for information extraction from interactions
US20120209605A1 (en) * 2011-02-14 2012-08-16 Nice Systems Ltd. Method and apparatus for data exploration of interactions
US10467289B2 (en) * 2011-08-02 2019-11-05 Comcast Cable Communications, Llc Segmentation of video according to narrative theme
US9602738B2 (en) 2011-11-23 2017-03-21 Avigilon Fortress Corporation Automatic event detection, text generation, and use thereof
US8972262B1 (en) * 2012-01-18 2015-03-03 Google Inc. Indexing and search of content in recorded group communications
US9736520B2 (en) 2012-02-01 2017-08-15 Futurewei Technologies, Inc. System and method for organizing multimedia content
US9244924B2 (en) * 2012-04-23 2016-01-26 Sri International Classification, search, and retrieval of complex video events
US20130308922A1 (en) * 2012-05-15 2013-11-21 Microsoft Corporation Enhanced video discovery and productivity through accessibility
KR102081925B1 (en) 2012-08-29 2020-02-26 엘지전자 주식회사 display device and speech search method thereof
US10915492B2 (en) * 2012-09-19 2021-02-09 Box, Inc. Cloud-based platform enabled with media content indexed for text-based searches and/or metadata extraction
FR3004054A1 (en) * 2013-03-26 2014-10-03 France Telecom GENERATING AND RETURNING A FLOW REPRESENTATIVE OF AUDIOVISUAL CONTENT
US9183466B2 (en) 2013-06-15 2015-11-10 Purdue Research Foundation Correlating videos and sentences
US11481855B2 (en) 2013-08-07 2022-10-25 Jeb C. Griebat Method for questioning jurors
KR102092164B1 (en) * 2013-12-27 2020-03-23 삼성전자주식회사 Display device, server device, display system comprising them and methods thereof
US9479730B1 (en) 2014-02-13 2016-10-25 Steelcase, Inc. Inferred activity based conference enhancement method and system
US9893944B2 (en) 2014-10-01 2018-02-13 International Business Machines Corporation Managing network bandwidth based on cognitive analysis of site content against organizational needs
MX2017006581A (en) * 2014-11-28 2017-09-01 Sony Corp Transmission device, transmission method, reception device, and reception method.
US10609454B2 (en) * 2015-07-31 2020-03-31 Promptu Systems Corporation Natural language navigation and assisted viewing of indexed audio video streams, notably sports contests
US10228775B2 (en) * 2016-01-22 2019-03-12 Microsoft Technology Licensing, Llc Cross application digital ink repository
CN108780457A (en) * 2016-02-09 2018-11-09 开利公司 Multiple queries are executed in steady video search and search mechanism
CN106021354A (en) * 2016-05-10 2016-10-12 北京信息科技大学 Establishment method of digital interpretation library of Dongba classical ancient books
USD816117S1 (en) * 2016-06-13 2018-04-24 Apple Inc. Display screen or portion thereof with icon
US10845956B2 (en) * 2017-05-31 2020-11-24 Snap Inc. Methods and systems for voice driven dynamic menus
US20190020854A1 (en) * 2017-07-13 2019-01-17 Bryce Jonathan Di Geronimo Method and system for recording online tutoring
US10885159B2 (en) 2018-07-09 2021-01-05 Dish Network L.L.C. Content anti-piracy management system and method
US20200152237A1 (en) * 2018-11-13 2020-05-14 Zuoliang Chen System and Method of AI Powered Combined Video Production
US10963841B2 (en) 2019-03-27 2021-03-30 On Time Staffing Inc. Employment candidate empathy scoring system
US10728443B1 (en) 2019-03-27 2020-07-28 On Time Staffing Inc. Automatic camera angle switching to create combined audiovisual file
US11127232B2 (en) 2019-11-26 2021-09-21 On Time Staffing Inc. Multi-camera, multi-sensor panel data extraction system and method
US11250872B2 (en) 2019-12-14 2022-02-15 International Business Machines Corporation Using closed captions as parallel training data for customization of closed captioning systems
US11023735B1 (en) 2020-04-02 2021-06-01 On Time Staffing, Inc. Automatic versioning of video presentations
US11144882B1 (en) 2020-09-18 2021-10-12 On Time Staffing Inc. Systems and methods for evaluating actions over a computer network and establishing live network connections
US11425181B1 (en) 2021-05-11 2022-08-23 CLIPr Co. System and method to ingest one or more video streams across a web platform
US11445273B1 (en) 2021-05-11 2022-09-13 CLIPr Co. System and method for creating a video summary based on video relevancy
US11355155B1 (en) 2021-05-11 2022-06-07 CLIPr Co. System and method to summarize one or more videos based on user priorities
US11610402B2 (en) 2021-05-11 2023-03-21 CLIPr Co. System and method for crowdsourcing a video summary for creating an enhanced video summary
US11727040B2 (en) 2021-08-06 2023-08-15 On Time Staffing, Inc. Monitoring third-party forum contributions to improve searching through time-to-live data assignments
US11423071B1 (en) 2021-08-31 2022-08-23 On Time Staffing, Inc. Candidate data ranking method using previously selected candidate data
TWI784780B (en) * 2021-11-03 2022-11-21 財團法人資訊工業策進會 Multimodal method for detecting video, multimodal video detecting system and non-transitory computer readable medium
WO2023168373A1 (en) * 2022-03-04 2023-09-07 Google Llc Structured video documents
US11907652B2 (en) 2022-06-02 2024-02-20 On Time Staffing, Inc. User interface and systems for document creation

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4905094A (en) * 1988-06-30 1990-02-27 Telaction Corporation System for audio/video presentation
US5136655A (en) * 1990-03-26 1992-08-04 Hewlett-Pacard Company Method and apparatus for indexing and retrieving audio-video data
WO1992002890A1 (en) * 1990-08-09 1992-02-20 Semantic Compaction System Communication system with text message retrieval based on concepts inputted via keyboard icons
EP0645757B1 (en) * 1993-09-23 2000-04-05 Xerox Corporation Semantic co-occurrence filtering for speech recognition and signal transcription applications

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3944234A1 (en) * 2020-07-24 2022-01-26 Atos Global IT Solutions and Services Private Limited Method for processing a video file comprising audio content and visual content comprising text content

Also Published As

Publication number Publication date
JPH10507554A (en) 1998-07-21
MX9702705A (en) 1997-10-31
EP0786114B1 (en) 1998-08-05
CA2202539C (en) 2004-09-28
EP0786114A1 (en) 1997-07-30
DE69503914D1 (en) 1998-09-10
WO1996012239A1 (en) 1996-04-25
US5835667A (en) 1998-11-10
DE69503914T2 (en) 1999-04-08

Similar Documents

Publication Publication Date Title
CA2202539A1 (en) Method and apparatus for creating a searchable digital video library and a system and method of using such a library
US5729741A (en) System for storage and retrieval of diverse types of information obtained from different media sources which includes video, audio, and text transcriptions
Cieri et al. The TDT-2 text and speech corpus
US7240003B2 (en) Database annotation and retrieval
DE69915455T2 (en) METHOD AND DEVICE FOR DETECTING REQUIRED VIDEO AND AUDIO SCENES BY VOICE RECOGNITION
MX9702675A (en) System and method for skimming digital audio/video data.
EP0109179A1 (en) Apparatus for processing document data including voice data
AU5200198A (en) Method and apparatus for organizing and processing information using a digital computer
MXPA97002675A (en) System and method for examining digital audio / video data
JP2005504395A (en) Multilingual transcription system
EP0565911A3 (en) Data processing system and method for sequentially repairing character recognition errors for scanned images of document forms
Steinmetz et al. Multimedia fundamentals, volume 1: media coding and content processing
AU1243400A (en) Image description system and method
MY115005A (en) Apparatus and method for processing a high definition video signal
EP0325373A3 (en) Method and apparatus for decomposing images
AU6201396A (en) Method and apparatus for providing an interactive guide to events available on an information network
AU6799194A (en) Method and apparatus for synchronizing a stream of picture data with a corresponding stream of audio data
CA2077604A1 (en) Method and apparatus for determining the frequency of words in a document without document image decoding
EP0390048A3 (en) Apparatus and method for data edition
EP0632363A3 (en) Method and apparatus for loosely ganging sliders on a user interface of a data processing system.
WO1999065224A3 (en) Creating animation from a video
AU5381698A (en) Method and apparatus for natural language querying and semantic searching of an information database
GB2279530B (en) An image processing apparatus for and a method of preparing data representing a colour image
WO1998047079A8 (en) A method and apparatus for remotely viewing a printed work
Hauptmann et al. Artificial intelligence techniques in the interface to a digital video library

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed