|Publication number||US6912688 B1|
|Application number||US 08/821,320|
|Publication date||Jun 28, 2005|
|Filing date||Mar 20, 1997|
|Priority date||Mar 27, 1996|
|Also published as||DE69713656D1, DE69713656T2, EP0798917A2, EP0798917A3, EP0798917B1|
|Publication number||08821320, 821320, US 6912688 B1, US 6912688B1, US-B1-6912688, US6912688 B1, US6912688B1|
|Inventors||Yiming Zhou, Mark John McGrath|
|Original Assignee||Sony Corporation, Sony United Kingdom Limited|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (13), Non-Patent Citations (2), Referenced by (9), Classifications (15), Legal Events (5)|
|External Links: USPTO, USPTO Assignment, Espacenet|
1. Field of the Invention
The present invention relates to editing scripts associated with video sequences and to an editing system having provision for editing such scripts
2. Description of the Prior Art
It is known to produce a sequence of video clips by editing source material. The sequence may for example comprise several clips assembled in an order which illustrates a news story. The news story is set out in a script which accompanies the sequence.
The sequence is required to be of a desired duration and the script is required to match the sequence, scenes within the video sequence being matched with sections of the script.
Once a draft sequence has been assembled and a draft script has been written or is being written it is desirable to check it matches the video sequence as intended by the scriptwriter.
In accordance with the invention, there is provided an editing system comprising:
The above and other objects, features and advantages of the invention will be apparent from the following detailed description of illustrative embodiments which is to be read in connection with the accompanying drawings, in which:
system in accordance with the invention;
An Editor or Script Writer selects video clips to be assembled into a video sequence. In the assembled sequence the frames or groups of 2 or more frames of the assembled sequence are identified by a sequence of time codes having the form
Once the video sequence has been assembled it is viewed in a video display section 1 of a display device 2, as shown in
The time code TCx of the video frame corresponding to the beginning of a section of text is entered into that section of the text in the form [HH:MM:SS:FF].
Successive time codes TCx, TCx+1 are entered into the text to indicate the beginnings of respective sections (T1, T2) of the text which are associated with respective sections (V1, V2) of the video sequence.
The number W of words of text which can be fitted into a section of text is a function of the duration of the section as defined by successive time codes (TCx, TCx+1) and the rate n at which the words are to be read
The amount of text which the script writer actually enters may exceed W. Furthermore, the writer may wish to vary the rate n of reading the words.
For that purpose, in accordance with one aspect of the present invention, there is displayed for each section (T1, T2) of text:
For the purposes of illustration, the sub-sections are separated from the active sections in
The number W of words in the active text sub-section is defined by the time codes TCx and TCx+1 at the beginning of the current text section and the next text section respectively and the rate n of reading words.
Any words in excess of W are automatically entered into the overflow text sub-section.
If the number of words in the active sub-section and/or the read rate n is changed, words automatically transfer from the active sub-section to the overflow sub-section or vice versa.
It is desirable to check that the video sequence matches the text either once the text has been written or during writing of the text. Thus, in accordance with another aspect of the present invention:—
The current position in the text is indicated by an indicator such as a cursor or highlighting. When the video sequence controls display of the text, the text position indicator moves through the text synchronously with the video sequence. When the text controls the video sequence, movement of the indicator through the text causes the video sequence to be displayed synchronously with the movement of the text indicator.
The rate of movement through the text relative to the rate of movement through the video sequence is defined by the rate n of reading the text.
If the text section is divided into active and overflow sub-sections, the overflow sub-section is disregarded, the video sequence being controlled only by the active text and the video sequence controls only position in the active text.
Referring again to
A conventional text editor is provided in the PC for editing the text.
The computer PC is linked by an interface 7 to a video editor 8 which includes data storage for edited video sequences. The video editor operates in known manner to produce the video sequences in which the frames or groups of 2 or more frames are allocated the time codes.
The time codes may be entered manually using the keyboard and the text editor. Once the first time code is entered, the next code is entered with a space, eg. one line between them. The time codes are entered in the form.
Dialogue boxes may be provided to enter the time codes.
Alternatively the time codes are displayed with the video sequence. The video sequence is run until it reaches the frame corresponding to the start of a text section. The associated time code is then copied on to the text section, or the time codes are set to be displayed in the text section and the appropriate ones selected. As another alternative, the text and its time codes can be written and stored in a separate file and then imported in to the text editor for the video sequence.
The rate of n of reading words is set at step 32.
Text is entered into the text section beginning at TCx using the text editor and keyboard and if necessary the pointing device. The text editor counts the number W of words entered beginning at TCx.
At step 35 the number of words W of the text is compared with the number of words ΔTC.n which can be fitted into the text section where ΔTC=TCx+1−TCx and n is the rate of reading words.
If W≧ΔTC.n then words in excess of ATC.n are allocated to an inactive text sub-section, as indicated at step 36.
Words are entered until the script writer indicates the end of the section of text TCx. In this example this is done by moving the cursor to the start of the next section TCx+1 of the text.
Then, at step 38, TCx+1 becomes the beginning (denoted TCx) of the new section and the new time code TCX+1 of the new section is entered at step 31.
The time codes of the sections may be changed at any time and new time codes entered into the text at any point. The position of the overflow text is recalculated for each change.
The reading rate n may be changed and consequently the position of the overflow text recalculated.
and the time code TCw of any word W is calculated as
This allows the current position in the text indicated by for example a conventional cursor 10 to be controlled in dependence upon the video frames. This also allows control of the display of the video frame in dependence upon the current text position.
Reference will now be made to FIG. 4. Assume the video sequence and its corresponding text sequence have been accessed by the computer. Assume the video frames control the text display. The computer accesses each successive frame by its time code VCy (40) by generating the time codes VCy one by one to call up the frames. The computer accesses (41) the text section having the nearest time code TCx less than the time code VCy of the video frame. Alternatively, the computer may derive the time codes VCy from the video sequence and access the text from the derived time codes VCy, selecting the text section having the nearest time code TCx less than VCy. The computer calculates the word position W=(VCy−TCx).n and moves the cursor to that position. If the current word position is in the overflow text, the cursor jumps (47) to the next time code TCx+1.
Assume now that the current position of the code in the text controls the video frame to be displayed.
The computer calculates (45) from the time code (41) TCx of the current section, the word count W to the current position in the section 43 and the reading rate n(44), the time code TCw of the current position, TCw=TCx+W/n.
That is also the time code of the corresponding video frame. As indicated at step 46, the computer accesses the corresponding video frame.
Although illustrative embodiments of the invention have been described in detail herein with reference to the accompanying drawings, it is to be understood that the invention is not limited to those precise embodiments, and that various changes and modifications can be effected therein by one skilled in the art without departing from the scope and spirit of the invention as defined by the appended claims.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4858033 *||Mar 18, 1987||Aug 15, 1989||Chippendale Arthur J||Apparatus for pacing, queing and equipment control in audiovisual work|
|US5274758||Dec 28, 1992||Dec 28, 1993||International Business Machines||Computer-based, audio/visual creation and presentation system and method|
|US5404316 *||Aug 3, 1992||Apr 4, 1995||Spectra Group Ltd., Inc.||Desktop digital video processing system|
|US5481296 *||Aug 6, 1993||Jan 2, 1996||International Business Machines Corporation||Apparatus and method for selectively viewing video information|
|US5649060 *||Oct 23, 1995||Jul 15, 1997||International Business Machines Corporation||Automatic indexing and aligning of audio and text using speech recognition|
|US5664087||Feb 13, 1992||Sep 2, 1997||Hitachi, Ltd.||Method and apparatus for defining procedures to be executed synchronously with an image reproduced from a recording medium|
|US5781687 *||May 27, 1993||Jul 14, 1998||Studio Nemo, Inc.||Script-based, real-time, video editor|
|US5782692 *||Mar 22, 1997||Jul 21, 1998||Stelovsky; Jan||Time-segmented multimedia game playing and authoring system|
|US5915256 *||Nov 5, 1997||Jun 22, 1999||Newsweek, Inc.||Multimedia method and apparatus for presenting a story using a bimodal spine|
|US6271892 *||Jun 2, 1994||Aug 7, 2001||Lucent Technologies Inc.||Method and apparatus for compressing a sequence of information-bearing frames having at least two media|
|EP0338753A2||Apr 17, 1989||Oct 25, 1989||Sony Corporation||Method of effecting a television program transmission|
|EP0598597A1||Nov 16, 1993||May 25, 1994||Canon Information Systems, Inc.||Method and apparatus for scripting a text-to-speech-based multimedia presentation|
|JPH04258090A||Title not available|
|1||*||Infrared decoding and vertical sync extraction techniques for automatic home video editing, Wong, E, M, IEEE, p. 903-911.|
|2||S. VIgneaux, "The Integration of a Newsroom Computer System with a Server-centred News Production System", International Broadcasting Convention, Sep. 12-16, 1996, pp. 512-518, XP002113460.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7697068 *||Nov 15, 2001||Apr 13, 2010||Canon Kabushiki Kaisha||Apparatus and method with receiving of broadcast data signal, communicating with external device, and controlling image to be displayed in accordance with communication|
|US7836389 *||Apr 13, 2005||Nov 16, 2010||Avid Technology, Inc.||Editing system for audiovisual works and corresponding text for television news|
|US9137354 *||Oct 9, 2012||Sep 15, 2015||Samsung Electronics Co., Ltd||Portable television (TV) phone and method for controlling operation thereof|
|US9628862||Sep 14, 2015||Apr 18, 2017||Samsung Electronics Co., Ltd||Portable phone and method for providing incoming message notifications during video operations thereof|
|US20020060748 *||Nov 15, 2001||May 23, 2002||Shuntaro Aratani||Method and apparatus for receiving television signal, broadcast data receiving and reproducing apparatus, and broadcast data receiving and reproducing system|
|US20060064641 *||Sep 6, 2005||Mar 23, 2006||Montgomery Joseph P||Low bandwidth television|
|US20070260968 *||Apr 13, 2005||Nov 8, 2007||Howard Johnathon E||Editing system for audiovisual works and corresponding text for television news|
|US20110200305 *||Apr 26, 2011||Aug 18, 2011||Dacreous Co. Limited Liability Company||Low bandwidth television|
|US20130033561 *||Oct 9, 2012||Feb 7, 2013||Samsung Electronics Co., Ltd.||Portable television (tv) phone and method for controlling operation thereof|
|U.S. Classification||715/202, 715/716, G9B/27.012, G9B/27.051|
|International Classification||G11B27/034, H04N5/765, H04N5/78, G11B27/02, G11B27/34, H04N5/781, G11B27/031|
|Cooperative Classification||G11B27/34, G11B27/034|
|European Classification||G11B27/034, G11B27/34|
|Mar 20, 1997||AS||Assignment|
Owner name: SONY CORPORATION, JAPAN
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ZHOU, YIMING;MCGRATH, JOHN;REEL/FRAME:008529/0946
Effective date: 19970228
Owner name: SONY UNITED KINGDOM, LIMITED, ENGLAND
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ZHOU, YIMING;MCGRATH, JOHN;REEL/FRAME:008529/0946
Effective date: 19970228
|Sep 30, 2008||FPAY||Fee payment|
Year of fee payment: 4
|Feb 11, 2013||REMI||Maintenance fee reminder mailed|
|Jun 28, 2013||LAPS||Lapse for failure to pay maintenance fees|
|Aug 20, 2013||FP||Expired due to failure to pay maintenance fee|
Effective date: 20130628