CA2278376A1 - Method and apparatus for adaptive synchronization of digital video and audio playback in a multimedia playback system - Google Patents

Method and apparatus for adaptive synchronization of digital video and audio playback in a multimedia playback system Download PDF

Info

Publication number
CA2278376A1
CA2278376A1 CA002278376A CA2278376A CA2278376A1 CA 2278376 A1 CA2278376 A1 CA 2278376A1 CA 002278376 A CA002278376 A CA 002278376A CA 2278376 A CA2278376 A CA 2278376A CA 2278376 A1 CA2278376 A1 CA 2278376A1
Authority
CA
Canada
Prior art keywords
decoding
video
video frames
playback
backlogged
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002278376A
Other languages
French (fr)
Other versions
CA2278376C (en
Inventor
Yan Huang
Raymond K. Jones
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia of America Corp
Original Assignee
Lucent Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lucent Technologies Inc filed Critical Lucent Technologies Inc
Publication of CA2278376A1 publication Critical patent/CA2278376A1/en
Application granted granted Critical
Publication of CA2278376C publication Critical patent/CA2278376C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets

Abstract

Synchronization among digital video and digital audio signals is maintained in a multimedia player with limited or highly varying processing power. In an exemplary embodiment of the invention, a processor with stored program memory controls the decoding and playback of audio blocks and video frames, each stream independently stored in an order of intended playback time.
The processor gives priority to the decoding and playback of audio blocks, and periodically determines whether a backlog of encoded video frames exists.
Under video backlog conditions, the processor reduces the backlog by decoding only those backlogged video frames that must be decoded in order to decode and play the frame in the sequence of backlogged video frames with the latest intended playback time. After decoding this latest backlogged frame, the processor directs it to be played. Normal video decoding and playback then resumes for video frames following this latest backlogged video frame in sequence and in intended playback time.
CA002278376A 1998-08-31 1999-07-22 Method and apparatus for adaptive synchronization of digital video and audio playback in a multimedia playback system Expired - Fee Related CA2278376C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/144,161 1998-08-31
US09/144,161 US6016166A (en) 1998-08-31 1998-08-31 Method and apparatus for adaptive synchronization of digital video and audio playback in a multimedia playback system

Publications (2)

Publication Number Publication Date
CA2278376A1 true CA2278376A1 (en) 2000-02-29
CA2278376C CA2278376C (en) 2002-06-18

Family

ID=22507352

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002278376A Expired - Fee Related CA2278376C (en) 1998-08-31 1999-07-22 Method and apparatus for adaptive synchronization of digital video and audio playback in a multimedia playback system

Country Status (4)

Country Link
US (1) US6016166A (en)
EP (1) EP0987904B1 (en)
JP (1) JP3739609B2 (en)
CA (1) CA2278376C (en)

Families Citing this family (83)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6304895B1 (en) * 1997-08-22 2001-10-16 Apex Inc. Method and system for intelligently controlling a remotely located computer
US6205140B1 (en) * 1997-12-01 2001-03-20 Intel Corporation Communication of dynamic dependencies along media streams
US6374336B1 (en) 1997-12-24 2002-04-16 Avid Technology, Inc. Computer system and process for transferring multiple high bandwidth streams of data between multiple storage units and multiple applications in a scalable and reliable manner
US6415373B1 (en) * 1997-12-24 2002-07-02 Avid Technology, Inc. Computer system and process for transferring multiple high bandwidth streams of data between multiple storage units and multiple applications in a scalable and reliable manner
US6081299A (en) * 1998-02-20 2000-06-27 International Business Machines Corporation Methods and systems for encoding real time multimedia data
US6769130B1 (en) 2000-01-20 2004-07-27 Interactual Technologies, Inc. System, method and article of manufacture for late synchronization during the execution of a multimedia event on a plurality of client computers
US7188193B1 (en) 2000-01-20 2007-03-06 Sonic Solutions, A California Corporation System, method and article of manufacture for a synchronizer component in a multimedia synchronization framework
US7178106B2 (en) 1999-04-21 2007-02-13 Sonic Solutions, A California Corporation Presentation of media content from multiple media sources
US6529949B1 (en) 2000-02-07 2003-03-04 Interactual Technologies, Inc. System, method and article of manufacture for remote unlocking of local content located on a client device
US6453420B1 (en) 1999-04-21 2002-09-17 Research Investment Network, Inc. System, method and article of manufacture for authorizing the use of electronic content utilizing a laser-centric medium
US7448021B1 (en) 2000-07-24 2008-11-04 Sonic Solutions, A California Corporation Software engine for combining video or audio content with programmatic content
US6941383B1 (en) * 2000-01-20 2005-09-06 Interactual Technologies, Inc. System, method and article of manufacture for java/javascript component in a multimedia synchronization framework
US6405203B1 (en) * 1999-04-21 2002-06-11 Research Investment Network, Inc. Method and program product for preventing unauthorized users from using the content of an electronic storage medium
US7346920B2 (en) * 2000-07-07 2008-03-18 Sonic Solutions, A California Corporation System, method and article of manufacture for a common cross platform framework for development of DVD-Video content integrated with ROM content
US6665489B2 (en) 1999-04-21 2003-12-16 Research Investment Network, Inc. System, method and article of manufacturing for authorizing the use of electronic content utilizing a laser-centric medium and a network server
US6480902B1 (en) * 1999-05-25 2002-11-12 Institute For Information Industry Intermedia synchronization system for communicating multimedia data in a computer network
US6957220B2 (en) 2000-11-07 2005-10-18 Research Investment Networks, Inc. System, method and article of manufacture for tracking and supporting the distribution of content electronically
US7120162B1 (en) * 2000-08-03 2006-10-10 Skyworks Solutions, Inc. System and method for processing audio and video data in a wireless handset
EP1312206A1 (en) * 2000-08-16 2003-05-21 Koninklijke Philips Electronics N.V. Method of playing multimedia applications
WO2002015591A1 (en) * 2000-08-16 2002-02-21 Koninklijke Philips Electronics N.V. Method of playing multimedia data
US7689510B2 (en) 2000-09-07 2010-03-30 Sonic Solutions Methods and system for use in network management of content
US7779097B2 (en) 2000-09-07 2010-08-17 Sonic Solutions Methods and systems for use in network management of content
FR2814027B1 (en) * 2000-09-14 2003-01-31 Cit Alcatel METHOD FOR SYNCHRONIZING A MULTIMEDIA FILE
JP4208398B2 (en) * 2000-10-05 2009-01-14 株式会社東芝 Moving picture decoding / reproducing apparatus, moving picture decoding / reproducing method, and multimedia information receiving apparatus
US7191442B2 (en) 2000-10-30 2007-03-13 Research Investment Network, Inc. BCA writer serialization management
US7447791B2 (en) * 2000-12-15 2008-11-04 British Telecommunications Public Limited Company Transmission and reception of audio and/or video material
US8166093B2 (en) * 2001-02-08 2012-04-24 Warner Music Group, Inc. Method and apparatus for processing multimedia programs for play on incompatible devices
US7030930B2 (en) * 2001-03-06 2006-04-18 Ati Technologies, Inc. System for digitized audio stream synchronization and method thereof
TW499818B (en) * 2001-03-29 2002-08-21 Winbond Electronics Corp Audio/video packet synchronous decoding method
US7360149B2 (en) 2001-04-19 2008-04-15 International Business Machines Corporation Displaying text of video in browsers on a frame by frame basis
US6639649B2 (en) * 2001-08-06 2003-10-28 Eastman Kodak Company Synchronization of music and images in a camera with audio capabilities
US7133362B2 (en) * 2001-11-14 2006-11-07 Microsoft Corporation Intelligent buffering process for network conference video
US7212247B2 (en) * 2002-01-31 2007-05-01 Thomson Licensing Audio/video system providing variable delay
US8558795B2 (en) * 2004-03-12 2013-10-15 Riip, Inc. Switchless KVM network with wireless technology
US7684483B2 (en) * 2002-08-29 2010-03-23 Raritan Americas, Inc. Method and apparatus for digitizing and compressing remote video signals
US7818480B2 (en) * 2002-08-29 2010-10-19 Raritan Americas, Inc. Wireless management of remote devices
US8068546B2 (en) * 2002-08-29 2011-11-29 Riip, Inc. Method and apparatus for transmitting video signals
US7606314B2 (en) * 2002-08-29 2009-10-20 Raritan America, Inc. Method and apparatus for caching, compressing and transmitting video signals
US7660512B2 (en) * 2003-10-16 2010-02-09 Microsoft Corporation Systems and methods for managing frame rates during multimedia playback
US7853663B2 (en) * 2004-03-12 2010-12-14 Riip, Inc. Wireless management system for control of remote devices
EP1805983A4 (en) * 2004-05-14 2007-11-28 J Carl Cooper Method, system, and program product for eliminating error contribution from production switchers with internal dves
US20060209210A1 (en) * 2005-03-18 2006-09-21 Ati Technologies Inc. Automatic audio and video synchronization
US7996699B2 (en) 2005-04-11 2011-08-09 Graphics Properties Holdings, Inc. System and method for synchronizing multiple media devices
US8478884B2 (en) 2005-09-30 2013-07-02 Riip, Inc. Wireless remote device management utilizing mesh topology
US7555715B2 (en) * 2005-10-25 2009-06-30 Sonic Solutions Methods and systems for use in maintaining media data quality upon conversion to a different data format
US20070107024A1 (en) * 2005-11-10 2007-05-10 Scientific-Atlanta, Inc. Atomic channel changes in a switched digital video system
US20070106782A1 (en) * 2005-11-10 2007-05-10 Scientific-Atlanta, Inc. Bandwidth management in each network device in a switched digital video environment
US8099756B2 (en) * 2005-11-10 2012-01-17 Versteeg William C Channel changes between services with differing bandwidth in a switched digital video system
US7742407B2 (en) * 2005-11-10 2010-06-22 Scientific-Atlanta, Llc Quality of service management in a switched digital video environment
US7873760B2 (en) * 2005-11-11 2011-01-18 Versteeg William C Expedited digital signal decoding
US20070230898A1 (en) * 2006-03-31 2007-10-04 Masstech Group Inc. Random access searching with frame accuracy and without indexing within windows media video
DE602006020188D1 (en) * 2006-05-08 2011-03-31 Thomson Licensing METHOD FOR RECEIVING CONTENT PLAYBACK OVER FACILITIES BY MEANS OF BOOKMARKS.
US20080022320A1 (en) * 2006-06-30 2008-01-24 Scientific-Atlanta, Inc. Systems and Methods of Synchronizing Media Streams
US7774672B2 (en) * 2006-07-07 2010-08-10 Scientific-Atlanta, Llc Requesting additional forward error correction
US7899046B2 (en) * 2006-07-07 2011-03-01 Ver Steeg William C Determining strategy for multicast and/or unicast transmission to correct forward errors
US7877660B2 (en) * 2006-07-07 2011-01-25 Ver Steeg William C Transmitting additional forward error correction (FEC) upon request
US7725797B2 (en) * 2006-07-07 2010-05-25 Scientific-Atlanta, Llc Buffer for storing data and forward error correction (FEC)
TWI314017B (en) * 2006-07-12 2009-08-21 Quanta Comp Inc System and method for synchronizing video frames and audio frames
JP5049652B2 (en) * 2006-09-07 2012-10-17 キヤノン株式会社 Communication system, data reproduction control method, controller, controller control method, adapter, adapter control method, and program
US7870465B2 (en) * 2006-10-18 2011-01-11 Versteeg William C Reducing channel-change time
TWI338508B (en) * 2006-12-20 2011-03-01 Ind Tech Res Inst Method and apparatus for audio/video synchronization
US7788395B2 (en) * 2007-02-14 2010-08-31 Microsoft Corporation Adaptive media playback
US20080244667A1 (en) * 2007-03-27 2008-10-02 Osborne Jason C Bandwidth sensitive switched digital video content delivery
US8370889B2 (en) * 2007-03-28 2013-02-05 Kanthimathi Gayatri Sukumar Switched digital video client reverse channel traffic reduction
US8832766B2 (en) * 2007-07-27 2014-09-09 William C. Versteeg Systems and methods of differentiated channel change behavior
US8776160B2 (en) * 2007-07-27 2014-07-08 William C. Versteeg Systems and methods of differentiated requests for network access
JP4983923B2 (en) * 2007-08-27 2012-07-25 富士通株式会社 Decoder device and decoding method
EP2043372B1 (en) * 2007-09-26 2019-07-17 Vodafone GmbH Method for audio and video synchronization, receiving and transmitting device
US8190760B2 (en) * 2008-01-15 2012-05-29 Echostar Advanced Technologies L.L.C. System and method of managing multiple video players
US9832442B2 (en) 2008-01-15 2017-11-28 Echostar Technologies Llc System and method of managing multiple video players executing on multiple devices
US8490195B1 (en) * 2008-12-19 2013-07-16 Symantec Corporation Method and apparatus for behavioral detection of malware in a computer system
CA2684678A1 (en) * 2009-11-03 2011-05-03 Research In Motion Limited System and method for dynamic post-processing on a mobile device
CN102215429B (en) * 2010-04-01 2013-04-17 安凯(广州)微电子技术有限公司 Recording method for mobile TV
CN102959544B (en) * 2010-05-04 2016-06-08 沙扎姆娱乐有限公司 For the method and system of synchronized multimedia
US8483286B2 (en) 2010-10-27 2013-07-09 Cyberlink Corp. Batch processing of media content
US9043800B2 (en) * 2011-05-26 2015-05-26 Adobe Systems Incorporated Video player instance prioritization
US9015555B2 (en) 2011-11-18 2015-04-21 Cisco Technology, Inc. System and method for multicast error recovery using sampled feedback
CN102821308B (en) * 2012-06-04 2014-11-05 西安交通大学 Multi-scene streaming media courseware recording and direct-broadcasting method
US20140149606A1 (en) * 2012-11-23 2014-05-29 Samsung Electronics Co., Ltd. Server, multimedia apparatus and control method thereof for synchronously playing multimedia contents through a plurality of multimedia devices
CN103024517A (en) * 2012-12-17 2013-04-03 四川九洲电器集团有限责任公司 Method for synchronously playing streaming media audios and videos based on parallel processing
CN104935996A (en) * 2015-06-09 2015-09-23 深圳康荣电子有限公司 Synchronous display method of spliced wall
CN109660805B (en) * 2017-10-10 2020-07-31 武汉斗鱼网络科技有限公司 Audio and video synchronous optimization method, storage medium, equipment and system in decoding and playing
CN107911729A (en) * 2017-10-23 2018-04-13 广州市百果园网络科技有限公司 Internet video playback method and terminal

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU672070B2 (en) * 1993-02-26 1996-09-19 Sony Corporation Synchronization of audio/video information
US5351092A (en) * 1993-07-23 1994-09-27 The Grass Valley Group, Inc. Synchronization of digital audio with digital video
EP0644692B2 (en) * 1993-09-16 2003-10-01 Kabushiki Kaisha Toshiba Video signal compression/decompression device for video disk recording/reproducing apparatus
US5430485A (en) * 1993-09-30 1995-07-04 Thomson Consumer Electronics, Inc. Audio/video synchronization in a digital transmission system
US5815634A (en) * 1994-09-30 1998-09-29 Cirrus Logic, Inc. Stream synchronization method and apparatus for MPEG playback system
US5594660A (en) * 1994-09-30 1997-01-14 Cirrus Logic, Inc. Programmable audio-video synchronization method and apparatus for multimedia systems
US5598352A (en) * 1994-09-30 1997-01-28 Cirrus Logic, Inc. Method and apparatus for audio and video synchronizing in MPEG playback systems
JPH09205618A (en) * 1996-01-29 1997-08-05 Mitsubishi Electric Corp Dynamic image sound expansion reproduction device and dynamic image sound synchronization controller
US5824997A (en) * 1996-08-05 1998-10-20 Fastrax Industries, Inc. Railroad track switch heater

Also Published As

Publication number Publication date
EP0987904B1 (en) 2015-03-25
JP3739609B2 (en) 2006-01-25
US6016166A (en) 2000-01-18
JP2000115772A (en) 2000-04-21
EP0987904A3 (en) 2001-05-02
EP0987904A2 (en) 2000-03-22
CA2278376C (en) 2002-06-18

Similar Documents

Publication Publication Date Title
CA2278376A1 (en) Method and apparatus for adaptive synchronization of digital video and audio playback in a multimedia playback system
EP0866461A3 (en) Video data decoding and video signal reproduction
CA2237690A1 (en) Method and apparatus for implementing playback features for compressed video data
CA2181863A1 (en) Apparatus and method for encoding and decoding digital video data
AU2613800A (en) Digital video decoding, buffering and frame-rate converting method and apparatus
EP0668700A3 (en) Audio/video decoding system.
MXPA01004843A (en) Method and device for decoding a video data stream in special reproduction modes.
TW357299B (en) Audio-visual decoding apparatus and audio-visual encoding apparatus and data transmission system
AU4722697A (en) Video encoder, video decoder, video encoding method, video decoding method and video encoding and decoding system
CA2234078A1 (en) Method of and apparatus for coding audio signals
EP0782332A3 (en) Digital signal processing
WO2001030063A3 (en) Data stream decoder and method
PL2209319T3 (en) Video encoder
ZA200204170B (en) Apparatus and method for decoding digital image and audio signals.
CA2172011A1 (en) Subtitle encoding/decoding method and apparatus
GB2333414B (en) Video decoding method video decoder and digital TV system using the video decoding method and video decoder
MXPA04008425A (en) Audio data deletion and silencing during trick mode replay.
EP1487200A4 (en) Signal processing apparatus and signal processing method
EP1122955A4 (en) Method and device for seamless-decoding video stream including streams having different frame rates
MXPA04008426A (en) Gated silence removal during video trick modes.
KR100891065B1 (en) Modifying video by inserting shadow intra pictures
AU2728400A (en) Digital video decoding, buffering and frame-rate converting method and apparatus
JP2002290384A (en) Active/standby changeover device for digital broadcast program transmission system
CA2451997A1 (en) Modifying video signals by converting non-intra pictures
EP0737959A4 (en) Coded data decoding device and video/audio multiplexed data decoding device using it

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed
MKLA Lapsed

Effective date: 20090722