Search Images Maps Play YouTube News Gmail Drive More »
Sign in
Screen reader users: click this link for accessible mode. Accessible mode has the same essential features but works better with your reader.

Patents

  1. Advanced Patent Search
Publication numberUS20020007718 A1
Publication typeApplication
Application numberUS 09/883,442
Publication dateJan 24, 2002
Filing dateJun 18, 2001
Priority dateJun 20, 2000
Also published asCN1383543A, EP1297692A2, WO2001099413A2, WO2001099413A3
Publication number09883442, 883442, US 2002/0007718 A1, US 2002/007718 A1, US 20020007718 A1, US 20020007718A1, US 2002007718 A1, US 2002007718A1, US-A1-20020007718, US-A1-2002007718, US2002/0007718A1, US2002/007718A1, US20020007718 A1, US20020007718A1, US2002007718 A1, US2002007718A1
InventorsIsabelle Corset
Original AssigneeIsabelle Corset
Export CitationBiBTeX, EndNote, RefMan
External Links: USPTO, USPTO Assignment, Espacenet
Karaoke system
US 20020007718 A1
Abstract
The concept of singing karaoke exclusively relies on audio based techniques. The invention consists of developing the concept of video immersion: the user will see his (her) image inserted into the video clip or movie at the place of his (her) favorite dancer, singer or player, and will therefore be able to play clip/song on video tape, and replace any famous star. More precisely, the invention relates to a karaoke system in which are provided successive means for picking up an image of the user and his/her voice, analyzing and processing the obtained signals, mixing the audio/video signals thus analyzed and processed and a pre-recorded material and displaying the combination signals thus obtained.
Images(3)
Previous page
Next page
Claims(1)
1. A karaoke system for singing during a sequence such a video clip or movie and comprising in series a pickup device, for picking up an image and the voice of an user, an analysis and processing device, for separating at least a part of the user from the background, a mixing and rendering device, for combining the ouput signal of said analysis and processing device and a pre-recorded material, and a displaying device, for displaying the combination signal.
Description

[0001] The present invention relates to a karaoke system for singing during a sequence such as a video clip or a movie.

[0002] In a karaoke system such as described for instance in the european patent application EP 0782338, music, lyrics or any kind of audio data are transmitted from a transmission station to a distribution station. Music control means of a main module of the system airs music through a built-in speaker of a monitor and voice from an unshown microphone through said speaker. Image control means display a background image (such as a video image or a still image extracted from background image storage means) on the monitor, and lyrics control means display lyrics by superimposing them upon the background image. An image pickup device such as a CCD camera picks up an image of a singer and superimposes it on the screen of the monitor through video image control means as a superimposed image. Such a system defines what may be called “video mixing” in the concept of karaoke.

[0003] It is an object of the invention to propose another type of karaoke system, equipped with an additional functionality.

[0004] To this end, the system relates to a karaoke system for singing during a sequence such a video clip or movie and comprising in series a pickup device, for picking up an image and the voice of an user, an analysis and processing device, for separating at least a part of the user from the background, a mixing and rendering device, for combining the ouput signal of said analysis and processing device and a pre-recorded material, and a displaying device, for displaying the combination signal.

[0005] Up to now, the concept of singing karaoke was exclusively relying on audio based techniques giving limited functionality and no possibility of real insertion of the user into the video imaginary world. The proposed solution, that introduces the idea of video mixing, allows to extend this karaoke concept to video and, more generally, to develop the concept of a complete audio-video immersion: according to said concept, the voice and the face in the video clip of the song can be replaced by the voice and the face of the fortuitous singer (hereinafter also called user since he/she may be in fact a singer, a player, a dancer, and so on . . . ). The same proposed technique may find similar applications in other contexts, for instance in the field of e-commerce or for video editing of pre-recorded content.

[0006] The present invention will now be described, by way of example, with reference to the accompanying drawing in which:

[0007]FIG. 1 is a block diagram of a karaoke system according to the invention;

[0008]FIG. 2 illustrates another implementation of a karaoke system according to the invention.

[0009] As shown in FIG. 1, the different sub-systems necessary to implement the karaoke system according to the invention are mainly an analysis and processing device 11 and a mixing and rendering device 12.

[0010] The analysis and processing device 11, that receives the image and voice of the user (the person shown in black) picked up by a pickup device 10, consists of a segmentation circuit, provided for separating for instance the face of the user from the background and thus defining an alpha plane (such a circuit can be based for example on the chroma key technique, if the user is put on stage, in front of a blue screen). The mixing and rendering device 12 is a circuit using the shape information analyzed in the device 11 for composing the user with a background pre-recorded video or audio-video delivered by a medium 13 (said pre-recorded material is shown at the left side of the medium). This composition completes the audio one, provided for mixing the voice of said user with the background pre-recorded music from the song. Using the alpha plane defined thanks to the device 11, it is then easy to combine the two sources, according to a relation of the following type: [(video 1×alpha)+(video 2×(255−alpha))]/255= finalvideo. A displaying device 14 such as a monitor is finally used for displaying the final result (i.e. the combination of the pre-recorded material and of what belongs specifically to the user).

[0011] Obviously, for an improved quality, the analysis implemented in the device 11 can produce 8-bit alpha plane, which enables a better mixing on the fronteer of the incrusted object. It may also be noted that the system can replace either only the head of the user or his/her whole body.

[0012] Different cases may be considered, with respect to the type of audio/video sources:

[0013] (a) the two audio/video sources are not compressed: this option may be used for instance in a karaoke restaurant, when the whole body of a singer is incrusted in the clip/movie (the pre-recorded data can be stored on a tape, and the fortuitous singer video can be analyzed and transmitted directly to the video mixer);

[0014] (b) one or the two sources are compressed: one adapted framework for such a case is then the newly developed MPEG-4 standard, that enables to encode the shape and alpha plane of an object—here the face of the fortuitous user—(MPEG-4 has defined a whole system framework enabling the composition of audio and video objects).

[0015] Different cases of application of the invention may also be considered:

[0016] (a) the user may want to record the result of the mixing operation: this is illustrated in FIG. 2 that shows a system similar to the implementation of FIG. 1 but including an additional recording device 25;

[0017] (b) in some cases, the karaoke system will work on line: the pre-recorded clips are then stored on a database (on the Internet for instance), and the user is recording his/her performance at home and wants to produce the combination karaoke clip and put it on his/her homepage (the use of compression techniques is particularly useful in such a case and, more generally, in all the applications that are run in a bandwidth constrained environment);

[0018] (c) in some cases also, the user may want to only put his/her head in place of the original singer's head, which induces further processing in the mixing and rendering device 12, since it is needed that the position of the head of the user and the orientation and posture of the body of the original singer match up.

Referenced by
Citing PatentFiling datePublication dateApplicantTitle
US7053915 *Jul 16, 2003May 30, 2006Advanced Interfaces, IncMethod and system for enhancing virtual stage experience
US7517219 *Feb 20, 2004Apr 14, 2009Mcdonald MichaelMethod of providing specialized dance videos
US7528890Apr 30, 2004May 5, 2009Yoostar Entertainment Group, Inc.Interactive system and method for video compositing
US7646434Jun 11, 2009Jan 12, 2010Yoostar Entertainment Group, Inc.Video compositing systems for providing interactive entertainment
US7649571Jun 11, 2009Jan 19, 2010Yoostar Entertainment Group, Inc.Methods for interactive video compositing
US7734070 *Dec 16, 2003Jun 8, 2010Rajeev SharmaMethod and system for immersing face images into a video sequence
US7826644Apr 12, 2010Nov 2, 2010Rajeev SharmaMethod and system for immersing face images into a video sequence
US8139126Oct 21, 2010Mar 20, 2012Eastman Kodak CompanyDigital video system for assembling video sequences
US8172638 *Jul 27, 2006May 8, 2012Parental Media LLCMethod and apparatus for education and entertainment
US8824861Jun 30, 2009Sep 2, 2014Yoostar Entertainment Group, Inc.Interactive systems and methods for video compositing
US20070046774 *Jul 27, 2006Mar 1, 2007Luis SilvaMethod and apparatus for education and entertainment
US20110285878 *May 24, 2010Nov 24, 2011Yunshu ZhangMethod for generating multimedia data to be displayed on display apparatus and associated multimedia player
US20140026164 *Sep 24, 2013Jan 23, 2014Steven SchragaCustomized program insertion system
WO2004100535A1Apr 30, 2004Nov 18, 2004Allan Robert StakerInteractive system and method for video compositing
WO2005096621A2 *Mar 4, 2005Oct 13, 2005Eastman Kodak CoDigital video system for assembling video sequences
Classifications
U.S. Classification84/609, 348/E05.058
International ClassificationH04N5/272, H04N7/18, G10K15/04, G10H1/36, H04N5/262
Cooperative ClassificationG10H2220/011, G10H1/368, H04N5/272, G10H2220/455
European ClassificationG10H1/36K7, H04N5/272
Legal Events
DateCodeEventDescription
Sep 4, 2001ASAssignment
Owner name: KONINKLIJKE PHILIPS ELECTRONICS N.V., NETHERLANDS
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CORSET, ISABELLE;REEL/FRAME:012140/0240
Effective date: 20010710