|Publication number||US20060064645 A1|
|Application number||US 11/192,979|
|Publication date||Mar 23, 2006|
|Filing date||Jul 29, 2005|
|Priority date||Mar 8, 2000|
|Also published as||CA2402418A1, EP1264479A2, US6948131, WO2001067759A2, WO2001067759A3|
|Publication number||11192979, 192979, US 2006/0064645 A1, US 2006/064645 A1, US 20060064645 A1, US 20060064645A1, US 2006064645 A1, US 2006064645A1, US-A1-20060064645, US-A1-2006064645, US2006/0064645A1, US2006/064645A1, US20060064645 A1, US20060064645A1, US2006064645 A1, US2006064645A1|
|Inventors||Hartmut Neven, Orang Dialameh, Charles Blanchard|
|Original Assignee||Vidiator Enterprises Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Referenced by (49), Classifications (13)|
|External Links: USPTO, USPTO Assignment, Espacenet|
The present invention relates to multimedia communications, and more particularly, to a rich media communication system based on user combinations of computer graphics, video, still images, audio, and text.
Communication formats have evolved from text to interactive audio-visual communications. Recent virtual reality models generally involve the creation of a shared-space world in which the persons involved in the experience each represent a character in the shared-space world. The user representations, often referred to as avatars, in general consist of video representations or of graphic representations that are animated by a mouse or keyboard. Such virtual reality models often have been limited to real-time interactive communications. Such scenarios and representations limit the creativity and expression available using rich media communication formats.
Accordingly, there exists a need for a system and related tools for providing rich media communications. The present invention satisfies these needs.
The present invention is directed to a system, and related method, having tools for generating and presenting rich media communications. The tools allow improved and lower cost rich media communications.
The invention may be embodied in a rich media communication system having a theater and a player. The theater includes a representation associated with a person. The representation provides a choice of visual presence for the person. The player presents the theater at a remote location.
An alternative embodiment is a rich media theater controller having a theater window and a presentation control. The theater window has a background presentation scene. The presentation control selects a character for a presentation in the theater. The character presentation may be selected from an avatar, a blue screen cutout of the character, or a plain video presentation.
The theater window may have a media target onto which the person may direct media, such as a video stream or audio, for display or play. The visual representation may be an avatar representation that is driven by visual sensing of the person. A rich media messaging directory service or an online directory may be used for locating other users capable of communicating with rich media presentations. The rich media communication system may include a status window indicating rich media communications received, the user's visibility to other users, the user's availability to other users, and the user's automatic response to rich media communication messages from other users. The rich media communication users may enter into user defined communities organized in hierarchical levels. Also, a theater window may be published to a rich media website.
The rich media communication system may include a message center having a message reader. The message reader may have a text message window and a rich media presentation window. The rich media window may be toggled off such that a user may first read only a text message in the text message window before requesting transmission of a rich media message for presentation in the presentation window.
In another embodiment, the rich media communication system includes a server infrastructure, a content client, and a plurality of communication clients. The server infrastructure provides web hosting, message hosting and communication services. The content client has an authoring tool for generating a rich media communication. The plurality of communicator clients display the rich media communication at remote locations using the server infrastructure.
Other features and advantages of the present invention should be apparent from the following description of the preferred embodiments taken in conjunction with the accompanying drawings, which illustrate, by way of example, the principles of the invention.
The rich media communication system of the present invention provides a user with a three-dimensional (3D) communication space or theater having rich media functions. The user may be represented in the theater as a segmented video image or as an avatar. The user is also able to communicate by presenting images, videos, audio files, or text within the theater. The system may include tools for allowing lowered cost of animation, improved collaboration between users, presentation of episodic content, web casts, newscasts, infotainment, advertising, music clips, video conferencing, customer support, distance learning, advertising, social spaces, and interactive game shows and content.
The communication system may use existing Internet protocols, communication channels and bandwidth reducing techniques to allow rich media communications over limited bandwidth channels. For example, a theater may be created which has an individualized space with media targets and an image or representation of the user. The theater space is transmitted to a receiver only once. The user representation may be represented by an avatar animated using low-bandwidth control signals, or alternatively, by a bandwidth reducing video cutout.
The rich media communication system of the invention allows each person to create his own world in which he is presented to others. The person's individual creativity may provide enhanced entertainment and attention retaining value to the communications space.
The rich media communication system of the present invention may be embodied in an application window for a communicator shown in
Under the file menu 16, a previously saved session file or environment may be opened 22, the current session may be saved 24, or the program quit 26. Under the edit menu 18 are context sensitive cut, copy, and paste. Also, an option exists for editing user preferences. Under the window menu 20 are options to open the variety of child window tools. As discussed in more detail below, the tools may include a player 28, a controller 30, a chat module 32, a monitor 34, a status window 36, an editor 38, a message center 40, directories 42, a card editor 44, an address book 46, preferences 48, a block list 50, a message reader 52, and a message composer 54. Through the window menu option, a communication tool may be invoked and an associated window pops up on the background. As shown in
The controller window 30 is shown in
In the center of the controller 30 is a display region 62 that provides a working area for constructing a rich media communication session. The controller may provide a visual representation of a user using four buttons, 64, 66, 68 and 70, that gives the user media control of the user's appearance. The buttons are radio buttons that immediately switch between available visual modes. The modes include an avatar mode, a video mode, a cutout mode, or a show nothing mode. If a mode is not available in particular theater, the associated button is grayed out.
The controller window 30 may be organized as a theater that provides a stage on which a representation 72 of the user may be displayed and provides media targets, 74 and 76, on which selected media from a file manager (
The controller 30 also includes control buttons for controlling the media in the targets. The particular media target is selected by clicking on the target and its properties may be controlled using the control buttons. If no immediate target is currently selected, the media controls are grayed out.
The controller 30 includes a camera button 86 which, when toggled, brings up a camera control user interface overlaid on top of the window. The controller may also include a loudspeaker button 88 that controls the volume of the audio coming from the user's microphone. The controller also includes a behavior button 90 which, when invoked, pops up a pop-up menu of all the available behaviors for a currently displayed avatar. The user may then select one of the behaviors for the avatar. The pop-up menu also shows any hot keys associated with particular behaviors. The controller also includes mutually exclusive radio buttons, 92 and 94, for move/select. When the select button is selected, a mouse click on an object causes the media controls to be directed to that target. When the move button is selected, a mouse click on an object brings up a move interface on top of the object. Also, object translation and rotation may be performed using mouse clicks and or drags.
The controller 30 includes a recorder for savings of a user's session. The recorder includes buttons, 96, 98 and 100, for saving the recorded session as a file, making a message out of the recorded session, or making a web page out of the recorded session. The controller also includes a directory button 102, an address book button 104, and a friend's button 106.
The monitor window 34 (
The player window 28 is shown in
The file manager includes three buttons, 120, 122 and 124, for toggling the file manager between the theater file manager 126, the avatar file manager 128, and the media file manager 130. The theater file manager 126, shown in
The message center window 40 is for handling rich media communication messages. The messages may be either just text, text with attached rich media, or only rich media. The inbox 132 of the message center is shown in
The message list 148 is a columnar table of all the messages that the user has received. Using a mouse to click on any of the column headings sorts the message list by that heading. Double clicking the mouse on the subject of the message opens that message in a new message reader window. If a rich media attachment is included in the message, an icon will be displayed in a media icon column. Rich media sessions which have been included as an attachment and which have been downloaded will appear as an icon in a file column. Rich media sessions which have not been downloaded may be marked for downloading in a download column. A triangle icon 150 associated with the words “download manager” is provided in the message center window 40. When the download manager triangle icon is selected, associated buttons are provided for allowing the user to control downloading of rich media to a local hard disk. A “get attachment” button 152 allows the user to download rich media associated with the currently selected message. A “get marked attachment” 154 button allows a user to download rich media in marked messages. A “get all attachments” button 156 allows the user to download any rich media which has not been downloaded. A stop button 158 allows user to halt the download process. A downloading message indicator 160 may show how much more of a rich media component is left for downloading both as a visual indicator and as a percentage. The current download speed also may be indicated.
By selecting an outbox button 136 of the message center, as shown in
The message reader window 50 is a two-part window that allows a user to play messages. When the reader is selected or a message is selected for playing, the first top portion 174 of the reader indicates whom the message is from, the subject of the message, and associated message text. The size of the rich media component for downloading is also shown in the message window. The user may toggle the second half 176 of the reader window, which allows the user to display the rich media portion of the message. When the rich media portion 176 is selected, the media player opens in the bottom portion of the window and the rich media starts streaming and playing in the media player window. A download indicator 178 shows the progress of the rich media download.
An editor window 38, shown in
An avatar editor window allows a user to generate an avatar that looks and appears similar to the user. A wizard allows the user to select a head geometry that is similar to the head geometry of the user. A new avatar is generated based on an image of the user. Alternatively an existing avatar may be edited to the satisfaction or the user. The avatar may be animated or driven by wavelet-based facial motion capture as described in U.S. patent application Ser. No. 09/188,079 (WO 99/53443 A1), which is incorporated herein by reference.
The avatar window includes a wizard that leads the user through a sequence of steps for allowing the user to improve the accuracy of tracking of the avatar tracker. The avatar wizard may include a tutor face that prompts the user to make a number of expressions and varying head poses. A position is taken for each image and facial features are automatically located for each face image. The user has the opportunity to manually correct the positions of the automatically located features.
The status window 36, shown in
A user card editor window 38 is shown in
An address book or card manager 46 is shown in
A directory 42 associated with the rich media communication system is shown in
The hierarchal levels of the directory may be cities, neighborhoods, houses, and rooms. Cities and neighborhoods may be put in place by server staff. Houses and rooms may be built by users. Each hierarchal level has an information button. When activated, a rich media message plays describing the location. To build a house, a user clicks on a house builder button next to a neighborhood, and to build a room, a user clicks on a builder button next to a house. Rooms in houses may have bulletin boards upon which users may leave or read messages. Entering a room is similar to entering a conventional chat room. Each live member of the room or house appears as a thumbnail with his theater next to his name.
A block diagram of an embodiment of a rich media communication system 210 of the invention is shown in
The server includes a web server 232, message hosting 234, and communication services 236. The server also includes resource information and parameters for each user allowing other users to engage in direct communication with a user based on the parameters stored on the server.
Clients of other users may include a personal communicator 218 having only a player window or may include the authoring tools described above. A client side personal communicator 218 is shown in more detail in
A flow diagram of the rich media communications data or bit stream is shown in
Although the foregoing discloses the preferred embodiments of the present invention, it is understood that those skilled in the art may make various changes to the preferred embodiments without departing form the scope of the invention. The invention is defined only by the following claims.
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7313760||Dec 19, 2002||Dec 25, 2007||Microsoft Corporation||Contact picker|
|US7360172 *||Dec 19, 2002||Apr 15, 2008||Microsoft Corporation||Contact controls|
|US7360174||Dec 19, 2002||Apr 15, 2008||Microsoft Corporation||Contact user interface|
|US7386799||Apr 8, 2003||Jun 10, 2008||Forterra Systems, Inc.||Cinematic techniques in avatar-centric communication during a multi-user online simulation|
|US7418663||May 13, 2004||Aug 26, 2008||Microsoft Corporation||Contact picker interface|
|US7430719||Jul 7, 2004||Sep 30, 2008||Microsoft Corporation||Contact text box|
|US7468729||Dec 21, 2004||Dec 23, 2008||Aol Llc, A Delaware Limited Liability Company||Using an avatar to generate user profile information|
|US7484176||Dec 30, 2003||Jan 27, 2009||Aol Llc, A Delaware Limited Liability Company||Reactive avatars|
|US7636755||Dec 30, 2003||Dec 22, 2009||Aol Llc||Multiple avatar personalities|
|US7779004||Feb 22, 2006||Aug 17, 2010||Qurio Holdings, Inc.||Methods, systems, and products for characterizing target systems|
|US7802191||Aug 20, 2008||Sep 21, 2010||Microsoft Corporation||Contact picker interface|
|US7814438||Jun 8, 2007||Oct 12, 2010||Microsoft Corporation||Contact page|
|US7818321 *||Nov 21, 2006||Oct 19, 2010||Kiran Venkatesh Hegde||Method and system for generating and providing rich media presentations optimized for a device over a network|
|US7840903||Jun 8, 2007||Nov 23, 2010||Qurio Holdings, Inc.||Group content representations|
|US7849420||Feb 26, 2007||Dec 7, 2010||Qurio Holdings, Inc.||Interactive content representations enabling content sharing|
|US7908554||Dec 29, 2004||Mar 15, 2011||Aol Inc.||Modifying avatar behavior based on user action or mood|
|US7913176||Dec 21, 2004||Mar 22, 2011||Aol Inc.||Applying access controls to communications with avatars|
|US7953759||Feb 17, 2004||May 31, 2011||Microsoft Corporation||Simplifying application access to schematized contact data|
|US8046672||Feb 25, 2002||Oct 25, 2011||Dandia Audio Kg Limited Liability Company||Method and system for delivering technology agnostic rich media content within an email, banner ad, and web page|
|US8060824 *||Jan 4, 2008||Nov 15, 2011||Starz Entertainment Llc||User interface for a multimedia service|
|US8073870 *||Sep 25, 2008||Dec 6, 2011||Air Products And Chemicals, Inc.||Methods for storing data|
|US8122004||Oct 26, 2009||Feb 21, 2012||Dandia Audio Kg Limited Liability Company||Generating and providing rich media presentations optimized for a device over a network|
|US8260266||Jun 26, 2007||Sep 4, 2012||Qurio Holdings, Inc.||Method and system for third-party discovery of proximity-based services|
|US8261307||Oct 25, 2007||Sep 4, 2012||Qurio Holdings, Inc.||Wireless multimedia content brokerage service for real time selective content provisioning|
|US8458601||Dec 4, 2008||Jun 4, 2013||International Business Machines Corporation||System and method for item inquiry and information presentation via standard communication paths|
|US8527649||Mar 6, 2011||Sep 3, 2013||Mobixell Networks Ltd.||Multi-stream bit rate adaptation|
|US8600808||Jun 7, 2007||Dec 3, 2013||Qurio Holdings, Inc.||Methods and systems of presenting advertisements in consumer-defined environments|
|US8688074||Feb 26, 2012||Apr 1, 2014||Moisixell Networks Ltd.||Service classification of web traffic|
|US8689254 *||Jul 17, 2007||Apr 1, 2014||Apple Inc.||Techniques and graphical user interfaces for preview of media items|
|US8695044||Aug 31, 2012||Apr 8, 2014||Qurio Holdings, Inc.||Wireless multimedia content brokerage service for real time selective content provisioning|
|US8699479 *||Aug 18, 2008||Apr 15, 2014||Sk Telecom Co., Ltd.||Server, system and method that providing additional contents|
|US8832709||Jul 18, 2011||Sep 9, 2014||Flash Networks Ltd.||Network optimization|
|US8850331||Mar 1, 2013||Sep 30, 2014||International Business Machines Corporation||System and method for item inquiry and information presentation via standard communication paths|
|US9075901 *||Dec 15, 2008||Jul 7, 2015||International Business Machines Corporation||System and method to visualize activities through the use of avatars|
|US9098167||Feb 26, 2007||Aug 4, 2015||Qurio Holdings, Inc.||Layered visualization of content representations|
|US9111285||Aug 27, 2007||Aug 18, 2015||Qurio Holdings, Inc.||System and method for representing content, user presence and interaction within virtual world advertising environments|
|US20040119732 *||Dec 19, 2002||Jun 24, 2004||Grossman Joel K.||Contact picker|
|US20040119758 *||Dec 19, 2002||Jun 24, 2004||Grossman Joel K.||Contact controls|
|US20040122822 *||Dec 19, 2002||Jun 24, 2004||Thompson J. Patrick||Contact schema|
|US20040179037 *||Dec 30, 2003||Sep 16, 2004||Blattner Patrick D.||Using avatars to communicate context out-of-band|
|US20040179038 *||Dec 30, 2003||Sep 16, 2004||Blattner Patrick D.||Reactive avatars|
|US20040221224 *||Dec 30, 2003||Nov 4, 2004||Blattner Patrick D.||Multiple avatar personalities|
|US20040228531 *||May 14, 2003||Nov 18, 2004||Microsoft Corporation||Instant messaging user interfaces|
|US20050182741 *||Feb 17, 2004||Aug 18, 2005||Microsoft Corporation||Simplifying application access to schematized contact data|
|US20080066102 *||Jul 17, 2007||Mar 13, 2008||Tammy Tova Abraham||Techniques and Graphical User Interfaces for Review of Media Items|
|US20100153869 *||Dec 15, 2008||Jun 17, 2010||International Business Machines Corporation||System and method to visualize activities through the use of avatars|
|US20100278170 *||Aug 18, 2008||Nov 4, 2010||Sk Telecom Co., Ltd.||Server, system and method that providing additional contents|
|US20110167337 *||Jan 4, 2011||Jul 7, 2011||Joseph Paley||Auto-Trimming of Media Files|
|US20120096371 *||Apr 19, 2012||Be In, Inc.||System and method for online interactive recording studio|
|U.S. Classification||715/753, 715/716, 348/E07.083, 715/758, 715/751|
|International Classification||H04N7/15, G06T17/40, G06F3/00|
|Cooperative Classification||H04N7/157, H04N7/15, H04L12/1813|
|European Classification||H04N7/15, H04L12/18D|