WO2002037798A1

WO2002037798A1 - Terminal-based link adaptation scheme

Info

Publication number: WO2002037798A1
Application number: PCT/US2001/042972
Authority: WO
Inventors: Khiem Le
Original assignee: Nokia Corporation
Priority date: 2000-11-06
Filing date: 2001-11-06
Publication date: 2002-05-10
Also published as: AU2002224481A1

Abstract

Apparatus, and associated method, converts real-time multimedia information generated pursuant to an RTP protocol into a form amenable for transmission upon a radio channel, such as a radio channel defined in a cellular communication system. When converted, the informational content of the multimedia information is transmitted in a manner that achieves spectral efficiency and low, constant delay. Once transmitted over the radio channel, the multimedia information is converted back into form corresponding to the RTP protocol before being sent to the receiving station.

Description

TERMINAL-BASED LINK ADAPTATION SCHEME

BACKGROUND ART

The present invention relates generally to the communication of multimedia information, such as multimedia information formatted pursuant to the Real-Time Transport Protocol (RTP). More particularly, the present invention relates to apparatus, and an associated method, for converting real-time multimedia information, formatted in packet data form, such as that formatted pursuant to the RTP, into a form to facilitate transmission of the information on a radio channel. Operation of an embodiment of the present invention permits the communication of multimedia information by way of a cellular, or other radio communication system, with m-tnimal time delay while also communicating the information in a spectrally-efficient manner.

Advancements in communication technologies have permitted the introduction of, and popularization of, new types of, and improvements in existing, communication systems. Increasingly large amounts of data are permitted to be communicated at increasing thruput rates through the use of such new, or improved, communication systems. As a result of such improvements, new types of communications, requiring high data thruput rates, are possible. Digital communication techniques, for instance, are increasingly utilized in communication systems to efficiently communicate digital data, and the use of such techniques has facilitated the increased data thruput rates.

Multimedia communications, for instance, are exemplary of new types of communications permitted as a result of the improvements in communications technologies. Multimedia communications refer, generally, to the communication of more than one type of data between a sending station and a receiving station. Typically, the communication of such more than one type of data appears, to a user, to be simultaneous. Multimedia communications include, for instance, voice-over-data applications. Audio signals overlaid upon video signals used to effectuate teleconferencing is an example of a multimedia communication application. Two-way white board communication is exemplary of another multimedia communication application. The different types of data exhibit different communication requirements. For instance, voice data must be communicated in real-time. That is to say, voice data must be communicated without significant delay and must be communicated in a manner which permits its reconstruction at a receiving station in a manner which introduces minimal time distortion. Otherwise, the voice data shall appear to be noticeably distorted. Conversely, non-voice data is not as time-sensitive. However, more stringent accuracy requirements are associated with non-voice data.

Multimedia communications can be effectuated utilizing packet data communication techniques. With the popularization of the Internet and communication thereon, standardized, multimedia protocols have been set forth by which to communicate multimedia information in a form amenable to its transmission by way of the Internet. An example of multimedia protocol is H.323. H.323 is a widely used ITU standard which uses RTP.

According to the H.323 protocol, when multimedia data is to be transmitted by a sending station, logical channels upon which to transmit the data are assigned. The data channels are allocated responsive to requests made by the sending station. Separate logical channels are requested for separate types of data. For instance, a first logical channel is requested upon which to transmit voice data, and allocation of a second logical channel is requested for transmission of non-voice data. A subset of the H.323 protocol, referred to as the H.245 protocol, defines the manner in which the channels are requested. Packets of data are thereafter transmitted upon the logical channels. In conventional manner, the individual packets include header information, such as IP, UDP and RTP information, to identify to where the packet is to be directed and to provide a time stamp with the packet. The information of a packet of data, referred to as the payload, is appended to the header information.

The H.323 protocol was intended originally for wireline communications, such as between communication stations, connected by wireline connections including those of the Internet. But, advancements in communication technologies have also permitted the widespread usage of radio communication systems. A cellular communication system is exemplary of a wireless communication system which has achieved wide levels of popularity and usage. Telephonic communication by way of a cellular communication system mimics communication by way of a conventional wireline, telephonic system. However, because a radio-link is utilized in a cellular, or other radio, communication system, bandwidth considerations are generally more significant than when wireline networks are utilized for communications. That is to say, the radio-link upon which communication is communicated in a radio communication system is of a limited bandwidth capacity. And, by reducing the bandwidth requirements of information communicated thereon, the information capacity of the radio-link can be increased. So, efforts are made to minimize the bandwidth requirements of signals transmitted over the radio-link.

Information communicated pursuant to an H.323 protocol is predicated upon a packet-data configuration. The header information required of each packet of data is relatively bandwidth-consumptive. As a result, communication of multimedia information by way of a radio-link, such as that formed in the operation of a cellular communication system, is a relatively inefficient manner by which to communicate multimedia information. However, because the RTP-based protocol has become a defacto standard by which to format multimedia information, multimedia stations shall likely continue to be operable pursuant to such protocol irrespective of the bandwidth inefficiency of communication of packet data by way of the radio-link.

If a manner could be provided by which more efficiently to communicate multimedia information by way of a radio-link, while still utilizing the RTP-based protocol at the sending and receiving stations, improved multimedia communications by way of a radio communication system could result. It is in light of this background information related to multimedia communications that the significant improvements of the present invention have evolved. DISCLOSURE OF INVENTION The present invention, accordingly, advantageously provides apparatus, and an associated method, for converting real-time multimedia information formatted in packet-data form, into a form to facilitate transmission of the information on, for example, a radio channel. Through such conversion, the multimedia information can be transmitted with minimal time delay while also being transmitted in a spectrally efficient manner.

In one aspect of the present invention, real-time media, which is part of multimedia information, is communicated between sending and receiving multimedia stations. On the communications path between the sending and receiving stations there is a communications link, which could, for example, be a radio link, or any other such link having bandwidth limitations and spectrum efficiency requirements. In what follows, that link shall, at times, be referred to as the communications link. The multimedia information, when generated at a sending multimedia station, and when provided to a receiving multimedia station, is formatted in packet-data form according to an existing RTP protocol. Before transmission on the communications link, real-time media is converted into a communications-link format. Once converted into the con-tm-mications-link format, the real-time media can be transmitted upon the communications-link in an efficient manner. Once received, the real-time media is converted out of the communications-link format and back into the packet-data format before being sent to the receiving station. The same process takes place in the reverse direction.

The communications-link could, for example, include a special channel upon which the real-time media is transmitted. However, the invention is not limited to such an embodiment. The special channel is defined as a channel that provides a constant bit rate. In a CDMA (code-division, multiple-access) communication system, the channel can be realized by a unique code by which the information to be communicated is encoded. In a TDMA (time-division, multiple-access) communication system, the channel can be realized by a time slot-frequency combination. Other ways to realize a special channel are possible. A typical example of communications link is a radio link.

Consider the example of a cellular multimedia station communicating with a wireline multimedia station. At the cellular station, the outgoing multimedia information is converted into a radio-link format. Once converted into the radio-link format, the multimedia information can be transmitted upon the radio-link in an efficient manner. Once received, the multimedia information is converted out of the radio-link format and back into the packet data format before being sent to the wireline station. The reverse process takes place in the reverse direction.

In one implementation, the multimedia stations include multimedia terminals. The multimedia terminals are operable to generate, and to receive, multimedia information formatted pursuant to a multimedia protocol such as H.323. Multimedia information is communicated between the multimedia terminals by way of a radio communication system, such as a cellular communication system.

Operation of an embodiment of the present invention converts the packet data-formatted information into a form to permit its efficient transmission upon a channel defined in the cellular communication system. The multimedia protocol provides for two components, a control plane and a user plane. The control plane includes an application signalling protocol, such as H.245 for H.323. The application signalling protocol specifies logical channels to be opened for the communication of the different types of multimedia information. Operation of an embodiment of the present invention monitors the application signalling and detects the opening and closing of logical channels defined in the control plane. Messaging to open a real-time media channel is translated into messaging to set up a special channel upon which to communicate multimedia information between the multimedia stations. Monitoring continues, and when the application signalling indicates that the logical channels are to be closed, the corresponding special channel is also closed.

As the multimedia protocol such as H.323 is increasingly being used in Internet Protocol (IP)-based communication systems to effectuate multimedia communications, operation of an embodiment of the present invention advantageously permits multimedia devices, operable pursuant to the protocol, to operate without alteration. Apparatus of an embodiment of the present monitors signals generated by such existing multimedia devices, and utilizes such signals to convert the multimedia information into a form more amenable for transmission upon a circuit-switched, or other, radio channel. Overhead data, such as IP, RTP and UDP headers associated with each packet of data, is removed prior to transmission of the multimedia information upon the special channel. Subsequent to transmission upon the special channel, multimedia information is reconverted back into packet-data format, and the header information is affixed again to the packets of data. Because the header information, otherwise forming a portion of each packet of data, is removed prior to transmission of the payload data, the same information is not repeatedly transmitted on the special channel. Improved spectrum efficiency results. hi these and other aspects, therefore, apparatus, and an associated method, is provided for converting packet-formatted multimedia information into a radio-link format. Once converted into the radio-link format, the multimedia information is amenable for transmission upon a radio-link extending between a first communication station and a second communication station of a radio communication system. A detector is coupled to receive indications of the packet-formatted data. The detector detects control plane information associated with the packet-formatted data. A requester is coupled to receive indications of detection by the detector of the control plane information. The requester requests allocation of a special channel defined by the radio-link extending between the first and second communication stations, respectively, for communication of the multimedia information thereon. A format converter is coupled to receive the packet-formatted data of which ,the multimedia information is formed. Responsive to allocation of the special channel requested by the requester, the format converter converts the packet-formatted data into the radio-link format. Thereafter, transmission of the multimedia information, formatted in the radio-link format, is permitted upon the special channel. A more complete appreciation of the present invention and the scope thereof can be obtained from the accompanying drawings which are briefly summarized below, the following detailed description of the presently preferred embodiments of the invention, and the appended claims.

BRIEF DESCRIPTION OF THE DRAWINGS The present invention will be more apparent from the following detailed description, when taken in conjunction with the accompanying drawings, in which:

Fig. 1 illustrates a functional block diagram of a radio communication system operable pursuant to an embodiment of the present invention to communicate multimedia information;

Fig. 2 illustrates a functional block diagram of the control plane of the radio communication system shown in Figure 1 constructed according to an embodiment of the present invention;

Fig. 3 illustrates a functional block diagram of the user plane of the radio communication system shown in Fig. 1 according to an embodiment of the present invention;

Fig. 4 illustrates a functional block diagram, similar to that shown in Fig. 2, but according to another embodiment of the present invention;

Fig. 5 illustrates a functional block diagram similar to that shown in Fig. 3, but according to another embodiment of the present invention;

Fig. 6 illustrates the format of multimedia information generated during operation of an embodiment of the present invention;

Fig. 7 illustrates a functional block diagram of a portion of a radio communication system, here to illustrate operation of an embodiment of the present invention during hand-off procedures;

Fig. 8 illustrates a functional block diagram of a further embodiment of the present invention. Fig. 9 illustrates a method flow diagram listing the method steps of the method of operation of an embodiment of the present invention;

Fig. 10 illustrates a functional block diagram of the user plane, similar to that shown in Figures 3 and 5, but according to another embodiment of the present invention;

Fig. 11 illustrates a functional block diagram of a portion of the radio communication system illustrating a non-integrated mobile station according to the present invention; and

Fig. 12 illustrates a functional block diagram of a portion of the radio communication system illustrating an integrated mobile station according to the present invention.

BEST MODE FOR CARRYING OUT THE. INVENTION Turning first to Figure 1, a radio communication system, shown generally at 10, is operable to communicate multimedia information between multimedia stations. In the Figure, exemplary multimedia stations 12 and 14 are shown. In the exemplary implementation, the radio communication system 10 comprises a cellular communication system, such as a CDMA or TDMA communication system. In other implementations, the radio communication system is formed of other types of radio communication systems.

Multimedia information is communicated between the multimedia station 12 and the infrastructure by way of forward and reverse link channels, here represented by the arrows 16 and 18. In an implementation in which the radio communication system is formed of a CDMA cellular communication system, the forward and reverse link channels are defined by unique codes by which signals are encoded prior to tlieir transmission. And, when the radio communication system comprises a TDMA, cellular communication system, the forward and reverse channels are defined by time slot-frequency combinations. In other implementations, the channels are defined in other manners. The multimedia station 12 is here shown to include a multimedia device 22 and a mobile station 24. It should be understood, of course, that the embodiment shown in the figure is exemplary. In other implementations, the mobile multimedia station is constructed in other manners. The multimedia device 22 is operable to generate and receive real-time multimedia information pursuant to a packet data format such as the RTP protocol. In what follows, multimedia information generated by the multimedia device 22 will at times be referred to as mobile originated (MO), while multimedia information received by 22 will at times be referred to as mobile terminated (MT). In conventional manner, MO multimedia information is formatted into packets of data at the multimedia device 22. In one implementation, the packet-formatted data is converted, at the multimedia device, into a form more amenable to its transmission upon the reverse radio-link. The form will at times be referred to as radio-link format.

The mobile station 24 here forms a cellular radio telephone operable in a cellular communication system and is capable of transceiving signals on the forward and reverse link channels 16 and 18. The mobile station 24 is here shown to be coupled to the multimedia device 22 by way of lines 26. MO multimedia information is provided to the mobile station 24 therethrough. As noted above, in one implementation, the MO packet-formatted multimedia information is converted into a radio-link format at the multimedia device 22. In another implementation, such conversion is performed at the mobile station 24. MT multimedia information transmitted upon a forward link channel and received at the mobile station 24 is analogously also convertible out of a radio-link format and into packet-data format, either at the mobile station 24, or at the multimedia device 22, depending upon the manner in which the present invention is implemented.

The multimedia station 14 is here shown to be a fixed multimedia station, coupled to access network infrastructure 34 of a cellular communication system. Analogous to the multimedia station 12, the multimedia station 14 is operable to generate and receive the multimedia information formatted pursuant to a packet data format such as the RTP protocol. MT multimedia information is generated by 14 in packet data format. In one implementation, the access network infrastructure 34 is further operable to convert the packet data-formatted information into a radio-link format to facilitate efficient transmission of the MT multimedia information upon the forward radio-link to the multimedia station 12. MO multimedia information, received in radio link format, is converted by the access network infrastructure into packet data format.

The cellular system network infrastructure 34 is coupled to receive the multimedia information formed by the multimedia station 14 here by way of the lines 36. While not separately shown, the multimedia station 14 is coupled to the infrastructure 34 by way of an IP network. The infrastructure can also include elements based on GPRS (General Packet Radio Service). And, also while not separately shown, the infrastructure 34 includes, base station controllers, and base transceiver stations. The infrastructure 34 is operable to transceive signals on the forward and reverse channels, here represented by the arrows 16 and 18.

Associated with the user plane is the control plane. While the user plane relates to the packet data formatted multimedia information described above, the control plane relates to the protocols used for example to establish and tp4K down the multimedia call, as well as the logical channels carrying the individual media within the call. For example, the user plane of H.323 is based on RTP, while the control plane includes various application signaling link format by 24 and protocols, especially H.245. The conversion to a radio 34 of the MO and MT real-time multimedia information respectively, is predicated on the knowledge that the media is real-time. The knowledge is acquired by a detection function which monitors the application signaling exchanged in the control plane. The detection function can be located in 24. Since 24 does not alter the application signaling exchanged between 22 and 14, the control plane protocols of 22 can be conventional in nature. Furthermore, because operation of an embodiment of the present invention converts packet data-formatted information into a radio-link format prior to its transmission and thereafter reconverts the information in the radio-link format back to a packet-data format, the multimedia device 22 can be of conventional construction in the user plane as well. That is to say, the multimedia device 22 can be of conventional construction to generate multimedia information pursuant to a standard multimedia protocol such as H.323. And, because of the conversion of the information into a radio-link format, the multimedia information can be transmitted in a spectrally efficient fashion upon a radio-link, such as that defined in a cellular communication system.

Fig. 2 illustrates the logical layers of the control plane of the radio communication system 10 shown in Figure I according to an embodiment of the present invention. The embodiment illustrated in Fig. 2 is that of a non-integrated configuration. That is to say, the embodiment shown in Figure 2 is that of an implementation in which the upper logical layers of the control plane are conventional in nature, such as the upper level layers of a laptop computer, or the like, which is operable pursuant to a multimedia protocol using RTP, such as H.323, in conventional manner, without alteration. In the illustration of Fig. 2, the stations 12 and 14 and the access network infrastructure are pictured in terms of application layers. Operation of the embodiment of the present invention shown in the figure adapts the multimedia protocol so that real-time media can be carried over a special air interface channel in a manner better to meet the delay and spectrum efficiency requirements of a radio communication system.

The forward and reverse channels 16 and 18 are commonly designated in the Figure. When the cellular communication system comprises a CDMA cellular communication system, such as that described in the IS-95 standard promulgated by the EIA/TIA, dedicated codes are used by which to encode the information prior to its transmission- And, in a TDMA cellular communication system, such as that defined in the IS-136 standard promulgated by the EIA/TIA, dedicated time slot-frequency combinations define the channels.

Here, the multimedia station 12 is shown to include an application signaling layer 48. The application signaling layer is defined pursuant to the multimedia protocol. For example, H.245 is the application signaling corresponding to the H.323 multimedia protocol. The layer 48 is operable, amongst other things, to request logical channels upon which to communicate different types of multimedia information. For instance, a request is made to open a logical channel to communicate voice data, or to communicate non-voice data, etc. Subsequent to communication of the data, a request is made to close the logical channel.

Signaling generated by the layer 48 is provided to a TCP layer 50 which is operable to form TCP data segments. The TCP layer runs on an IP layer 52 which is operable to format the data segments according to the IP protocols to add, e.g., headers and trailer thereto.

Formatted data generated by the layer 52 is detected by an adaptation layer 54. The adaptation layer 54 is here shown to perform, amongst other things, detection of the signaling generated by the upper layers. Here the function of the adaptation layer 54 to detect the data is represented by a detector 56. Responsive to detection of data generated by the layer 52, the adaptation layer 54 translates such signaling into a request to set up a special channel upon the radio-link extending between the stations 12 and the access network infrastructure. Such function performed by the adaptation layer 54 is represented in the Figure by a requester 58. ^λ

The access network infrastructure 34 is here shown also to include lower layers 68 which correspond to the lower application layers 66 of the multimedia station 12.

The access network infrastructure 34 further includes additional lower layers 76 to carry the application signaling. The lower layers 76 permits formation of a link by way of an IP backbone 78 with lower layers 82 of the station 14. The access network infrastructure is further shown to include a real-time manager 84.

Analogous to the layers 48, 50, and 52 of the station 12, the station 14 includes an application signaling layer 88, a TCP layer 90, and an IP layer 92. The application signaling layer 88 is defined pursuant to the multimedia protocol and is operable, amongst other things, to request logical channels upon which to communication different types of multimedia information. The TCP layer 90 is operable to form, and to receive, TCP data segments. And, the IP layer 92 is operable to format data segments, and to strip formatted data segments, in conventional manner. In such manner, both the stations 12 and 14 are formed of, in part, regular multimedia protocol over IP devices. That is to say, IP packet-formatted information, formatted pursuant to a multimedia protocol can be received, and generated thereat.

In exemplary operation in which the station 12 initiates communications, a request to set up a special channel is generated and provided, by way of the various layers 12, the radio links 16-18, the various layers of the access network infrastructure, and provided to and processed at the real-time manager 84 of the access network infrastructure. Setting up of the special channel includes setting up the channel on the radio link as well as converter functions (described below) in a user plane (also described below). After successful processing, a special channel is available to carry real-time media. The requester exchanges signaling with the real-time manager 84 over the ρ4tlls labelled (4) and (4') in Figure 2. In addition, H.245 (H.323 application signaling) exchanged between the station 12 and a remote end point, here the station 14, is relayed by the access network infrastructure the paths labelled (2) and (2') in the figure.

Fig. 3 again illustrates the radio communication system 10 shown in Figs. 1-2, again showing multimedia stations 12 and 14 and access network infrastructure 34. Fig. 3 illustrates the user plane of a non-integrated configuration, analogous to the control plane layers of the non-integrated configuration shown in Fig. 2.

Here, the station 12 includes a real-time media layer 102 which runs on top of a RTP layer 104. The RTP layer is operable, amongst other things, to add a time stamp to data segments generated by the real-time media layer 102. The time stamp specifies the time when the associated real-time media sample was generated. The time stamp is used by the receiving end to correct any delay fluctuation introduced by the IP backbone network. The RTP layer also adds a sequence number to each packet. The sequence number is used by the receiving end to detect packet loss and/or mis-sequencing and take the appropriate corrective action. The RTP header also includes other information, such as the Synchronization Source (SSRC). All packets coming from a SSRC are part of the same timing and sequence number space.

The RTP layer 104 runs on top of a UDP layer 106 which is operable to format data segments applied thereto. The UDP layer 106 runs upon an IP layer 108. The IP layer 108 corresponds to the IP layer 52 shown in Fig. 2. The IP layer runs upon the adaptation layer 54 which here is operable to perform converting functions, represented by the converter 112. Again, the adaptation layer runs upon lower layers, here again represented by lower layers 66.

A special channel 114 formed during operation of an embodiment of the present invention interconnects the station 12 with the access network infrastructure 34. As shown, the special channel interconnects the lower layers 66 of the station 12 with corresponding lower layers 68 of the access network infrastructure. The infrastructure 34 is here shown to include an access network infrastructure converter 1 1 6 which runs upon the lower layers 68. The converter 116 is also shown to run upon lower layers 76, which also were shown previously in Figure 2. The lower layers 76 are connected by way of the IP backbone 78 with the corresponding lower layers 82 of the station 14.

The station 14 is here shown to include layers 122, 124, 126 and 128 which correspond with the corresponding layers 102, 104, 106, and 108, respectively, of the multimedia station 12.

During operation of the radio communication system, when in the user plane, packetized real-time media generated by the multimedia station 12 is processed by the converter 112. The converter 112 removes the RTP, UDP, and IP headers attached to the media generated by the medial 102 at the layers 104, 106, and 108, respectively. Once removed, the resultant media is provided to the lower layers 66.

The lower layers 66 are operable to perform conventional lower layer functions. For example, if real-time media is speech, lower layers may perform convolutional coding, interleaving, etc. They may also perform multiplexing with other types of traffic and media. As a result of processing by the converter, real-time media is transmitted in a spectrally efficient manner upon a radio link formed of the special channel 114. At the access network infrastructure, lower layers 68 perform the inverse operations. Thereafter, the converter 116 regenerates the RTP, UDP and IP headers. As the values of the UDP and IP fields do not change during a call, their values need only to be sent to the access network infrastructure at the special channel set up time and at time of handoff to another converter.

As the values of the RTP fields change, the ANI (Access Network Infrastructure) converter 116 must be able to derive the correct time stamps and sequence numbers of the RTP field. In one implementation, in which a circuit switched mode is used for the special channel, real-time media is received by the converter 116 in an extremely predictable manner. Therefore, the converter 116 is able to derive the running values of the RTP time stamp and sequence numbers merely by maintaining a local clock that increments monotonically and linearly in time.

For real-time media originating at the station 14, the converter 116 removes the RTP, UDP, and IP headers and generates a real-time media stream with the timing defined by the time stamps and sequence numbers received from the station 14. The result is transmitted upon the special channel 114. The converter 112 regenerates the RTP, UDP and IP headers based upon the same principle of a local clock.

Thereby, the mobile multimedia station 12, together with the ANI converter 116, appears to the multimedia station 14 merely to be another conventional multimedia station. In spite of such appearance to the multimedia station 14, operation of an embodiment of the present invention converts such packet data-formatted information into a radio-link format to facilitate its transmission in a spectrally efficient manner upon a radio-link. Once the radio-link-formatted information is received at the converter, the packet data-format of the information is regenerated.

Fig. 4 again illustrates the communication system 10, shown Fig. 1, here again showing multimedia stations 12 and 14 and previously in the access network infrastructure 34. Here, the logical layers of the control plane operation are illustrated in which the logical layers are formed in an integrated configuration according to an embodiment of the present invention. In this implementation, modifications are made to various of the logical layers to facilitate efficient communication of the multimedia between the stations 12 and 14.

In this implementation, the station 12 is shown to include an application signaling layer 148 which runs directly upon an adaptation layer 152 and also directly upon a TCP layer 154. Analogous to the adaptation layer 54 shown in the embodiment of Figs. 2-3, the adaptation layer performs requesting functions, represented by the requester 156. The requester 156 performs functions analogous to the requester 58 shown in Fig. 2. In this implementation, the adaptation layer 152 need not perform detection functions.

The TCP layer 154 runs upon an IP layer 158.

The radio link formed of the radio channels 16 and 18 are again pictured as a single line 16-18 in the Figure. The access network infrastructure 34 is logically identical to that shown in the embodiment of Fig. 2. Here, the network infrastructure is shown to include lower layers 168, corresponding to the lower layers 68 shown in Figure 2, and lower layers 176 corresponding to the lower layers 76 shown in Figure 2. The lower layers 176 are coupled by way of an IP backbone 178 . with lower layers 182 of the multimedia station 14. And, the network infrastructure 34 is again shown to include a real-time manager 184, corresponding to the real-time manager 84 shown in Fig. 2.

The multimedia station 14 is here shown include an application signaling layer 188 which runs upon a TCP layer 190 which, in turn, runs upon an IP layer 192. The layers 188, 190 and 192, form the functions of the layers 148, 154 and 158, respectively, of the multimedia station 12.

Fig. 5 illustrates the user plane logical layers of the communication system 10 of the integrated configuration. Here, again, the communication system includes a multimedia station 12 and a multimedia station 14 together with an access network infrastructure 34. Once a call is established responsive to operation of the control plane functions, multimedia information is communicated between the multimedia stations 12 and 14 by way of the user plane. The multimedia station 12 is here shown to include two logical layers, real-time media layer 202 and lower layers 166. A special channel 214 is formed to extend between the station 12 and the access network infrastructure 34. In the user plane, the access network infrastructure shown in Fig. 5 corresponds identically with the access network infrastructure logical layers shown in Figure 3, here including lower layers 168 and access network infrastructure (ANI) converter 272, and lower layers 176.

The lower layers 176 are coupled by way of an IP backbone 178 with lower layers 182 of the multimedia station 14. The station 14 is further shown to include a real-time media layer 222, an RTP layer 224, a UDP layer 226, and an IP layer 228. Such layers correspond to the layers 122-128, respectively, of the multimedia station 14 shown in the embodiment of Fig. 3.

In the non-integrated configuration shown in the embodiments of Figs. 2-3, a conventional multimedia protocol stack was included in the multimedia station. That is, the behaviour of the multimedia protocol such as H.323, in the non-integrated configuration is not aware of the existence of an adaptation layer. The integrated configuration shown in the embodiment of Figs. 4-5 permits improved optimization and sfreamlining by integrating the multimedia protocol stack with the adaptation layer. The stack is integrated with the adaptation layer in both the control plane and user plane of Figs. 4 and 5, respectively.

In the control plane shown in Figure 4, the application signaling layer 148 makes a determination that a special channel is required for the communication of real-time media. Responsive to such determination, a request is forwarded to the requester 156 of the application layer 152. Thereby, need for a detector of the embodiment shown in Fig. 2 is obviated. Additionally, the adaptation layer 152 interfaces directly to the application, above the TCP and IP layers 154 and 158. In contrast, in the non-integrated configuration shown in Figure 2, the TCP and IP layers are formed able the adaptation layer. Also, in the user plane shown in Figure 5, real-time media generated at the station 12 is sent directly to the special channel 214, thereby bypassing RTP, UDP and IP layers required in the non-integrated configuration shown in Fig. 3, also eliminating the requirement of a converter 112 of such non-integrated embodiment.

Fig. 6 illustrates exemplary signal formats formed during operation of the multimedia stations 12 and 14 shown in the embodiments of Figs. 2-3 and 4-5. An exemplary packet 288 of multimedia information is shown to be generated for transmission to the multimedia station 14. The packet is formed of a header portion 292 here including an IP section, a UDP section, and an RTP section. Appended to the header portion is a data payload 296, such as voice data.

During operation of the embodiment of the present invention shown in Figs.2-3, the adaptation layer 54 is operable, amongst other things, to convert the packet-formatted data, of which the packet 288 is exemplary, into a form amenable for transmission upon a special channel, that is, a circuit-switched channel or the like, of the radio communication system. Once converted, the data payload 296 is transmitted upon the special channel, as indicated in the center section of the figure. Once received at the access network infrastructure 34, the data is reconverted into packet form as the packet 298. As illustrated, the packet 298 corresponds to the packet 288.

Fig. 7 also represents the radio communication system 10 of the embodiment shown in Figures 2, 3, 4 and 5. Here, the network infrastructure is shown to include two access network infrastructures 302 and 304 positioned, for example, to be associated with separate, spaced-apart base stations of a cellular communication network. The Figure is illustrative of the ability, through operation of an embodiment of the present invention, to communicate multimedia information between two mobile multimedia stations 12.

The multimedia stations 12 are operable in control and user planes analogous to that described with respect to Figs. 2-5 above. And, two access network infrastructures 34 are shown in the figure, each operable relative to the stations 12 in manners described with respect to Figs. 2-5 above. The separate access network infrastructures are coupled together by way of an IP backbone 78.

Fig. 8 illustrates a communication system 10 of a further embodiment of the present invention. In this implementation, multi-media information is communicated between two sources and sinks, here sources/sinks 312 and 313 of multi-media information. While, in the exemplary implementation, portions of the communication links are formed between the source/sinks 312 and 313 are formed of special channels formed of radio links 314-316, in other implementations, the communication link is formed in other manners, such as by way of wireline connections.

For purposes of defining operation of an embodiment of the present invention, the communication path formed between the sources/sinks of multi-media information 312 and 313 include IP networks 318, 322, and 324. In conventional manner, multimedia data is communicated through such IP networks by formatting the data in discrete packets, such as with the RTP, UDP, and IP headers and formatting information, as described above.

Communication system 10 is here shown to include a plurality of adaptors 328 which are operable to adapt the packet data, formatted in the formatted form into a spectrally-efficient form for communication upon the communication links 314-316 and to convert the media, once transmitted in the spectrally-efficient form into packetized form for communication over a respective IP network 318, 322, or 324.

The communication system 10 provides for 2-way communication of the multi-media information between the sources/sinks 312 and 313. Each of the adaptors 328, therefore, include an upstream adaptor portion 332 and a downstream adaptor portion 334. The upstream adaptor is defined as the device located on the same side of the radio link as the multimedia source, while the downstream adaptor is located on the same side of the radio link as the multimedia sink. The upstream adaptor portions of each of the adaptors are operable to detect when real-time multi-media is to be communicated upon a communication link and to request the allocation of a special channel upon the communication link to effectuate the communication of the real-time multi-media information thereto. Such operation is analogous to the operation of the adaptation layer 54 described previously with respect to operation of the embodiment shown in Figure 2. And, the upstream adaptor portions 332 are further operable to convert the packet-formatted multi-media information into spectrally efficient form for transmission upon the special channel, once assigned. Such operation of the upstream adaptor is analogous to the operation of the adaptation layer 54 shown in the embodiment of Fig. 3. That is to say, the upstream adaptor removes the RTP, UDP and IP headers.

The downstream adaptor portions 334 of each of the adaptors 328 are operable to detect reception of the multi-media information transmitted in the spectrally-efficient form upon a special channel upon a communication link and to convert such communication into packet-data form, all as described with respect to the operation of portions of the access network infrastructure shown in Figs. 2-3. The downstream adaptor is operable to regenerate IP, UDP and RTP headers. The values of the UDP and IP fields do not change during a call, so their values need to be sent by the upstream adaptor across the communications link (e.g., radio link) to the downstream adaptor only when the detector detects a real-time media logical channel setup. The downstream adaptor then memorizes these values. For the RTP field, the downstream adaptor must be able to derive the correct current time stamps and sequence numbers. If the special channel is such that real-time media is received by the downstream adaptor in a predictable manner, i.e., at a constant rate, the downstream adaptor is able to derive the raining values of the RTP time stamp and sequence numbers just by maintaining a local clock that increments monotonically and linearly in time.. The initial time stamp value and sampling rate can be sent by the upstream adaptor when the detector derives the values from monitoring the application signaling. If the sampling rate were to subsequently change, the upstream adaptor detects it from the application signaling and updates the downstream adaptor with the new sampling rate value. j-n operation of the exemplary implementation shown in Fig. 8, multi-media infoπnation sourced at the multi-media information source 312 is formatted into packets of data thereat and then communicated upon the IP network 318 and delivered to the upstream adaptor portion 332 of the adaptor 328 connected to the IP network 318. The upstream adaptor portion 332 requests allocation of a special channel upon the communication link 314-316, and the portion 332 converts the packets of data into spectrally-efficient form for communication upon the special channel. A downstream adaptor portion 334 of the adaptor 329 coupled to the IP network 322 reformats the multi-media information received thereat to permit its communication through the IP network 322 to an upstream adaptor portion 332 of the adaptor 330 coupled to the IP network 322. Such upstream adaptor portion requests a special channel upon a subsequent communication link 314-316 and converts the packetized data into spectrally-efficient form for communication thereon. Adaptor 331 connected to the IP network 324 includes a downstream adaptor portion 334 operable to reconvert the information into packetized form for communication through the IP network 324, thereafter to be delivered at the multi-media source 313. Multi-media information sourced at the source 313 is communicated to the multi-media source 312 in analogous but reverse manner. It should further be noted that any number of adaptor-communication link chains can be concatenated together, as necessary to interconnect multi-media sending and receiving stations.

Fig. 9 illustrates a method shown generally at 412, of an embodiment of the present invention. The method communicates multimedia information between a first communication station and a second communication station of a radio communication system. First, and as indicated by the block 414, the multimedia information is provided in packet-data form to the first communication station. Then, and as indicated by the block 416, control plane information associated with the multimedia information is detected.

Then, as indicated by the.block 418, allocation of a special channel defined upon a radio-link between the first communication station and the second communication station is requested. Then, and as indicated by the block 422, the multimedia information is converted into a radio-link format, amenable for transmission upon the special channel. And, as indicated by the block 424, the multimedia information is transmitted upon the special channel to the second communication station. Thereby, through of operation of an embodiment of the present invention, a manner is provided by which to efficiently transmit multimedia information, generated pursuant to a multimedia protocol using RTP such as H.232 upon a radio-link, such as that formed in a cellular communication system. The multimedia information is converted into a form amenable for transmission upon the radio-link in a spectrally-efficient manner.

A fixed multimedia station sends and receives multimedia information in packet data format, in accordance with H.323 or another protocol with similar concepts of logical channels. An access network infrastructure is provided so that the mobile multimedia station can send and receive multimedia information in a format more adapted to the radio link. The access network infrastructure takes care of the necessary conversion so that seen from the entity corresponding with the mobile multimedia station, the mobile multimedia station plus access network infrastructure combination behaves like a fixed multimedia station. The various entities on the communication path are mobile multimedia station-cellular infrastructure, which contains the access network infrastructure - IP network - fixed multimedia station. An embodiment of the present invention also applies to the case of mobile multimedia station to mobile multimedia station communication, in which case the entities on the path are: first mobile multimedia station- cellular infrastructure, which contains the access network infrastructure associated with the first station - IP network - cellular uifrastructure which contains the access network infrastructure associated with the second station - second mobile multimedia station.

Fig. 10 illustrates the user plane logical layers of the communication system 10 of another embodiment of the present invention. The figure is representative of the user plane logical layers of either the integrated confiscation, of which the control plane thereof is shown in Fig. 2 and of an integrated configuration, of which the control plane thereof is shown in Fig. 4. Again, the Figure shows multi-media stations 12 and 14 and access network infrastructure 34. Here, the station 12 includes a real-time media layer 102 which runs on top of an RTP layer 104. The RTP layer is operable, amongst other things, to add a time stamp to data segments generated by the real-time media layer 102. The time stamp specifies the time when the associated real-time media sample was generated. The time stamp is used by the receiving end to correct any delay fluctuation introduced by the IP backbone network. The RTP layer also adds a sequence number to each packet. The sequence number is used by the receiving end to detect packet loss and/or mis-sequencing and take appropriate corrective action. The RTP header also includes other information, such as the synchronization source (SSRC). All packets coming from an SSRC are part of the same timing and sequence number space.

The RTP layer 104 runs on top of a UDP layer 106 which is operable to format data segments applied thereto. The UDP layer 106 runs upon an IP layer 108. The IP layer 108 corresponds to the IP layer 52 shown in Fig. 2. The IP layer runs upon the adaptation layer 54 which is here operable to selectively perform compression functions. And, the adaptation layer 54 runs upon lower layers, here again represented by lower layers 66.

A special channel 114 formed during operation of an embodiment of the present invention interconnects the station 12 with the access network infrastructure 34. As shown, the special channel interconnects the lower layers 66 of the station 12 with corresponding lower layers 68 of the access network infrastructure.

The adaptation layer 54 is here shown to include a filter 472, a header compressor 474, and a header decompressor 476. The filter 472 is coupled to receive, on the line 478, each packet generated by a real-time media layer 102, subsequent to header information is added thereto by the layers 104, 106, and 108. While not separately shown, in an implementation in which non-real-time media is also sourced at the multi-media station 12, such non-real-time media is also acted upon by the layers 104-108 and packets of non-real-time media are also applied to the filter 472 by way of the line 478. The filter 472 is operable to separate, that is filter, real-time media packets from non-real-time media packets. Non-real-time media packets are generated on the line 482 and applied to the lower layers 66. Packets of real-time media, of which the packet 484 is exemplary, are provided by the filter on the line 486 to the header compressor 474.

The header compressor is operable to selectively compress the RTP, UDP, and IP fields of each packet of real-time media applied thereto. And, the header compressor generates packets of real-time media of which selected ones of the packets contain header fields of compressed form. The packet 492 shown in the figure is exemplary of a packet generated by the header compressor on the line 488.

Operation of the header compressor 474 takes advantage of the non-changing nature of the UDP and IP fields of packets of data generated during a single communication session. The UDP and IP fields from a first packet of the communication session are memorized, or passed, by the header compressor, and the UDP and IP fields of subsequent packets of the communication session are truncated. The header compressor 474 also acts upon the RTP fields of the data packet supplied thereto. While the RTP fields of the successive data packets supplied to the header compressor change with each packet, the RTP field is merely a time stamp indicating a sampling time, for instance. Identifying the packet by sequence number rather than an RTP stamp compresses the RTP field. Once compressed, the compressed packets are provided to the lower layers for communication upon the channel 114.

When received at the ANI 34, the compressed packets of real-time media, and, if any, non-compressed packets of non-real-time media are provided to the lower layers 68, and then to a header decompressor 502. The header decompressor is operable in a manner reverse to that of the header compressor 474. That is to say, compressed header fields of each packet provided thereto are decompressed. RTP and UDP fields, truncated from successive ones of the data packets, other than a first data packet, are reattached to the packets. And, the RTP time stamp is determined and substituted for the sequence numbers in the successive RTP fields of the successive data packets. Once decompressed, the data packets are provided to the lower layers 76 of the ANI. Figure 10 further shows the connection of the ANI 34 to the station 14 by way of the IP backbone 78. And, the multi-media station 14 is further shown to include lower layers 82, an IP layer 128, a UDP layer 126, an RTP layer 124, and a real-time media layer 122.

Packets of real-time media generated by the multi-media station 14 are analogously, in reverse manner, generated and communicated to the multi-media station 12. The ANI 34 is here shown further to include a filter 504 and header compressor 506 operable in manners analogous to operation of the filter 472 and header compressor 474 of the multi-media station 12.

Thereby, the embodiment shown in Figure 10 illustrates an implementation, based on header compression. Each of the adaptors has a filter and a header compressor in one direction, and a header decompressor in another of the directions. The header compressor compresses the IP/UDP/RTP headers into a smaller header, while the decompressor decompresses to regenerate the full headers. The filter routes only those packets corresponding to the real-time logical channel detected by the detector to the compressor. The other packets are not sent to the compressor. There is one filter for each compressor. With filtering, the compressor will not have to attempt unsuccessful compression on UDP packets which are not compressible. Thus, the compressor operates more efficiently. Both the MS and ANI filters rely on information provided by the detector to do the filtering. Such information is, for instance, the IP address and the UDP port number.

In contrast to the embodiments of Figures 2-3 and 4-5 in which the header fields of the packets of data are stripped, in the embodiments of Figs. 3 and 10 or 4 and 10, the header fields are compressed.

Adaptation techniques are often performed at a lower level to adapt the data to the limitations or constraints of the lower layers. Header compression is a primary example. Varius header compression schemes have been defined (IP, UDP, TCP, RTP, etc.). In general, the more the scheme is tailored to the application, the more efficient it is. An RTP header compression scheme, when applied to RTP traffic, achieves higher efficiency than a plain IP header compression scheme. In the context of cellular systems, efficiency is an overriding concern and therefore it is critical to be able to apply the most tailored adaptation technique to each flow.

In conventional systems the adaptation function is located at the link level and in general has no knowledge of the flow and type of application associated with a flow. As a result, one cannot apply more efficient adaptation techniques tailored to the application, or even the right adaptation. For example, a link does not know that an RTP protocol is being run in a flow on the link. Therefore, the link cannot apply a more efficient header compression scheme tailored for the RTP.

The present invention solves the above problem by relying on the terminal, where the knowledge of the application resides, to determine the more efficient adaptation (e.g. header compression scheme) to use. At flow set up time, the terminal exchanges signaling to inform the link level adaptation function what adaptation techniques to apply to each flow. For example, the terminal will determine that TCP compression is to be applied to flow X and RTP header compression is to be applied to flow Y. A flow is defined as IP source and destination addresses as well as port numbers. The present invention is particularly well suited for cellular environments, where highly optimized adaptation techniques are needed on the cellular link close to the mobile terminal or mobile station where spectral efficiency is a major concern.

Figs. 11 and 12 illustrate two examples where the adaptation function of the present invention is implemented. A Real-Time Manager (RTM) 701 and a Mobile Station (MS) 703 are provided. The RTM 701 includes an RTM control 705 which controls operation function of the realtime function of the RTM 701. The MS 703 includes an adaptation function 707 which identifies the appropriate adaptation for a particular flow. The adaptation function 707 includes a detector 709 which monitors application signaling from the application 711, and determines an appropriate adaptation to be used for each of the flows from the application 711. A special channel requester 713 is also provided in the adaptation function 707. The special channel requester 713, .in response to the detemination by the detector 709, sets up the special channel between the MS 703 and the RTM 701. RTM 701 is the counterpart of the adaptation function 707 residing in the MS 703. Together the adaptation function 707 and the RTM 701 perform the appropriate adaptation on each flow (e.g. TCP header compression/decompression, RTP header compression/decompression, RTP header stripping/regeneration etc).

Fig. 11 is the case of a non-integrated MS 703. In this case, the application 711 in the MS 703 is a standard application, which is not aware of even the existence of the adaptation function 707 underneath. The adaptation function 707 as described above monitors the signaling exchanged between the application 711 end-points and determines the flows as well as the adaptation techniques for each flow. The RTM 701 is then informed by the adaptation function 707 of the adaptation technique to apply to a particular flow. A special channel is set up by the special channel requester 713 to carry a particular flow.

Fig. 12 is the case where the application 711 in the MS 703 is integrated with the adaptation function 707 or informs the adaptation function 707 corresponding to the application 711 of each flow through an Application Programming Interface (API) 715. Thus, adaptation function 707 does not need to monitor the application signaling. As before, the RTM 701 is then informed by the adaptation function 707 of the adaptation technique to apply to a particular flow.

The previous descriptions are of preferred examples for implementing the invention, and the scope of the invention should not necessarily be limited by this description. The scope of the present invention is defined by the claims.

While the present invention has been described in detail and pictorially in the accompanying drawings it is not limited to such details since many changes and modifications recognizable to those of ordinary skill in the art may be made to the invention without departing from the spirit and the scope thereof.

Claims

CLAIMS What is claimed is:

1. In a first communication station operable in a communication system in which multimedia information is communicated between the first communication station and a second communication station, apparatus for determining an appropriate adaptation to be used for converting packet-formatted data, of which the multimedia information is formed, into a format amenable for transmission upon a link to the second communication station, said apparatus comprising: a detector which monitors application signaling output by an application or receives notification from an application to determine an appropriate adaptation to be used for converting packet-formatted data from the application to a format amenable for transmission on a link to the second communication station; and a requester, coupled to receive information of the determination by said detector, said requester requests allocation of a special channel defined as a link extending between the first and second communication stations, respectively, for communication of the multimedia information.

2. The apparatus according to claim 1 , wherein said application signaling output by said application is according to the H.245 standard and the application is an application according to the H.323 standard.

3. Apparatus according to claim 1 , wherein said detector determines an appropriate adaptation to be used for converting the packet-formatted to a format amenable for transmission on the link to the second communication station, wherein said appropriate adaptation includes at least one of TCP header compression/decompression, RTP header compression/decompression, and RTP header stripping/regeneration.

4. The apparatus according to claim 1, wherein said application signaling output by said application is according to the Session Initiation Protocol (SIP) standard.

5. The apparatus according to claim 1, further comprising: a format converter coupled to receive the packet-formatted data, of which the multimedia information is formed, and responsive to allocation of the special channel requested by said requester, said format converter converts the packet-formatted data into the amenable format to permit transmissions of the multimedia information, formatted in the amenable format, upon the special channel.

6. The apparatus according to claim 1, wherein the application signaling or the notifications to which said detector is coupled to receive comprises indications of selective assignation- requests for logical channels upon which to generate the multimedia information.

7. The apparatus according to claim 6, wherein the multimedia information comprises a first information-type and at least a second information-type, and wherein the indications of the selective assignation-requests comprises a request for selected assignation of a first logical channel upon which to generate the multimedia information of the first information-type.

8. The apparatus according to claim 7, wherein the first information-type of the multimedia information comprises real-time media, such as conversational voice information.

9. The apparatus according to claim 7, wherein the indications of the selective assignation-requests comprises a request for selective assignation of a second logical channel upon which to generate the multimedia information of the second information-type.

10. The apparatus according to claim 9, wherein the second information-type of the multimedia information comprises non-real-time media.

11. The apparatus according to claim 7, wherein the packet-formatted data of which the multimedia information is formed further comprises under plane information including the first information-type and at least the second information-type, the user plane information to be generated selectively upon the first logical channel and at least the second logical channel subsequent to assigning of the first logical channel and at least the second logical channel requested.

12. The apparatus according to 11, wherein the user plane information is formatted according to an RTP protocol.

13. The apparatus of claim 1 , wherein the application signaling or the notification which are detected by said detector, are each formatted according to an RTP protocol.

14. The apparatus according to claim 5, wherein the communication system comprises a TDMA (time-division, multiple-access) communication system in which time frames formed of groups of time slots are defined, wherein channels defined in the TDMA communication system are defined, at least in part, by a time slot allocation in successive ones of the time frames, and wherein the request by said requester for allocation of the special channel comprises a request for allocation of at least one selected time slot upon which to transmit the multimedia information.

15. The apparatus according to claim 14, wherein said format converter converts the packet-formatted data of which the multimedia information is formed into TDMA format for transmission upon the selected time slot subsequent to allocation responsive to the request by said requester.

16. The apparatus according to claim 5, wherein the communication system comprises a CDMA (code-division, multiple-access) communication system, wherein channels defined in the CDMA communication system are defined by channel codes, and wherein the request by said requester for allocation of the special channel comprises a request for allocation of at least one selected channel code by which to encode the multimedia information.

17. The apparatus according to claim 16, wherein said format converter converts the packet-formatted data of which the multimedia information is formed into a coded signal encoded by at least one channel code.

18. The apparatus according to claim 5, wherein said detector, said requester, and said format converter form portions of an adaptation layer of the first communication station.

19. The apparatus according to claim 18, wherein the second communication station further comprises an adaptation layer, a peer of the adaptation layer of the first communication station.

20. The apparatus according to claim 19, wherein said adaptation layer of the second communication station is operable to convert the multimedia information, received at the second communication station in the amenable format, into packet formatted data.

21. The apparatus according to claim 20, wherein the communication system comprises a cellular radio communication system, wherein the first communication station comprises a first terminal coupled together with a mobile station and wherein said detector, said requester, and said format converter form portions of the mobile station.

22. The apparatus according to claim 21, wherein the second communication station comprises a second terminal coupled together with network infrastructure of the cellular communication system, and wherein said adaptation layer of the second communication station is formed at the network infrastructure.