Search Images Maps Play YouTube News Gmail Drive More »
Sign in
Screen reader users: click this link for accessible mode. Accessible mode has the same essential features but works better with your reader.


  1. Advanced Patent Search
Publication numberUS5787152 A
Publication typeGrant
Application numberUS 08/928,890
Publication dateJul 28, 1998
Filing dateSep 12, 1997
Priority dateJul 18, 1995
Fee statusLapsed
Also published asUS6167116
Publication number08928890, 928890, US 5787152 A, US 5787152A, US-A-5787152, US5787152 A, US5787152A
InventorsTommyca Freadman
Original AssigneeFreadman; Tommyca
Export CitationBiBTeX, EndNote, RefMan
External Links: USPTO, USPTO Assignment, Espacenet
Computer communications device
US 5787152 A
A computer peripheral device for voice and synthesized voice communication is disclosed. The device serves in place of a telephone handset, in a telephone mode of operation, and as a remote-control computer-based media center in a voice control mode of operation, without requiring the use of headphones. Thus the device frees integrated multimedia and voice-command computer control operations from the physical limitations of the workstation, with its keyboard and CRT. The device also integrates telephone communication functions, into a computer remote control interface, thereby providing modal flexibility, minimizing disruption and increasing operator efficiency.
Previous page
Next page
I claim:
1. A communications device for a computer comprising:
a) a controller adapted to operate in a telephone mode and a voice control mode, the controller including a housing having a Plurality of manually actuated keys for use in operating the controller and having a microphone and a speaker disposed in the housing for use in the telephone mode and the voice control mode, the controller including a mode control switch disposed on said housing for selecting a mode of operation of the controller from the telephone mode and voice control mode, the controller controlling exchange of audio between the controller and a telephone line to conduct a telephone conversation while operating in the telephone mode and the controller controlling operation of a program which is performed by the computer in response to audio input to the controller while operating in the voice control mode, the controller including a transmitter for selectively transmitting audio which is input to the controller to the telephone line and for generating sound in response to audio signals received by the controller via the telephone line while operating in the telephone mode and for selectively transmitting data to the computer in response to audio input to the controller for controlling the operation of the program which is performed by the computer while the controller is operating in the voice control mode, the controller including a first converter for converting audio input to the controller into signals to be transmitted to at least one of the telephone line and the computer, a second converter for converting audio signals input to the controller into sound; and
b) an interface operatively connected to the controller and being adapted to be connected to the computer and the telephone line, the interface including a telephone line interface device for connecting the interface to the telephone line and an audio controller including auxiliary AUDIO IN and AUDIO OUT connections adapted to be connected to an auxiliary speaker located remote from the speaker disposed in the housing, the audio controller being arranged to receive audio signals from the microphone in the controller and from the auxiliary AUDIO IN connection, and to selectively transmit audio signals to the computer, to the telephone line via the telephone line interface and to the auxiliary AUDIO OUT connection.
2. The device according to claim 1, wherein the second converter for converting the audio signals input to the controller into sound includes the speaker disposed in the housing and an earpiece; and said
controller further comprising output selection means for selecting one of said speaker disposed in the housing and said earpiece.
3. The device according to claim 2, wherein said output selection means is a jack that supersedes the speaker disposed in the housing when the earpiece is plugged into said jack.
4. The device according to claim 1, wherein the interface is connected to the controller by a conductive cable.
5. The device according to claim 1, wherein the controller and the interface each includes a radio frequency transceiver, and wherein the interface is connected to the controller via a wireless, radio frequency link.
6. The device according to claim 1, wherein the interface has an RS232 connector for direct connection to the computer.
7. The device according to claim 1, wherein the controller is a lightweight, portable unit movable relative to the computer.
8. The device according to claim 7, wherein the controller includes:
a keyboard disposed on said housing for manually generating signals for transmission to at least one of the computer and the telephone line;
the housing having a support surface located opposite to a surface of said housing on which said keyboard is located, said support surface providing support for the keyboard when the housing is placed on a flat surface; and
a microphone aperture in an oblique surface of said housing, said oblique surface being substantially orthogonal to said support surface.
9. The device according to claim 1, wherein the controller also includes a privacy switch.
10. The device according to claim 1, wherein said keys include media control keys for controlling operation of a media program being performed by the computer.
11. The device according to claim 1, wherein said keys include cursor control keys.
12. The device according to claim 2, wherein the output selection means includes a speaker selection switch on the housing, said speaker selection switch selectively providing audio output through the speaker on the housing or through the auxiliary speaker connected to the auxiliary AUDIO OUT connection.
13. The device according to claim 1, further comprising:
a selection unit for enabling a user to selectively operate the controller in one of the telephone mode and the voice control mode.

This is a continuation application of Ser. No. 08/503,590, file on Jul. 18, 1995, now abandoned.


1. Field of the Invention

This invention generally relates to communication devices. More particularly, the invention relates to devices that provide full-duplex communication and to devices that provide remote control of personal computers.

2. Description of the Related Art

It is well-known that, in full-duplex communications operations such as normal telephone conversations, it is important to either physically separate an audio input device from audio output as much as possible or to provide an earpiece so that a lower output volume level can be used, as in the conventional telephone handset. This prevents acoustic feedback from being conducted by the structure of the housing.

Also, in full-duplex communications operations that do not use an earpiece, it is important to control the phase and directional relationships between audio input and audio output transducers, the speaker and the microphone, to prevent the sort of feedback that produces the squeals heard from improperly-used public address systems.

Conventional audio transducers for multimedia computers are mounted together below the computer monitor screen inside the screen enclosure, or in a separate audio enclosure resting on top of the screen enclosure, with the microphone between two speakers. All three transducer apertures are aligned on a flat surface facing the operator. Thus the conventional, screen-mounted microphone is subjected to structural conduction and will receive acoustic feedback that varies in phase and volume depending on the nature of the reflective surface opposite those speakers and its distance from the microphone, as is well known.

In particular, feedback is readily conducted by the respective enclosure because of the close proximity of these transducers to each other. Speaker sound is also readily reflected by opposing surfaces with little attenuation because of the speakers' proximity to the microphone and because all apertures in these units face in the same direction. Moreover the placement of the three audio transducer apertures in the flat, vertical front face of a conventional enclosure does nothing to shield the input transducer from such reflections.

Mounting a microphone on the computer screen enclosure in this conventional way is particularly problematic when computer voice command control is in use. Feedback and noise interfere with productivity in voice-command computer control operations because they reduce the accuracy of the computer's command recognition operations, thus reducing its speed.

Efficient voice communication, and voice-command computer control in particular, has three principal requirements:

1) A constant distance between the microphone and the person speaking, preferably a close proximity.

2) Shielding of the microphone from other voices and other extraneous noise.

3) Feedback prevention.

The first requirement assures an adequate input volume level. This level decreases rapidly as this person moves away, in accordance with the inverse-squares' law. Locating the microphone in close proximity to the person speaking also assures the best possible signal-to-noise ratio for accurate voice recognition. However, conventional computer audio equipment meets this requirement by immobilizing the operators in front of the computer screen when they use voice-command computer control, chaining them to their chairs. This, in itself, interferes with the workstation's productivity.

The second requirement is simply ignored in the design of the conventional computer audio inputs noted above. Mounting the microphone on a flat surface above or below the computer screen, provides little or no shielding from either ambient noise or reflected speaker sound.

The third requirement is often met by providing only half-duplex audio communication, speaker-phones' artificial alternation between providing audio output and accepting audio input. In human communication, this is disruptive and annoying.

Apart from voice recognition problems, operator efficiency is also hindered by lack of inter-modal coordination and flexibility. Real-time on-line communications activity, in general, is increasing rapidly. The computers themselves have become digital communications hubs connected by modem to telephone lines for facsimile transmissions, electronic mail and information exchanges between data banks. They are also increasingly used to access multimedia resources and process audio and video inputs.

Computers are no longer just off-line number-crunching or wordprocessing appliances. Nor is the operator dependent upon an alphanumeric keyboard and CRT for control of and responses from the computer. However, the complex interaction of these new functions demands more spatial and modal flexibility for the computer operator. In particular, an improved audio link is needed to prevent the attendant increases in functional complexity from interfering with workstation productivity.

For example, computer operators are hindered when their computer work is interrupted by telephone calls. They must locate the ringing telephone, perhaps digging it out from beneath the working papers accumulating on the desk, and pick up its handset to answer the call. This diverts them from the computer screen. "Hands-free" telephone equipment may simplify that process, but half-duplex speaker-phone operations interfere with normal conversation and people who are not employed full-time as telephone operators find headsets annoying.

Moreover, voice synthesis can completely free computer operators from their dependence on the CRT for monitoring the computer's operations, but conventional voice-command hardware immobilizes them in front of that CRT. This new, additional lack of mobility interferes with the operators' access to the physical resources available to them just as surely as the old CRT and keyboard interface did. This severely limits the potential usefulness of voice synthesis in computer control operations.

For these reasons, the conventional voice-communications system provided for personal computers is merely a toy. When productivity is at issue, these well-known shortcomings of the conventional computer audio hardware are intolerable.


The present invention provides a computer workstation having improved audio communications performance.

In particular the present invention provides an audio communications peripheral device for integrated personal computer workstations that facilitates highly-productive multimedia, voice control and voice communications work.

In accordance with the present invention, computer workstation productivity is improved by physically separating the output transducers from the microphone used for full-duplex operation and distributing audio output functions between full-duplex and half-duplex output transducers.

The present invention permits the same telephone line connected to a computer for transmitting facsimile messages, electronic mail and other digital data, to be used to transmit voice signals. This functional integration allows computer operators to answer telephone calls without leaving the computer workstation.

Voice-command control operations are also improved because the portable microphone can be conveniently moved to maintain an advantageous predetermined distance from the operator on the table, desk, etc. where the operator is working.

In addition to permitting the operator much greater freedom of movement, the act of resting the portable microphone on the table effectively shields the computer's audio input. This shielding provided by the orthagonal orientation of the described microphone aperture to the conventional speaker apertures, permits full-duplex operation and minimizes direct interference from ambient noise sources.

Also, when the device is placed on the table in front of the operator, the microphone's distance from the speakers is increased without sacrificing its proximity to the operator, thereby reducing not only reflected but also conducted feedback.

In accordance with a preferred embodiment of the present invention the device also provides a remote control interface. When using this device in the remote control device, the operator enjoys substantial independence from the operator's conventional CRT/keyboard control interface.

A communications device in accordance with the present invention includes a housing accessible to a human operator, said housing having means for converting sounds spoken by the operator into outgoing voice signals, and means for converting incoming voice signals into sounds heard by the operator in said housing. The device also includes an interface operatively connected to said means for converting incoming and outgoing voice signals, to the computer and to the telephone line, as well as control means for conducting said outgoing and incoming voice signals to and from the telephone line in a telephone mode of operation in which the housing serves in place of a telephone handset, and for conducting the outgoing and incoming voice signals to and from the computer in a voice-command mode of operation in which the housing serves as a computer control center.

In the telephone mode of operation, the operator can select either audible or inaudible notification of an incoming telephone call while working on the computer. Audible notice is provided by the computer, the communications device or a conventional telephone ringing circuit. Alternatively, in voice-command mode for example, silent notice is provided by displaying a visible graphic symbol on the computer screen, such as a flashing telephone icon. Then, in telephone mode for example, operator can also conveniently answer the telephone call by speaking into the microphone in the communications device and hearing the audio output from either the speaker in the device, or an earpiece, without diverting the operator's attention from the monitor. Thus telephone operations are integrated with the computer workstation and the same telephone line that heretofore conducted digital signals to the computer's modem: facsimile messages, electronic mail and data bank information, can be employed for both duplex and half-duplex voice communication.

When the voice-command mode of operation is selected, the communications device functions as a half-duplex computer control center. Words dictated by the operator into the microphone are processed by voice-recognition programs in the computer to provide commands that control the computer and provide data for use by the computer. In a preferred embodiment, this audio remote control mode also provides audible responses from the computer. The computer's response is communicated by voice-synthesis signals to a speaker in the housing, thereby providing an interactive remote control mode that frees the operator from the CRT and keyboard of the conventional computer workstation interface.


The features and advantages of the present invention will be better understood when detailed description of specific embodiments given below is considered in conjunction with the drawings provided, wherein:

FIG. 1 is a perspective view of a simple computer control and communications device in accordance with the present invention;

FIG. 2 is a block diagram of the device of FIG. 1 according to one embodiment of this invention;

FIG. 3 is a block diagram of the device of FIG. 1 according to another embodiment of this invention; and

FIG. 4 is a plan view of the keypad provided by the remote unit of the wireless computer access device of FIG. 3.

In these figures, like structures are assigned like reference numerals.


Referring now to the drawings, reference numeral 10 generally identifies a communications device including a portable housing 12 and an interface 14. The interface includes an external connector 16, preferably an RS232 connector, for direct connection to a computer, as well as a socket for reception of a plug connected to a telephone line 18. The electronic circuitry of the communications interface 14 is either hard-wired to the housing 12 by a cable 20, as shown in FIG. 2, or is connected by a wireless link between the antennae 22, 24, as shown FIGS. 3 and 4 which are described below.

The housing 12 also includes a microphone 26 that picks up conversation and voice commands, a speaker 28 and a jack 30 for connecting an optional headset for use in environments where privacy is important. The housing also provides a mode control key 32 that selects the mode of operation used by the system, and a standard keypad 34 for placing a telephone call and entering computer control codes.

Turning now to FIG. 2, control circuitry in the interface 14 includes a telephone line interface module 36 where incoming voice signals from the telephone line 18 are digitized and processed. The digitized signals are then conducted to a programmable microprocessor or a microcontroller 38 and to an audio controller 40. The audio controller has auxiliary audio input AUDIO IN and output AUDIO OUT connections that can be used to operate the computer's speakers (not shown), either a computer sound system or external speakers, and an interface cable connector for the cable 20.

The cable 20 connects the audio controller 40 through an amplifier to the speaker 28 on the housing 12. For full-duplex operation, the audio controller 40 is connected to headphones through the optional headset jack 30 or to the computer's speaker (not shown) through the auxiliary AUDIO IN and AUDIO OUT connections on the audio controller 40. In this embodiment, privacy is assured by simply connecting headphones to the jack 30, which simultaneously causes the audio controller to disconnect the auxiliary AUDIO IN and AUDIO OUT lines.

The operator's voice is picked up by the microphone 26 connected to the audio controller 40 by the cable 20 and, after being digitized and processed, to the microcontroller 38 and the telephone interface module 36. The digitized voice signals are output to the interface connector 16, to the telephone line 18 or to the auxiliary output of the audio controller 40 depending upon the mode of operation selected using the control key 32.

FIG. 3 shows another embodiment of the circuitry shown in FIG. 2. However, instead of the hard-wired cable 20, a wireless link is provided between the housing 12a and the interface 14a in a base-station that also serves as a charger for the wireless remote unit. Radio frequency transceivers 48, 44 transmit and receive radio frequency signals between antennas 22, 24 on the remote 12a and interface 14a, respectively.

In FIG. 3, the functions of the audio controller 40 in the interface 14a of FIG. 2 are provided by the radio frequency transceiver 44 in the interface 14a. Also, a key matrix 50 connects the keys of a standard dialing keypad and multiple control keys through a key signal encoder 46 to the radio frequency transceiver 48. Thus, pressing the keys of the matrix sends a signal from the remote unit through the base-station interface 14a to the computer (not shown).

The housing 52 of the wireless remote control unit is shown in FIG. 4. The key matrix 50 provides a mode control key "TEL" and the standard dialing keypad 34. For remote control, the key matrix also includes cursor keys 54, a speaker control key "SPKR", a privacy key "PVT" and media control keys 60.

The speaker control key permits the operator to mute the computer speakers when operating beyond the speakers' effective range, and the privacy key permits the operator to selectively mute the speaker 28 on the housing 12a when an ear piece is in use. The media control keys 60 provide a record function key "REC" and the standard playback control functions: "PLAY", "STOP" and "PAUSE" to remotely operate media devices (not shown) controlled by the computer.

A rotary audio volume control 62 may be provided on the side of the unit to vary the audio output level of the remote speaker 28, the earpiece that the operator plugs into the jack 30, or the computer's speakers (not shown), whichever is in use at the time. In this remote control embodiment the earpiece is an earphone, for convenience, but headphones may be used if remote stereo sound is needed.

In telephone mode, the computer operator is provided with a full-duplex multimedia channel, and can answer calls, using the microphone 26 and speakers (not shown) connected to the auxiliary AUDIO IN and AUDIO OUT connections on the audio controller 40. A remote operator will use an earpiece connected to the jack 30 rather than local, computer speakers connected to the auxiliary AUDIO IN and AUDIO OUT lines. Such outgoing and incoming voice signals are conducted via the telephone line 18, and may be conventional analog signals or ISDN digital audio. Multimedia operations over the auxiliary AUDIO IN and AUDIO OUT connections on the audio controller 40 may include speech-synthesis and audio-recording operations such as voice mail.

In voice control mode, the operator can very simply and very conveniently utilize the microphone 26 and the speaker 28 on the housing 12a for half-duplex communication with the computer itself. Alternatively, when an earphone or headphones are already in use for full-duplex multimedia or telephone communications, the jack 30 can be used to provide all audio output, as a matter of convenience.

In remote control operations, the speaker 28 on the housing 12a is used for digitally-synthesized voice output when the computer control mode is selected by the operator using the control key 32. The cursor keys 54 can be used to access functions that are identified by a synthetic-voice statement and would otherwise be located in a matrix on the screen. The stated function is then seletected by pressing the "ENTER" key in the center of the cursor keys 54.

In the remote telephone operations, when the auxilliary speakers are muted, the computer's synthesized voice output through the speaker 28 also announces caller ID, preferably including a caller name that is associated with that caller ID number in the computer's data base, information that would otherwise be available on the computer screen.

The present invention is in no way limited to the presently preferred embodiments of the described above. It will immediately apparent to one skilled in the art that variations and modifications of the disclosed embodiments are possible without departing from the spirit and scope of the present invention. The invention is defined by the appended claims.

Patent Citations
Cited PatentFiling datePublication dateApplicantTitle
US4356509 *Mar 12, 1981Oct 26, 1982Zenith Radio CorporationMicrocomputer-controlled television/telephone system and method therefore
US4392022 *Jan 30, 1981Jul 5, 1983Rca CorporationTelevision remote control system for selectively controlling a plurality of external apparatus
US4427847 *Aug 10, 1981Jan 24, 1984Zenith Radio CorporationTelevision/telephone system with annunciator and intercom feature
US4991197 *Sep 1, 1988Feb 5, 1991Intelligence Technology CorporationMethod and apparatus for controlling transmission of voice and data signals
US5031205 *Apr 23, 1990Jul 9, 1991Stephen PhillipsAuto response phone system
US5287119 *Oct 11, 1991Feb 15, 1994Wang Laboratories, Inc.Computer input device using an orientation sensor
US5375165 *May 27, 1993Dec 20, 1994Haber; Alan P.Computer keyboard having both a standard keyboard mode and a telephone control mode
US5426450 *Oct 4, 1994Jun 20, 1995Wang Laboratories, Inc.Hands-free hardware keyboard
US5442729 *Nov 8, 1993Aug 15, 1995The Board Of Trustees Of The Leland Stanford Junior UniversityStrain-sensing goniometers, systems and recognition algorithms
US5452289 *Jan 8, 1993Sep 19, 1995Multi-Tech Systems, Inc.Computer-based multifunction personal communications system
US5455859 *Nov 28, 1994Oct 3, 1995Gutzmer; Howard A.Telephone handset interface for device having audio input
US5524047 *Dec 27, 1993Jun 4, 1996Cirrus Logic, Inc.Method and apparatus for emulating telephonic communications with a modem and headset
US5526411 *Mar 8, 1994Jun 11, 1996Radio, Computer & Telephone CorporationIntegrated hand-held portable telephone and personal computing device
US5550649 *May 14, 1992Aug 27, 1996Current Logic Systems, Inc.Multi-function telecommunications instrument
US5594470 *Jun 30, 1994Jan 14, 1997Teletransaction, Inc.Highly integrated portable electronic work slate unit
US5619684 *Jul 25, 1994Apr 8, 1997International Business Machines CorporationMethod and apparatus for consistent user interface in a multiple application personal communications device
US5631745 *Nov 7, 1994May 20, 1997Current LogicMulti-function telecommunications instrument
US5675390 *Jul 17, 1995Oct 7, 1997Gateway 2000, Inc.Home entertainment system combining complex processor capability with a high quality display
Referenced by
Citing PatentFiling datePublication dateApplicantTitle
US6128006 *Mar 26, 1998Oct 3, 2000Immersion CorporationForce feedback mouse wheel and other control wheels
US6154201 *Oct 26, 1998Nov 28, 2000Immersion CorporationControl knob with multiple degrees of freedom and force feedback
US6212408 *May 3, 1999Apr 3, 2001Innovative Global Solution, Inc.Voice command system and method
US6449496 *Feb 8, 1999Sep 10, 2002Qualcomm IncorporatedVoice recognition user interface for telephone handsets
US6463299 *Oct 14, 1998Oct 8, 2002Avaya Technology Corp.Method and apparatus providing an integral computer and telephone system
US6584510 *Apr 17, 1998Jun 24, 2003Nokia Mobile Phones Ltd.Computer and a method of operating a computer
US6686911Oct 2, 2000Feb 3, 2004Immersion CorporationControl knob with control modes and force feedback
US6697456 *Dec 7, 2001Feb 24, 2004Avaya Technology Corp.Speech analysis based answer detection for IP based telephones
US6748361Dec 14, 1999Jun 8, 2004International Business Machines CorporationPersonal speech assistant supporting a dialog manager
US7024363Dec 14, 1999Apr 4, 2006International Business Machines CorporationMethods and apparatus for contingent transfer and execution of spoken language interfaces
US7046234Nov 21, 2002May 16, 2006Bloomberg LpComputer keyboard with processor for audio and telephony functions
US7532716 *Apr 25, 2003May 12, 2009Brother Kogyo Kabushiki KaishaCommunication system, and terminal device and communication device used in communication system
US7689939Jun 30, 2004Mar 30, 2010Avaya Inc.Software application break through a screen blanker
US7817106Sep 9, 2005Oct 19, 2010Sharp Kabushiki KaishaDisplay device, viewing angle control device, and electronic apparatus
US7834834Sep 1, 2005Nov 16, 2010Sharp Kabushiki KaishaDisplay device, viewing angle control device, and electronic apparatus
US8031273Sep 12, 2005Oct 4, 2011Sharp Kabushiki KaishaDisplay device, viewing angle control device, and electronic device
US8094103 *Aug 29, 2005Jan 10, 2012Sharp Kabushiki KaishaViewing-angle control device, display apparatus, method for controlling viewing-angle control device, viewing-angle control program, and storage medium storing the program
US8184145Oct 3, 2005May 22, 2012Sharp Kabushiki KaishaDisplay device and electronic apparatus
US8232967Feb 9, 2006Jul 31, 2012Bloomberg Finance L.P.Computer keyboard with processor for audio and telephony functions
US20040100447 *Nov 21, 2002May 27, 2004Ozolins Helmars EComputer keyboard with processor for audio and telephony functions
US20050213930 *May 17, 2004Sep 29, 2005Hitachi, Ltd.Electronic terminal apparatus
US20060012584 *Sep 22, 2005Jan 19, 2006Vassallo Steven PMechanisms for control knobs and other interface devices
USRE42831 *Apr 14, 2008Oct 11, 2011Lg Electronics Inc.Mobile communication terminal provided with handsfree function and controlling method thereof
USRE44871 *Aug 25, 2011Apr 29, 2014Lg Electronics Inc.Mobile communication terminal provided with handsfree function and controlling method thereof
WO2000067497A1 *Apr 25, 2000Nov 9, 2000Neopoint IncVoice command system and method
U.S. Classification379/88.01, 379/388.01, 379/388.02, 379/90.01, 379/110.01
International ClassificationH04M1/06, H04M1/725, H04M1/27, H04M11/06, H04M1/215, H04M1/57, H04M1/60
Cooperative ClassificationH04M1/215, H04M11/06, H04M1/06, H04M1/57, H04M1/271, H04M1/6033, H04M1/725
European ClassificationH04M1/06, H04M1/725, H04M11/06, H04M1/60T, H04M1/215
Legal Events
Mar 5, 2001ASAssignment
Feb 20, 2002REMIMaintenance fee reminder mailed
Jul 24, 2002SULPSurcharge for late payment
Jul 24, 2002FPAYFee payment
Year of fee payment: 4
Apr 23, 2004ASAssignment
Feb 15, 2006REMIMaintenance fee reminder mailed
Jun 20, 2006ASAssignment
Effective date: 20050923
Jul 28, 2006LAPSLapse for failure to pay maintenance fees
Sep 26, 2006FPExpired due to failure to pay maintenance fee
Effective date: 20060728