Search Images Maps Play YouTube News Gmail Drive More »
Sign in
Screen reader users: click this link for accessible mode. Accessible mode has the same essential features but works better with your reader.

Patents

  1. Advanced Patent Search
Publication numberUSH2098 H1
Publication typeGrant
Application numberUS 08/200,049
Publication dateMar 2, 2004
Filing dateFeb 22, 1994
Priority dateFeb 22, 1994
Also published asUS20030036911
Publication number08200049, 200049, US H2098 H1, US H2098H1, US-H1-H2098, USH2098 H1, USH2098H1
InventorsLee M. E. Morin
Original AssigneeThe United States Of America As Represented By The Secretary Of The Navy
Export CitationBiBTeX, EndNote, RefMan
External Links: USPTO, USPTO Assignment, Espacenet
Multilingual communications device
US H2098 H1
Abstract
A computer-based device for providing spoken translations of a predetermined set of medical questions, upon the selection of individual questions. Translations are prerecorded into a number of languages, and the physician user, in cooperation with the patient, chooses the language into which the translations are made. Then the physician chooses the questions in the physician's own language that should be asked, then indicates his choice to the device, and the device speaks the corresponding questions in the language of a potential respondent.
Images(4)
Previous page
Next page
Claims(17)
What is claimed is:
1. A computer-based communications device for aiding communication between a user and a respondent, wherein the user and respondent do not speak a common language, the device comprising:
(a) a primary storage unit which stores an ordered list comprising discrete phrases in a language understood by the user;
(b) at least one secondary storage unit which stores digital pre-recorded audio translations to the discrete phrases stored in the primary storage unit in at least one language not fluently spoken by the user, said digital pre-recorded audio translations having been produced by translating the discrete phrases into the at least one language not spoken by the user to form translated discrete phrases, speaking each translated discrete phrase to form spoken translated discrete phrases, and recording each spoken translated discrete phrase;
(c) a visual display unit which displays a plurality of phrases from the ordered list;
(d) a phrase selector which allows the user to select a discrete phrase from the plurality of displayed phrases, wherein the phrase selector allows the user to scroll through the plurality of displayed phrases to select available phrases, retrieves a set of discrete phrases from said primary storage unit in response to a keyword input from said user, retrieves a script comprising a plurality of discrete phrases making up a structured interview in response to a script topic selection from said user, or a combination thereof, said phrase selector including an input device which controls movement of an on-screen indicator, said input device further including an actuator which, when activated while the on-screen indicator is at a position corresponding to that of a specific displayed, discrete phrase, selects the specific displayed, discrete phrase;
(e) a foreign language selector which allows the user to select a language for translation of the selected, displayed, discrete phrase;
(f) a software interface which allows the user to interact with various components of the device;
(g) an audio unit which plays out, from the digital pre-recorded audio translations stored on the at least one secondary storage unit, a translation in the user-selected foreign language of the selected, displayed, discrete phrase;
wherein said ordered list comprises predetermined phrases which solicit a universally comprehensible response from the respondent; and wherein the respondent need not be literate in the language of the pre-recorded audio translations to comprehend and respond to the discrete phrases.
2. The device of claim 1 which is a personal computer system.
3. The device of claim 2 which is portable.
4. The device of claim 2 wherein the primary storage unit is at least one hard disk.
5. The device of claim 2 wherein the at least one secondary storage unit is at least one CD-ROM.
6. The device of claim 2 wherein the software interface comprises a program written in visual basic.
7. The device of claim 2 wherein the video display unit is a video monitor.
8. The device of claim 2 wherein the audio unit comprises a sound card and at least one speaker.
9. The device of claim 2 wherein the foreign language selector and the phrase selector comprise a keyboard or a peripheral device that, when activated by the user, interacts, through said software interface, with said visual display to select the language for translation or the discrete phrase.
10. The device of claim 1 wherein the ordered list comprises discrete phrases ordered alphabetically, according to category, or a combination thereof.
11. The device of claim 1 wherein the at least one language is a plurality of languages.
12. The device of claim 1 wherein the primary storage unit and the at least one secondary storage unit comprise the same hardware.
13. The device of claim 1, wherein said ordered list of discrete phrases comprises predetermined phrases which solicit a yes response, a no response, a non-verbal response, or a non-verbal gesture from the respondent.
14. The device of claim 1 wherein the phrase selector retrieves a script comprising a plurality of discrete phrases forming a structured medical interview in response to a script topic selection from the user.
15. The device of claim 14 wherein the structured interview is a standard medical interview.
16. The device of claim 15 wherein the standard medical interview is about at least one specific medical condition or ailment.
17. A method for a medical practitioner to interview a patient using the computer-based communications device of claim 1, wherein the patient does not understand any language spoken fluently by the doctor; the method comprising the steps of:
(a) selecting a phrase;
(b) selecting a foreign language to audibly present a translation of the phrase selected for the patient;
(d) determining whether the patient understood the translation;
(e) repeating steps (b) and (c) until a foreign language which the patient understands is found;
(f) selecting a script comprising a structured interview appropriate to medically interview the patient.
Description
GOVERNMENT INTEREST

The invention described herein may be manufactured, used, and/or licensed by or for the United States Government for governmental purposes without the payment of any royalties thereon.

BACKGROUND OF THE INVENTION

Field of the Invention

This invention provides a method and apparatus for providing interpretation into a chosen one of a plurality of languages for a structured interview, especially the type of interview done by a medical professional (hereafter called the physician, the operator, or the user) with a patient-who does not share a common language, without the necessity of a human interpreter, and without the necessity of the person being interviewed (hereafter called the patient or the respondent) being able to read or write in any language. The terms translation and interpretation are used interchangeably herein.

Medical history taking, physical examination, diagnostic procedures, and treatment all involve verbal communication to some degree. With rapid world-wide travel now being common, patients are often presented to physicians for care who do not have a common language with the physicians. While it is in this context that the inventor approached the problem, the invention could also be used between confessor and penitent, waiter and customer, hotel desk clerk and international customers, or in other situations where multiple unknown languages must be dealt with.

The use of a human interpreter is a good solution to the physician/patient interview, but it has drawbacks. An interpreter may not be available. It may not even be initially clear what language the patient speaks. Interpreters often interfere with the interview process. They may inject their usually poor medical judgment into the interview, or they may be embarrassed by or embarrass the patient with probing personal questions. If the translator is a relative of the patient, embarrassment or outright fabrication of answers may result.

Description of the Prior Art

In the prior art, phrase books have been used, and a large set of these for many different languages have been compiled by the United States Department of Defense. These have their drawbacks. Where they are written for the physician to attempt to pronounce a transliteration into a language that the physician is not familiar with, they frequently result in lack of understanding. Pointing to a written phrase in a phrase book requires that the patient be literate, and it is often slow.

In U.S. Pat. No. 4,428,733 to Kumat-Misir, a series of question and answer sheets are provided in two languages, with answers given in one language being generally understandable by reference to sheets in the second language. This would be slow, would require a literate patient, and would not allow the physician to choose the next question based upon the response to the previous question.

There have been efforts, such as represented in U.S. Pat. No. 4,984,117 to Rondel et al, to provide a number of phrases and sentences in a single foreign language, with provision for the user to attempt in his own language to select one or more of those phrases, and if his selection is recognized as possible, to play out a recorded foreign language version of what the user selected. In Rondel et al, this selection is made by training the device to recognize the user's voice as a means for making the selection in his own language. This device can operate in only one foreign language unless restructured, and provides no means for questioning a respondent to determine what foreign language would be suitable for an interview. It is also structured to operate only with user voices that it recognizes, making it time consuming at best for a new user to begin using the translator on short notice.

SUMMARY OF THE INVENTION

The invention provides a translating machine to enable an operator who is fluent in one language to interview a respondent using a predetermined list of available sentences, which may include questions. This assumes that the respondent speaks any one of a plurality of available languages other than the language in which the operator is fluent, and also assumes that the respondent need not be literate in any language. Translations into each of the available languages of each of the available sentences are stored in advance in a digital form which is convertible into an audio waveform. The available language to be used with a particular respondent is chosen. The user selects individual desired sentences from an alphanumerically stored list which is visually presented to the user. Then, as selected by the user, a translation of the chosen sentences are played out in an audio form to the respondent.

These translations into individual foreign languages were obtained and stored in advance from speakers who were fluent in the individual languages. One of the available sentences is visually presented to the speaker for translation and his spoken translation is recorded. It is then played back for the speaker's approval, and if approved is accepted for long-term storage. If not approved, the speaker is given additional opportunities for recording his spoken translation until he is satisfied.

When the device is to be used to interview a potential respondent, if the language spoken by that respondent is uncertain, the user plays samples of seemingly probable languages to the respondent to determine which language the respondent chooses. The user then can limit future translations to a given respondent to a language which the given respondent has chosen from the samples. In general, digital audio sentences sufficient to conduct a medical interview in a large number of languages, approximating 25 or 30, can be stored on one CD-ROM disk of the size currently in wide use.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram of a translating machine in accordance with the present invention

FIG. 2 is a schematic block diagram of a machine for recording a series of translations into a given foreign language.

FIG. 3 is a schematic block diagram of an element for use with the device of FIG. 1 for selecting which of a plurality of foreign languages a given respondent is familiar with.

FIG. 4 is a schematic block diagram indicating that a plurality of foreign languages can be stored on and played back from a single CD-ROM.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

When a physician wishes to interview a patient, as in an initial examination, there is a standard list of questions, almost a script, that covers most of what has to be asked. Lists of these phrases have long been available in Department of Defense phrase books referred to above. Other than “yes” or “no” answers in a foreign language, the physician will generally have difficulty understanding responses in the foreign language and must depend upon pointing, holding up a proper number of fingers for the answer, and other non-verbal responses.

Referring to FIG. 1, which is a schematic block diagram of a translating machine in accordance with the present invention, a storage unit 2 stores an alphabetical list of available phrases in the operator/user's language, and it is possible to move about the available list through the use of a manual selector 4 which can choose among the various available phrases. The phrases available to choose from are displayed to the operator on a visual display of available phrases 6.

The precise method of manually selecting from the available phrases can be chosen from several. It is possible to do a word search by typing in a word such as “appendicitis” and have all available phrases using that word appear on the visual display in order to allow selection of a desired phrase. It is possible to choose, with a mouse or otherwise, from the available phrases being displayed on the visual display in order to select the desired phrase. It is possible to have a script containing a plurality of questions to be asked in sequence (or skipped) as desired for a particular procedure or interview, and to go down that script in order to select the desired phrase.

For the purposes of FIG. 1, it is assumed that, by this time, the foreign language to be used has been selected by operator, using a foreign language selector 8. This can also be operated from a keyboard or with a mouse. Selector 8 operates a logical switch 10, which chooses whether to take the stored spoken foreign language from a storage 12 for a first spoken foreign language, or a storage 14 for a second spoken foreign language.

The choice from the available phrases by the operator from selector 4 goes to a selector 16 for corresponding foreign language phrases. This selector, in connection with logical switch 10, chooses a recorded spoken phrase in the chosen foreign language (the first spoken foreign language with the switch as illustrated) and passes that recorded phrase to an audio playout device 18, where it is played out to be listened to by the respondent/patient.

Referring to FIG. 2, which is a schematic block diagram of a machine for recording translations of a series of phrases into a given foreign language, a storage unit 2 is provided for alphanumeric storage of available phrases in the operator's language. The phrases to be translated are presented to the person/speaker who will speak and record the translations on a visual display 6. This speaker is, of course, necessarily knowledgeable in the foreign language to be recorded, unlike the physician/user who is to be the ultimate user of the machine.

When a phrase is presented for translation on display 6, the speaker speaks the translation into microphone 30, from which it is taken and temporarily stored in a temporary storage unit 32 for equivalent spoken foreign language phrases. The recorded phrase is then played back on an audio playout device 34 for the approval of the speaker. The speaker indicates whether or not he approves the translation as played back on manual approval indicator 36. If he does not approve, a re-record control 38 causes the system to accept a new recording of the phrase from the speaker until he gets one he approves. If he does approve of the translation, a transfer control unit 40 causes the temporarily stored phrase from storage unit 32 to be transferred to long-term storage unit 42 for storage as an approved equivalent spoken foreign language phrase.

Referring to FIG. 3, which is a schematic block diagram of an element for use with the device of FIG. 1 for selecting which of a plurality of recorded foreign languages a given respondent/patient is familiar with, foreign language selector 8 is shown in more detail in FIG. 3. When a respondent/patient is first presented for interview, if it is not clear what language the respondent understands, manual control 50 is operated to cause a selector 52 to make an initial selection of samples from a plurality of foreign languages. If, for example, a Navy ship picks up a person of oriental appearance from a raft in the ocean off southeast Asia, the operator might choose a series of languages such as Vietnamese, Laotian, Thai, Burmese, etc., to use in the first attempt to find the language of the respondent. In each language in sequence, selector 52 might ask, in that language, “Do you understand this language? If so, say yes.” These questions would be played out to the respondent from the audio playout device 18 of FIG. 1. When a satisfactory language was arrived at, manual control 50 could be used to operate limiter 54 to limit future translations to the one selected foreign language which had been found satisfactory. While switch 10 is shown as a logical switch connected to sources for two foreign languages, many more foreign languages could be connected. When the foreign languages are stored on CD-ROM, as indicated in FIG. 4, phrases and sentences sufficient to conduct a medical interview in up to twenty-five or thirty different foreign languages can be stored on one CD-ROM disk 60, and, of course, a plurality of such disks can be used interchangeably.

It is perfectly possible to construct a special-purpose device containing all of the digital logic to carry out the functions of this invention. However, from the point of economy and ease of operation, the preferred embodiment of the invention uses a personal computer to carry out the function. The system used by the inventor is configured as follows:

An Austin 433VLI Winstation 486 computer with 20 megabytes RAM, two Maxtor hard disk drives respectively holding 130 megabytes and 220 megabytes, a CD drive and soundboard provided by Soundblaster Pro multimedia kit,,a Colorado Mountain Jumbo tape backup unit, an SVGA monitor, a Diamond Stealth video board with 1 megabyte of RAM, DOS version 5.0, Windows version 3.1, Norton Desktop version 2.0, WavaWav (Wave after Wave) version 1.5 (a shareware utility allowing sequential audio playback without using Windows) which is available from Ben Salido, 660 West Oak St., Hurst, Tex. 76053-5526, WAVE EDITOR version 1.03 (a shareware utility allowing wave editing, which displays waveform, allowing blocking of the part of a waveform to be retained, thereby reducing required memory, and also allowing amplitude adjustment) available from Keith W. Boone, 114 Broward St., Tallahasse, Fla. 32301, Sony SRS 27 speakers, ACE CAT 5-inch tablet for mouse, and Microsoft Visual Basic version 3.0.

Many variations on this configuration would be possible, but this is the configuration used by the inventor, which is known to be operable. The inventor uses computer programs in Visual Basic, operated under Windows, to run the system. Although these programs are made a part of the file of this application as originally filed, they are not considered to be essential to the invention per se. It is within the skill of those skilled in the art to write such programs as needed, and the programs themselves are not intended for printing with a patent resulting from this application.

When the foreign-language speaker is recording the initial translations, the newly recorded material is originally recorded in RAM, then after approval by speaker is transferred to a hard disk. When the complete set of phrases for a given language are successfully recorded, they are “harvested” from the hard disk and combined with sets of phrases from other languages for permanent recording on a CD-ROM disk. Eventually as many different CD-ROM disks as are needed can be used.

It may be advisable to record all the sample questions needed to find the language spoken by the respondent on one disk for all available languages, to reduce the need from frequent switching of disks as the language is located. It is also possible, when operating in an environment where perhaps five or fewer foreign languages will cover all of the potential respondents, to download those languages from a CD-ROM disk to a hard disk of perhaps 80 megabyte capacity, to avoid necessity of carrying a CD-ROM drive in a portable computer.

It is also desirable to provide the ability to keep a medical history by recording and later printing out a record of the questions asked and the physician's contemporaneous recording of the patient's responses to those question. The system also allows recording a series of phrases as used with one patient, then subsequently editing the phrases in the physician's language to derive a suitable set of phrases for use with later similar patients in any available language. This edited version can include comments which were later added by the editing physician to assist later users. Editing can be done by using the Windows integrated utility Notepad, or by using other word processors, or by using the program which has been written in Visual Basic.

Patent Citations
Cited PatentFiling datePublication dateApplicantTitle
US4428733Jul 13, 1981Jan 31, 1984Kumar Misir VictorInformation gathering system
US4493050 *Jul 24, 1981Jan 8, 1985Sharp Kabushiki KaishaElectronic translator having removable voice data memory connectable to any one of terminals
US4593356 *Jul 16, 1981Jun 3, 1986Sharp Kabushiki KaishaElectronic translator for specifying a sentence with at least one key word
US4613944 *Aug 25, 1981Sep 23, 1986Sharp Kabushiki KaishaElectronic translator having removable data memory and controller both connectable to any one of terminals
US4843589Sep 17, 1982Jun 27, 1989Sharp Kabushiki KaishaWord storage device for use in language interpreter
US4882681 *Sep 2, 1987Nov 21, 1989Brotz Gregory RRemote language translating device
US4984177Feb 1, 1989Jan 8, 1991Advanced Products And Technologies, Inc.Voice language translator
US5010495 *Feb 2, 1989Apr 23, 1991American Language AcademyInteractive language learning system
US5056145Jan 22, 1990Oct 8, 1991Kabushiki Kaisha ToshibaDigital sound data storing device
US5063534 *Oct 12, 1989Nov 5, 1991Canon Kabushiki KaishaElectronic translator capable of producing a sentence by using an entered word as a key word
US5065317 *May 24, 1990Nov 12, 1991Sony CorporationLanguage laboratory systems
US5091876Dec 18, 1989Feb 25, 1992Kabushiki Kaisha ToshibaMachine translation system
US5341291 *Mar 8, 1993Aug 23, 1994Arch Development CorporationPortable medical interactive test selector having plug-in replaceable memory
US5375164 *Aug 12, 1992Dec 20, 1994At&T Corp.Voice messaging system
US5384701 *Jun 7, 1991Jan 24, 1995British Telecommunications Public Limited CompanyLanguage translation system
US5523946 *May 5, 1995Jun 4, 1996Xerox CorporationCompact encoding of multi-lingual translation dictionaries
Non-Patent Citations
Reference
1 *Cowart, R., "Mastering Windows 3.1" pp. 516-518 Sybex Inc. 1993.*
2Operator's Guide-Morin Multimedia Medical Translator Release 2.0 (1993) (by the inventor).
3Operator's Guide—Morin Multimedia Medical Translator Release 2.0 (1993) (by the inventor).
4 *Wurst, Brooke E. "PC Interpreter topple the tower of babble. (Evaluation)", Nov. 1992, Computer Shopper, v12, n11, p950(2).*
Referenced by
Citing PatentFiling datePublication dateApplicantTitle
US7949538 *Mar 14, 2007May 24, 2011A-Life Medical, Inc.Automated interpretation of clinical encounters with cultural cues
US8244222May 2, 2005Aug 14, 2012Stephen William Anthony SandersProfessional translation and interpretation facilitator system and method
US8423370Apr 19, 2011Apr 16, 2013A-Life Medical, Inc.Automated interpretation of clinical encounters with cultural cues
US8639829 *May 19, 2010Jan 28, 2014Ebay Inc.System and method to facilitate translation of communications between entities over a network
US8655668Mar 15, 2013Feb 18, 2014A-Life Medical, LlcAutomated interpretation and/or translation of clinical encounters with cultural cues
US8682823Apr 13, 2007Mar 25, 2014A-Life Medical, LlcMulti-magnitudinal vectors with resolution based on source vector features
US8731954Mar 27, 2007May 20, 2014A-Life Medical, LlcAuditing the coding and abstracting of documents
US20100228536 *May 19, 2010Sep 9, 2010Steve GroveSystem and method to facilitate translation of communications between entities over a network
US20110246174 *Jan 21, 2009Oct 6, 2011Geacom, Inc.Method and system for situational language interpretation
Classifications
U.S. Classification704/2
International ClassificationG06F17/28
Cooperative ClassificationG06F17/2836
European ClassificationG06F17/28D6
Legal Events
DateCodeEventDescription
Mar 10, 1994ASAssignment
Owner name: UNITED STATES OF AMERICA, THE, AS REPRESENTED BY T
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MORIN, LEE M. E.;REEL/FRAME:006878/0620
Effective date: 19940217