WO2005008476A3 - Method and system for intelligent prompt control in a multimodal software application - Google Patents

Method and system for intelligent prompt control in a multimodal software application Download PDF

Info

Publication number
WO2005008476A3
WO2005008476A3 PCT/US2004/021696 US2004021696W WO2005008476A3 WO 2005008476 A3 WO2005008476 A3 WO 2005008476A3 US 2004021696 W US2004021696 W US 2004021696W WO 2005008476 A3 WO2005008476 A3 WO 2005008476A3
Authority
WO
WIPO (PCT)
Prior art keywords
software application
prompts
user interface
peripheral devices
prompt control
Prior art date
Application number
PCT/US2004/021696
Other languages
French (fr)
Other versions
WO2005008476A2 (en
Inventor
Arthur Eugene Mcnair
Lawrence R Sweeney
Timothy Joseph Eusterman
Original Assignee
Vocollect Inc
Arthur Eugene Mcnair
Lawrence R Sweeney
Timothy Joseph Eusterman
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vocollect Inc, Arthur Eugene Mcnair, Lawrence R Sweeney, Timothy Joseph Eusterman filed Critical Vocollect Inc
Priority to EP04756716A priority Critical patent/EP1644824A2/en
Priority to JP2006518860A priority patent/JP2007531069A/en
Publication of WO2005008476A2 publication Critical patent/WO2005008476A2/en
Publication of WO2005008476A3 publication Critical patent/WO2005008476A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems

Abstract

Dialog manager and methods for integrating multimodal data capture device inputs or speech recognition inputs with speech output capabilities. A work flow description (208) is extracted from objects in a graphical user interface (86) and a multi-modal user interface (204) is defined. A dialog engine (254) synchronizes the flow of information, in accordance with the work flow description (208), between input/output devices (264) and an application (204). The prompts for inputting data, which are output via a plurality of peripheral devices (266 - 274), are controlled in an intelligent manner by the dialog engine (254) based on the input state of the peripheral devices (266-274). Functionality such as barge-in, prompt-holdoff, priority prompts, and talk-ahead is provided.
PCT/US2004/021696 2003-07-10 2004-07-06 Method and system for intelligent prompt control in a multimodal software application WO2005008476A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP04756716A EP1644824A2 (en) 2003-07-10 2004-07-06 Method and system for intelligent prompt control in a multimodal software application
JP2006518860A JP2007531069A (en) 2003-07-10 2004-07-06 Method and system for intelligent prompt control in multimodal software

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/617,593 US20050010418A1 (en) 2003-07-10 2003-07-10 Method and system for intelligent prompt control in a multimodal software application
US10/617,593 2003-07-11

Publications (2)

Publication Number Publication Date
WO2005008476A2 WO2005008476A2 (en) 2005-01-27
WO2005008476A3 true WO2005008476A3 (en) 2006-01-26

Family

ID=33565007

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2004/021696 WO2005008476A2 (en) 2003-07-10 2004-07-06 Method and system for intelligent prompt control in a multimodal software application

Country Status (4)

Country Link
US (1) US20050010418A1 (en)
EP (1) EP1644824A2 (en)
JP (1) JP2007531069A (en)
WO (1) WO2005008476A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8933791B2 (en) 2010-07-22 2015-01-13 Vocollect, Inc. Method and system for correctly identifying specific RFID tags

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6910911B2 (en) 2002-06-27 2005-06-28 Vocollect, Inc. Break-away electrical connector
US8311835B2 (en) * 2003-08-29 2012-11-13 Microsoft Corporation Assisted multi-modal dialogue
US20060253272A1 (en) * 2005-05-06 2006-11-09 International Business Machines Corporation Voice prompts for use in speech-to-speech translation system
US20070080930A1 (en) * 2005-10-11 2007-04-12 Logan James R Terminal device for voice-directed work and information exchange
JP4197344B2 (en) * 2006-02-20 2008-12-17 インターナショナル・ビジネス・マシーンズ・コーポレーション Spoken dialogue system
US8311836B2 (en) * 2006-03-13 2012-11-13 Nuance Communications, Inc. Dynamic help including available speech commands from content contained within speech grammars
US20080180218A1 (en) * 2006-11-07 2008-07-31 Flax Stephen W Bi-Modal Remote Identification System
US20080130528A1 (en) * 2006-12-01 2008-06-05 Motorola, Inc. System and method for barging in a half-duplex communication system
US8612230B2 (en) * 2007-01-03 2013-12-17 Nuance Communications, Inc. Automatic speech recognition with a selection list
US9307029B2 (en) * 2007-02-12 2016-04-05 Broadcom Corporation Protocol extensions for generic advisory information, remote URL launch, and applications thereof
US7801728B2 (en) * 2007-02-26 2010-09-21 Nuance Communications, Inc. Document session replay for multimodal applications
US8635069B2 (en) 2007-08-16 2014-01-21 Crimson Corporation Scripting support for data identifiers, voice recognition and speech in a telnet session
DE102007050127A1 (en) * 2007-10-19 2009-04-30 Daimler Ag Method and device for testing an object
USD626949S1 (en) 2008-02-20 2010-11-09 Vocollect Healthcare Systems, Inc. Body-worn mobile device
US20090216534A1 (en) * 2008-02-22 2009-08-27 Prakash Somasundaram Voice-activated emergency medical services communication and documentation system
US8856009B2 (en) * 2008-03-25 2014-10-07 Intelligent Mechatronic Systems Inc. Multi-participant, mixed-initiative voice interaction system
US20100057505A1 (en) * 2008-08-27 2010-03-04 International Business Machines Corporation Business process community input
US20100077458A1 (en) * 2008-09-25 2010-03-25 Card Access, Inc. Apparatus, System, and Method for Responsibility-Based Data Management
US8386261B2 (en) * 2008-11-14 2013-02-26 Vocollect Healthcare Systems, Inc. Training/coaching system for a voice-enabled work environment
GB2468340A (en) * 2009-03-04 2010-09-08 Global Refund Holdings Ab Validation of tax refunds
JP4824793B2 (en) * 2009-07-06 2011-11-30 東芝テック株式会社 Wearable terminal device and program
US20110154291A1 (en) * 2009-12-21 2011-06-23 Mozes Incorporated System and method for facilitating flow design for multimodal communication applications
USD643400S1 (en) 2010-08-19 2011-08-16 Vocollect Healthcare Systems, Inc. Body-worn mobile device
USD643013S1 (en) 2010-08-20 2011-08-09 Vocollect Healthcare Systems, Inc. Body-worn mobile device
US9600135B2 (en) 2010-09-10 2017-03-21 Vocollect, Inc. Multimodal user notification system to assist in data capture
US9489940B2 (en) 2012-06-11 2016-11-08 Nvoq Incorporated Apparatus and methods to update a language model in a speech recognition system
US9430420B2 (en) 2013-01-07 2016-08-30 Telenav, Inc. Computing system with multimodal interaction mechanism and method of operation thereof
US20140195968A1 (en) * 2013-01-09 2014-07-10 Hewlett-Packard Development Company, L.P. Inferring and acting on user intent
US9076459B2 (en) 2013-03-12 2015-07-07 Intermec Ip, Corp. Apparatus and method to classify sound to detect speech
US9870357B2 (en) * 2013-10-28 2018-01-16 Microsoft Technology Licensing, Llc Techniques for translating text via wearable computing device
US10846112B2 (en) * 2014-01-16 2020-11-24 Symmpl, Inc. System and method of guiding a user in utilizing functions and features of a computer based device
US11043206B2 (en) 2017-05-18 2021-06-22 Aiqudo, Inc. Systems and methods for crowdsourced actions and commands
US11056105B2 (en) * 2017-05-18 2021-07-06 Aiqudo, Inc Talk back from actions in applications
US11520610B2 (en) 2017-05-18 2022-12-06 Peloton Interactive Inc. Crowdsourced on-boarding of digital assistant operations
US10838746B2 (en) 2017-05-18 2020-11-17 Aiqudo, Inc. Identifying parameter values and determining features for boosting rankings of relevant distributable digital assistant operations
US11340925B2 (en) 2017-05-18 2022-05-24 Peloton Interactive Inc. Action recipes for a crowdsourced digital assistant system
WO2019152511A1 (en) 2018-01-30 2019-08-08 Aiqudo, Inc. Personalized digital assistant device and related methods
US11423215B2 (en) * 2018-12-13 2022-08-23 Zebra Technologies Corporation Method and apparatus for providing multimodal input data to client applications
EP4248302A1 (en) * 2020-11-23 2023-09-27 NLX, Inc. Method for multi-channel audio synchronization for task automation
US11915694B2 (en) 2021-02-25 2024-02-27 Intelligrated Headquarters, Llc Interactive voice system for conveyor control

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5892813A (en) * 1996-09-30 1999-04-06 Matsushita Electric Industrial Co., Ltd. Multimodal voice dialing digital key telephone with dialog manager
WO2002069320A2 (en) * 2001-02-28 2002-09-06 Vox Generation Limited Spoken language interface
US6504914B1 (en) * 1997-06-16 2003-01-07 Deutsche Telekom Ag Method for dialog control of voice-operated information and call information services incorporating computer-supported telephony

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5010495A (en) * 1989-02-02 1991-04-23 American Language Academy Interactive language learning system
US5012511A (en) * 1990-04-06 1991-04-30 Bell Atlantic Network Services, Inc. Method of and system for control of special services by remote access
US5386494A (en) * 1991-12-06 1995-01-31 Apple Computer, Inc. Method and apparatus for controlling a speech recognition function using a cursor control device
JP3286339B2 (en) * 1992-03-25 2002-05-27 株式会社リコー Window screen control device
IT1256823B (en) * 1992-05-14 1995-12-21 Olivetti & Co Spa PORTABLE CALCULATOR WITH VERBAL NOTES.
US5748841A (en) * 1994-02-25 1998-05-05 Morin; Philippe Supervised contextual language acquisition system
US5890123A (en) * 1995-06-05 1999-03-30 Lucent Technologies, Inc. System and method for voice controlled video screen display
US5903870A (en) * 1995-09-18 1999-05-11 Vis Tell, Inc. Voice recognition and display device apparatus and method
US5812977A (en) * 1996-08-13 1998-09-22 Applied Voice Recognition L.P. Voice control computer interface enabling implementation of common subroutines
US5909667A (en) * 1997-03-05 1999-06-01 International Business Machines Corporation Method and apparatus for fast voice selection of error words in dictated text
US5884265A (en) * 1997-03-27 1999-03-16 International Business Machines Corporation Method and system for selective display of voice activated commands dialog box
CA2292959A1 (en) * 1997-05-06 1998-11-12 Speechworks International, Inc. System and method for developing interactive speech applications
US5991726A (en) * 1997-05-09 1999-11-23 Immarco; Peter Speech recognition devices
JPH10340180A (en) * 1997-06-06 1998-12-22 Olympus Optical Co Ltd Voice data processing controller and recording medium recording control program to control voice data processing
US6246989B1 (en) * 1997-07-24 2001-06-12 Intervoice Limited Partnership System and method for providing an adaptive dialog function choice model for various communication devices
US5956675A (en) * 1997-07-31 1999-09-21 Lucent Technologies Inc. Method and apparatus for word counting in continuous speech recognition useful for reliable barge-in and early end of speech detection
US6044347A (en) * 1997-08-05 2000-03-28 Lucent Technologies Inc. Methods and apparatus object-oriented rule-based dialogue management
US5950167A (en) * 1998-01-26 1999-09-07 Lucent Technologies Inc. Screen-less remote voice or tone-controlled computer program operations via telephone set
US6233559B1 (en) * 1998-04-01 2001-05-15 Motorola, Inc. Speech control of multiple applications using applets
US6012030A (en) * 1998-04-21 2000-01-04 Nortel Networks Corporation Management of speech and audio prompts in multimodal interfaces
US6438523B1 (en) * 1998-05-20 2002-08-20 John A. Oberteuffer Processing handwritten and hand-drawn input and speech input
US6434526B1 (en) * 1998-06-29 2002-08-13 International Business Machines Corporation Network application software services containing a speech recognition capability
US6185535B1 (en) * 1998-10-16 2001-02-06 Telefonaktiebolaget Lm Ericsson (Publ) Voice control of a user interface to service applications
US6243682B1 (en) * 1998-11-09 2001-06-05 Pitney Bowes Inc. Universal access photocopier
US6233560B1 (en) * 1998-12-16 2001-05-15 International Business Machines Corporation Method and apparatus for presenting proximal feedback in voice command systems
US6321198B1 (en) * 1999-02-23 2001-11-20 Unisys Corporation Apparatus for design and simulation of dialogue
US6424357B1 (en) * 1999-03-05 2002-07-23 Touch Controls, Inc. Voice input system and method of using same
US7216351B1 (en) * 1999-04-07 2007-05-08 International Business Machines Corporation Systems and methods for synchronizing multi-modal interactions
GB9930731D0 (en) * 1999-12-22 2000-02-16 Ibm Voice processing apparatus
JP3705735B2 (en) * 2000-08-29 2005-10-12 シャープ株式会社 On-demand interface device and its window display device
DE60133529T2 (en) * 2000-11-23 2009-06-10 International Business Machines Corp. Voice navigation in web applications
US7487440B2 (en) * 2000-12-04 2009-02-03 International Business Machines Corporation Reusable voiceXML dialog components, subdialogs and beans
US7257537B2 (en) * 2001-01-12 2007-08-14 International Business Machines Corporation Method and apparatus for performing dialog management in a computer conversational interface
US6915258B2 (en) * 2001-04-02 2005-07-05 Thanassis Vasilios Kontonassios Method and apparatus for displaying and manipulating account information using the human voice
GB2378776A (en) * 2001-05-22 2003-02-19 Canon Kk Apparatus and method for managing a multi-modal interface in which the inputs feedback on each other
US7003464B2 (en) * 2003-01-09 2006-02-21 Motorola, Inc. Dialog recognition and control in a voice browser

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5892813A (en) * 1996-09-30 1999-04-06 Matsushita Electric Industrial Co., Ltd. Multimodal voice dialing digital key telephone with dialog manager
US6504914B1 (en) * 1997-06-16 2003-01-07 Deutsche Telekom Ag Method for dialog control of voice-operated information and call information services incorporating computer-supported telephony
WO2002069320A2 (en) * 2001-02-28 2002-09-06 Vox Generation Limited Spoken language interface

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
YOICHI TAKEBAYASHI: "SPONTANEOUS SPEECH DIOLOGUE SYSTEM TOSBURG II-THE USER-CENTERED MULTIMODAL INTERFACE", SYSTEMS & COMPUTERS IN JAPAN, WILEY, HOBOKEN, NJ, US, vol. 26, no. 14, 15 November 1995 (1995-11-15), pages 77 - 91, XP000551716, ISSN: 0882-1666 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8933791B2 (en) 2010-07-22 2015-01-13 Vocollect, Inc. Method and system for correctly identifying specific RFID tags
US9449205B2 (en) 2010-07-22 2016-09-20 Vocollect, Inc. Method and system for correctly identifying specific RFID tags

Also Published As

Publication number Publication date
WO2005008476A2 (en) 2005-01-27
JP2007531069A (en) 2007-11-01
US20050010418A1 (en) 2005-01-13
EP1644824A2 (en) 2006-04-12

Similar Documents

Publication Publication Date Title
WO2005008476A3 (en) Method and system for intelligent prompt control in a multimodal software application
WO2005008465A3 (en) Method and system for integrating multi-modal data capture device inputs with multi-modal output capabilities
WO2006062620A3 (en) Method and system for generating input grammars for multi-modal dialog systems
CN101484934B (en) Method and device for the natural-language recognition of a vocal expression
RU2653283C2 (en) Method for dialogue between machine, such as humanoid robot, and human interlocutor, computer program product and humanoid robot for implementing such method
AU2003215226A1 (en) Voice-controlled data entry
WO2005041033A3 (en) Method and apparatus for a hierarchical object model-based constrained language interpreter-parser
AU2003215239A8 (en) Voice-controlled user interfaces
WO2008042121A3 (en) Systems and methods for secure voice identification and medical device interface
JPH07191715A (en) Method for execution of position-dependent language command and computer control system
ATE410768T1 (en) SYSTEM AND METHOD FOR OPERATING A VOICE RECOGNITION SYSTEM IN A VEHICLE
WO2002054033A3 (en) Hierarchical language models for speech recognition
WO2004061820A3 (en) Method and apparatus for selective distributed speech recognition
KR102221513B1 (en) Voice emotion recognition method and system
CN107018228B (en) Voice control system, voice processing method and terminal equipment
CN101923857A (en) Extensible audio recognition method based on man-machine interaction
Vajpai et al. Industrial applications of automatic speech recognition systems
CN103591947B (en) The voice background navigation method of mobile terminal and mobile terminal
WO2003023572A3 (en) Device for providing voice driven control of a media presentation
WO2002077790A3 (en) Information processing apparatus and method, and program
CN105225665A (en) A kind of audio recognition method and speech recognition equipment
KR20190068021A (en) User adaptive conversation apparatus based on monitoring emotion and ethic and method for thereof
EP1063635A3 (en) Method and apparatus for improving speech command recognition accuracy using event-based constraints
WO2002073600A1 (en) Method and processor system for processing of an audio signal
US6757656B1 (en) System and method for concurrent presentation of multiple audio information sources

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2004756716

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2006518860

Country of ref document: JP

WWP Wipo information: published in national office

Ref document number: 2004756716

Country of ref document: EP