|Publication number||US6337629 B1|
|Application number||US 09/540,902|
|Publication date||Jan 8, 2002|
|Filing date||Mar 31, 2000|
|Priority date||Sep 14, 1999|
|Publication number||09540902, 540902, US 6337629 B1, US 6337629B1, US-B1-6337629, US6337629 B1, US6337629B1|
|Original Assignee||Biosys Ab|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (19), Referenced by (31), Classifications (13), Legal Events (9)|
|External Links: USPTO, USPTO Assignment, Espacenet|
The present invention relates to a method and a system for monitoring a person. In particular the present invention relates to a method and a system for monitoring drowsiness of a person performing a task where it is important to be awake, such as a person driving a car, monitoring personnel in a nuclear power plant or in a radar office, or a pilot.
In today's traffic, there is a problem relating to people driving vehicles despite the fact that they are too tired, sleepy or drowsy in order to safely drive their vehicle. In particular, during longer journeys, a person may start the journey in good shape and then as times goes being more and more drowsy, and, in the worst case, finally go to sleep. Such a scenario is of course highly undesirable, since it poses a great threat to both the driver and persons around him/her, such as other drivers or passengers in vehicles on the same road.
Also, it is known that when a person becomes drowsy, the eyelid and pupil movement pattern changes. Furthermore, in WO/33403 a method where the corresponding relationship between cardiac and respiratory functions are used in order to detect a condition of drowsiness.
It is an object of the present invention to provide a method and a system, which have an improved reliability over the prior art. It is also an object of the present invention to provide a method and a system, which is more robust and user friendly compared to the methods according to the prior art.
This object is obtained by means of monitoring the autonomic nervous system, and in particular parameters reflecting the current condition of the autonomic nervous system. Thus, by means of intensive research it has been possible to show that it is in fact a change in state in the autonomic nervous system that causes the body to change certain patterns in, for example, eye movements. Thus, changes in activities in the autonomic nervous system are reflected by changes in behaviour of certain physiological parameters.
In a preferred embodiment the method and system comprise continuous recording of at least one parameter reflecting the current state of the autonomic nervous system, such as a parameter reflecting cardiac activity. If a trend in the monitored parameter fulfils a certain criteria or certain conditions, such as slowing down of the activity, a first alarm level is triggered by the system. At the first alarm level a second parameter reflecting the autonomic nervous system can be monitored in addition of the first parameter, such as body motor activity or respiratory activity. If both the monitored parameters exceed a pre-set threshold value an alarm is generated indicating that there is a risk that the person may fall to sleep. In this manner a multi-step threshold model is formed, which is used to indicate a potential risk of falling asleep.
When such an alarm is generated a number of different actions can be taken. For example, a light or sound signal can be generated, an air puff, or another change in the physical environment, or a vibrator located in the seat where the person is seated can be activated.
The invention relics on the fact that extensive studies have shown that the autonomic nervous system reflects the wakefulness level of a person. Thus, by monitoring a parameter, which reflects the current state of the autonomic nervous system, a lower level of wakefulness can be detected. One such parameter, which has been found to indicate such a state, is cardiac oscillation. Thus, the autonomic nervous system affect the heartbeat of a person falling to sleep in such a way that the heartbeat will go through a series of acceleration and de-acceleration.
The present invention will now be described in more detail and with reference to the accompanying drawings, in which:
FIG. 1 is a general view of a person driving a car.
FIG. 2 is a flowchart illustrating different steps carried out when detecting a condition of drowsiness.
FIG. 3 is a more detailed flow chart.
In FIG. 1 a driver 403 in a vehicle 404 is shown. In the vehicle 404 a seat 406 and a safety belt 405 are provided. The seat 406 and the safety belt 405 are provided with sensors 401. The sensors 401 are adapted to sense physiological parameters from a person, such as the driver 403, sitting in the seat 406.
For example, the sensors may output signals corresponding to respiration, cardiac activity and body movements from the driver. The sensors can be of any kind and are preferably of a conventional type, such as PVF type sensors. The sensors are connected to a data collecting computer unit 402. The unit 402 is operated by software, which uses the input data from the sensors for determining if the driver risk falling asleep. The procedure steps carried out in the unit 402 are described in more detail below in conjunction with FIG. 2.
The computer unit 402 is connected to an alarm-generating unit 407. The alarm unit can comprise several different alarm-generating devices. For example, the unit 407 can comprise a siren, a light emitting device, a vibrator etc. If the alarm unit is connected to a vibrator the vibrator can be located in the seat 406 or at some other suitable location. The object of the alarm unit is to indicate to the driver when he/she risks falling asleep, and thereby preventing that the driver become drowsy or falls asleep, which can have serious consequences. For example the alarm can activate the vehicle such as by means of slowing down the speed of the vehicle.
FIG. 2 and FIG. 3 show flowcharts illustrating different steps carried out by the software in the computer unit 402 for monitoring the driver 403 is shown. The software in the unit 402 continuously updates a first physiological parameter, such as a parameter corresponding to cardiac activity, and in particular the time interval between successive heartbeats.
In the case when the first physiological parameter monitored by the computer unit 402 is the time interval between successive heartbeats, the following process steps can be carried out by the software. First, in a step 201, 201′, a mean value of the time between successive heartbeats during a first time interval window is calculated. The first window can have any duration, but in a preferred embodiment, the first time interval window is in the range of 1-20 seconds and in particular in the range of 5-10 seconds.
Next, in a step 203, 203′, a trend in the mean value as calculated in step 201 is read. The trend can, for example, be derived by means of during a second time interval window, being longer than the first time interval window, and continuously recording the changes in the value obtained in the second window. The duration of the second window can for example be in the range 1-10 minutes , and in particular in the range 1-3 minutes. In the example given here the duration of the second window is 2 minutes and is updated every 6 second.
In the example given here, where cardiac activity continuously is recorded, the trend in the derived windowed mean value for successive heartbeats is monitored. If the trend exceeds one or several threshold values, the procedure continues to the step 207, and else the procedure returns to the step 201, as is indicated in the step 205, 205′.
The threshold value in step 203 can, for example, be set so that if the mean value between successive heartbeats is continuously increasing during a pre-set time interval, the threshold value is exceeded. Other possibilities for the threshold value include zero-crossing and slope values.
The object of setting the threshold value is to detect acceleration in cardiac activity, and in particular to detect a state of successive accelerations and de-accelerations. A pattern corresponding to successive accelerations and de-accelerations is used to indicate that the driver is falling asleep and in order to prevent this an alarm is triggered.
In order to prevent that a false alarm is triggered, the following additional process steps are preferably executed. In the step 207, 207′ recording of one or several additional parameter(s) is activated. The additional parameter(s) can be additional physiological parameters, such as respiratory pattern (amplitude and frequency variations) or body motor activity, or other parameters. In the example described herein the additional parameters are physiological parameters. However, it is possible to record physical parameters as well. For example, the vehicle position on the road can be recorded or steering wheel movements can be recorded. Also, it is possible to adjust the alarm levels to different levels for different individuals, in order to further prevent triggering of an alarm at an incorrect time.
If the recorded additional parameters also indicate the same fact, i.e. that it is likely that the autonomic nervous system is in a state where the person is drowsy, the alarm generating unit is activated in a process step 209, 209′. The activation of the alarm is performed in order to indicate to the driver that there is a risk of falling asleep. If it is decided that the driver is not likely to fall asleep the process returns to the step 201 as is indicated in step 208.
The alarm generating unit can comprise audio and/or light signals, and means for generating environment conditioning signals. Also a vibrator can be located in the driver seat or the unit can trigger a change in temperature.
Use of the system and method as described herein achieves an improved monitoring of a person whom should stay awake and alert, such as for example a driver of a vehicle, a pilot or a person supervising an industrial process such as supervising personnel at a nuclear power plant. The system can be made very robust and insensitive to minor variations in the physiological parameters monitored by the system and used as input data to the method executing the steps for determining if the monitored person is drowsy or risks falling asleep. Thus, the system is adapted to prevent triggering a false alarm. Also, in order to even further ensure that the triggering of a false alarm is avoided, several parameters can be monitored, both physical and physiological, in the event that a first monitored parameter indicates that the alarm should be triggered. The logic for correlating the outcome of different monitored parameter can either be formed by different logic block or by one single logic block evaluating the combined signal from the different monitored parameters.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4569536||Jul 3, 1984||Feb 11, 1986||Noboru Tsuge||Seat belt system|
|US4889131 *||Dec 20, 1988||Dec 26, 1989||American Health Products, Inc.||Portable belt monitor of physiological functions and sensors therefor|
|US5232243||Apr 9, 1991||Aug 3, 1993||Trw Vehicle Safety Systems Inc.||Occupant sensing apparatus|
|US5311197||Feb 1, 1993||May 10, 1994||Trimble Navigation Limited||Event-activated reporting of vehicle location|
|US5474327||Jan 10, 1995||Dec 12, 1995||Delco Electronics Corporation||Vehicle occupant restraint with seat pressure sensor|
|US5488353||Jan 4, 1994||Jan 30, 1996||Mitsubishi Jidosha Kogyo Kabushiki Kaisha||Apparatus and method for improving the awareness of vehicle drivers|
|US5511553 *||Oct 28, 1994||Apr 30, 1996||Segalowitz; Jacob||Device-system and method for monitoring multiple physiological parameters (MMPP) continuously and simultaneously|
|US5515858 *||Feb 26, 1993||May 14, 1996||Myllymaeki; Matti||Wrist-held monitoring device for physical condition|
|US5612876||Mar 3, 1995||Mar 18, 1997||Mercedes-Benz Ag||Device for detecting seat occupancy in a motor vehicle|
|US5724024||Jun 1, 1994||Mar 3, 1998||Vos Verkehrs-Optimierungs-Systems Gmbh & Co.||Device for detecting the presence of persons on seats|
|US5749907 *||Feb 18, 1997||May 12, 1998||Pacesetter, Inc.||System and method for identifying and displaying medical data which violate programmable alarm conditions|
|US5813989||Nov 15, 1995||Sep 29, 1998||Pioneer Electronic Corporation||Driving mental condition detecting apparatus|
|US5846206||Jun 1, 1995||Dec 8, 1998||Biosys Ab||Method and apparatus for monitoring and estimating the awakeness of a person|
|US5853005 *||May 2, 1996||Dec 29, 1998||The United States Of America As Represented By The Secretary Of The Army||Acoustic monitoring system|
|US5964720 *||Nov 26, 1997||Oct 12, 1999||Adaptivity Devices Ltd.||Method and system for monitoring the physiological condition of a patient|
|DE4406897A||Title not available|
|EP0560351B1||Mar 11, 1993||Dec 29, 1997||Matsushita Electric Industrial Co., Ltd.||Presence detecting and safety control apparatus|
|GB2289332A||Title not available|
|WO1995000368A1||Jun 1, 1994||Jan 5, 1995||Vos Verkehrs-Optimierungs-Systeme Gmbh & Co. Kg||Device for detecting the presence of persons on seats|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7415297||Mar 8, 2005||Aug 19, 2008||Masimo Corporation||Physiological parameter system|
|US7496457 *||Mar 22, 2005||Feb 24, 2009||Delta Tooling Co., Ltd.||Load body state judging device, vehicle seat and computer program|
|US7663474||Feb 16, 2010||Gianni Arcaini||Method and apparatus for automatic noninvasive illegal rider detection system|
|US7982618 *||Jul 19, 2011||Denso Corporation||Wakefulness maintaining apparatus and method of maintaining wakefulness|
|US8556020 *||Jan 26, 2012||Oct 15, 2013||Paragon Ag||Motor-vehicle seat belt with built-in electronics|
|US8698639||Feb 18, 2011||Apr 15, 2014||Honda Motor Co., Ltd.||System and method for responding to driver behavior|
|US8721542||Aug 7, 2008||May 13, 2014||Masimo Corporation||Physiological parameter system|
|US8823792 *||Apr 23, 2009||Sep 2, 2014||Toyota Jidosha Kabushiki Kaisha||Wakefulness level estimation apparatus|
|US8979761 *||May 26, 2010||Mar 17, 2015||Nagoya City University||Sleepiness assessment apparatus|
|US9198523 *||Jun 28, 2005||Dec 1, 2015||Terry Cassaday||Chair or bed member having data storage|
|US9292471||Mar 15, 2013||Mar 22, 2016||Honda Motor Co., Ltd.||Coordinated vehicle response system and method for driver behavior|
|US9296382||Mar 15, 2013||Mar 29, 2016||Honda Motor Co., Ltd.||System and method for responding to driver behavior|
|US9440646||Aug 18, 2014||Sep 13, 2016||Honda Motor Co., Ltd.||System and method for responding to driver behavior|
|US20030199943 *||Apr 17, 2002||Oct 23, 2003||Orly Katz||Method and device for maintaining wakefulness and preventing undesired sleep|
|US20050203352 *||Mar 8, 2005||Sep 15, 2005||Ammar Al-Ali||Physiological parameter system|
|US20050240108 *||Jun 28, 2005||Oct 27, 2005||Terry Cassaday||Chair or bed member having data storage|
|US20060290516 *||Apr 29, 2004||Dec 28, 2006||Koninklijke Philips Electronics N.V.||Distress signaling system, a body area network for anabling a distress signaling, method for signaling a condition of a distress and a vehicle arranged witha distress signaling system|
|US20070208241 *||Jan 30, 2007||Sep 6, 2007||Marc Drucker||Vital Sign Sensing Device|
|US20070299636 *||Mar 22, 2005||Dec 27, 2007||Delta Tooling Co., Ltd.||Load Body State Judging Device, Vehicle Seat And Computer Program|
|US20080180257 *||Nov 30, 2007||Jul 31, 2008||Denso Corporation||Wakefulness maintaining apparatus and method of maintaining wakefulness|
|US20080300471 *||Aug 7, 2008||Dec 4, 2008||Masimo Corporation||Physiological parameter system|
|US20090268022 *||Oct 29, 2009||Toyota Jidosha Kabushiki Kaisha||Wakefulness level estimation apparatus|
|US20100168591 *||Dec 23, 2009||Jul 1, 2010||Industrial Technology Research Institute||Drowsiness detection method and apparatus thereof|
|US20120078122 *||May 26, 2010||Mar 29, 2012||Nagoya City University||Sleepiness assessment apparatus|
|CN102602358A *||Dec 28, 2011||Jul 25, 2012||帕拉贡股份公司||Safety belt for motor vehicles, has safety belt with hose section that extends in longitudinal direction in which electrical or electronic unit of seat belt is inserted|
|DE102007060696B4 *||Dec 17, 2007||Feb 4, 2016||Denso Corporation||Vorrichtung und Verfahren zur Aufrechterhaltung eines Wachzustands|
|DE102011113100A1 *||Sep 9, 2011||Mar 14, 2013||Volkswagen Aktiengesellschaft||Method for detection of ballistocardiogenic or respiratory-caused movements of person on motor vehicle seat, involves designing sensor as ballistographic sensor for detection of ballistocardiogenic or respiratory-caused movements of person|
|EP1665188A1 *||Mar 29, 2004||Jun 7, 2006||David Cohen||Emergency situation detector|
|EP2204119A1 *||Dec 23, 2009||Jul 7, 2010||Industrial Technology Research Institute||Drowsiness detection method and apparatus thereof|
|WO2005087097A1 *||Mar 8, 2005||Sep 22, 2005||Masimo Corporation||Physiological parameter system|
|WO2012112300A1 *||Jan 31, 2012||Aug 23, 2012||Honda Motor Co., Ltd.||System and method for responding to driver behavior|
|U.S. Classification||340/576, 600/484, 340/575|
|International Classification||A61B5/18, G08B21/06, A61B5/0205|
|Cooperative Classification||G08B21/06, A61B5/18, A61B5/0205, A61B5/4035|
|European Classification||A61B5/18, G08B21/06, A61B5/0205|
|Jun 23, 2000||AS||Assignment|
Owner name: BIOSYS AB, SWEDEN
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BADER, GABY;REEL/FRAME:010877/0460
Effective date: 20000410
|Jun 9, 2005||FPAY||Fee payment|
Year of fee payment: 4
|Apr 13, 2006||AS||Assignment|
Owner name: HEALTH CARE INTERNATIONAL CONSULTING BADR AKTIEBOL
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BIOSYS AB;REEL/FRAME:017776/0923
Effective date: 20060327
|Jul 20, 2009||REMI||Maintenance fee reminder mailed|
|Jan 7, 2010||SULP||Surcharge for late payment|
Year of fee payment: 7
|Jan 7, 2010||FPAY||Fee payment|
Year of fee payment: 8
|Aug 16, 2013||REMI||Maintenance fee reminder mailed|
|Jan 8, 2014||LAPS||Lapse for failure to pay maintenance fees|
|Feb 25, 2014||FP||Expired due to failure to pay maintenance fee|
Effective date: 20140108