|Publication number||US5890083 A|
|Application number||US 08/612,288|
|Publication date||Mar 30, 1999|
|Filing date||Mar 7, 1996|
|Priority date||Mar 7, 1995|
|Also published as||DE19507956A1, DE19507956C2|
|Publication number||08612288, 612288, US 5890083 A, US 5890083A, US-A-5890083, US5890083 A, US5890083A|
|Inventors||Uwe Franke, Stefan Hahn|
|Original Assignee||Daimler Benz Ag|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (15), Non-Patent Citations (4), Referenced by (72), Classifications (24), Legal Events (6)|
|External Links: USPTO, USPTO Assignment, Espacenet|
The invention relates to an apparatus for determining the distance of a vehicle from at least one roadway side marking and, more particularly, to an apparatus for determining the distance of a vehicle from a roadway side marking having an arrangement, fitted to the vehicle, of light-sensitive sensor elements for optically scanning a portion of the roadway located in front of the vehicle. The sensor element arrangement includes at least two sensor element lines, each of which scans a strip of the roadway which runs in front of the vehicle and is not parallel to the vehicle longitudinal axis, and extends laterally as far as the roadway side marking. An evaluation unit, which is connected downstream of the sensor element arrangement, reads each sensor element line sequentially and further processes the received signals for determining the lateral distance of the vehicle from the roadway marking.
An apparatus for determining the vehicle distance from a roadway side marking may be used, in particular, as a so-called sleep warning system, that is to say as a system which emits an acoustic or haptic warning if the vehicle threatens to leave the roadway and, therefore, to travel over a roadway side marking due for example to a faulty steering reaction of a tired or distracted driver.
In European Patent documents, EP 0 586 857 A1 and EP 0 361 914 A2, as well as in U.S. Pat. No. 4,970,653, the sensor element arrangement, in each case, comprises a two-dimensional sensor element array of an image recording camera. The array is arranged in the front portion of the associated vehicle, pointing to the front, in order to optically scan a specific portion of the roadway area in front of the vehicle. The image information obtained from the camera is further processed in an analog manner, for example by nonlinear resistance networks, in order to generate a binary image pattern of the roadway markings. By means of known techniques, such as Hough transformation and Kalman filtering, the parameters which are relevant for determining the distance are extracted therefrom by a microprocessor.
The conventional use of image recording cameras having a two-dimensional sensor element array in the form of a CCD array analog requires further processing of the sensor data for use in a vehicle, since digital real-time data processing of the high data rates from such a two-dimensional sensor element array cannot be managed in a satisfactory manner by microprocessors normally used nowadays in the motor vehicle.
An apparatus of the above-mentioned type is known from U.S. Pat. No. 4,630,109, in which the sensor element arrangement includes one or two sensor element lines. For the case of only one sensor element line, the associated scanned strip of the roadway lies symmetrically in relation to the vehicle longitudinal center as a result of central positioning of a CCD camera. As an alternative, the use of two cameras arranged at the side is proposed, each of the cameras scanning a strip of the roadway. In the latter case, the two scanned lateral strips of roadway are located in the direction of the vehicle longitudinal axis at the same height in front of the vehicle and in each case extend approximately from the vehicle longitudinal center as far as beyond the relevant vehicle lateral region.
The European Patent document EP 0 640 903 A1 discloses an apparatus for determining the distance of a vehicle from at least one roadway side marking in which a portion of the roadway, typically extending to the front of the vehicle as far as 60 m, is optically scanned. An evaluation unit which is connected downstream evaluates the video image with respect to roadway markings which are present, and is equipped for the purpose of applying suitable forces to the steering mechanism of the vehicle. These forces are intended to facilitate the driver's staying in the roadway lane. In addition, a warning apparatus is provided which, in the event of the threatened crossing of a roadway marking, in a first stage emits an optical and haptic warning in the form of a steering wheel vibration and, in a second stage, emits an acoustic warning message to the driver.
The invention is based on solving the technical problems to provide an apparatus of the above-mentioned type which, on the one hand, makes possible reliable determination of the distance of the vehicle from roadway side markings and, on the other hand, requires only a comparatively low data processing outlay. This in particular would also readily allow digital processing of the sensor data in real time in a microprocessor in the vehicle. The apparatus would also be capable, if necessary, of producing an effective warning signal against a threatened crossing of a roadway marking.
These problems are solved by apparatus for determining the distance of a vehicle from a roadway side marking having an arrangement, fitted to the vehicle, of light-sensitive sensor elements for optically scanning a portion of the roadway located in front of the vehicle. The sensor element arrangement includes at least two sensor element lines, each of which scans a strip of the roadway which runs in front of the vehicle and is not parallel to the vehicle longitudinal axis, and extends laterally as far as the roadway side marking. An evaluation unit, which is connected downstream of the sensor element arrangement, reads each sensor element line sequentially and further processes the received signals for determining the lateral distance of the vehicle from the roadway marking. The sensor element arrangement contains two sensor element lines which scan two strips of the roadway which are spaced apart from each other in the direction of the vehicle longitudinal axis. A warning signal-producing apparatus is provided having loudspeakers which are fitted to the side in the vehicle interior, via which in the case of the threatened crossing of a roadway marking, detected by the evaluation unit, an artificially produced rumble strip noise is emitted in a side-specific manner on that side of the vehicle which threatens to cross the roadway marking.
Characteristically, in this case the sensor element arrangement comprises only one or a few sensor element lines, and not a normal two-dimensional sensor element array. This considerably reduces the quantity of data to be processed in real time by the evaluation unit connected downstream, so that this sensor data processing can be carried out digitally by a conventional microprocessor system which can be fitted in the vehicle without difficulty. Of course, analogue processing of the sensor data is further also contemplated as an alternative. The placing of the sensor element lines in such a way that they each scan a strip of roadway which is not parallel to the vehicle longitudinal axis, runs in front of the vehicle and extends laterally as far as the roadway markings, ensures that the roadway markings are reliably detected optically and can be recognized by the evaluation unit. This is done so that the latter can determine the lateral distances of the vehicle from the roadway markings.
Additionally, as a result of the use of a second sensor element line which scans a second strip of the roadway which is located at a predetermined distance parallel and in front of the first strip of the roadway scanned by the first sensor element line, the apparatus specifically permits verification of the measurement results of the one sensor element line by the respective other one, as well as automatic calibration of the entire system in respect of measurement of the angular error between the vehicle longitudinal axis and the optical axis.
A convenient sleep warning or lane guard function is realized specifically by the apparatus according to the invention in that an acoustic warning in the form of a so-called rumble strip noise is emitted in a side-specific manner in each case on that side of the vehicle on which the vehicle threatens to leave the lane. The rumble strip noise acoustically suggests to the driver that he is driving over a roadway marking provided with rumble strips or a profile. Since the meaning of this noise is known to the driver, he will most often carry out a suitable, intuitive steering correction very rapidly in order to guide the vehicle once more in the direction of the center of the lane.
In an advantageous refinement of the invention, the apparatus contains a line camera which is fitted behind the windscreen of the vehicle in such a way that it scans a strip of the roadway which is at right angles to the vehicle longitudinal axis and is located approximately between 4 m and 10 m in front of the vehicle. In the case of using the apparatus as a sleep warning system or as a "lane guard", this distance between the scanned strips of the roadway and the vehicle is sufficient in order to be able to warn a driver, who may have fallen asleep or been distracted, in good time.
An apparatus according to the present invention makes possible the additional determination of the yaw angle error and/or of the roadway width between the roadway markings, for which purpose the evaluation unit can be fed with the necessary input variables.
Before a threatened crossing of a roadway side marking, already relatively early before reaching the same, the apparatus according to the invention advantageously gives a warning through the use of the so-called TLC (time to line crossing) method, in which a continuous determination is made of the time duration after which the vehicle would reach a roadway side marking were it to travel further in accordance with the instantaneous driving condition. A warning is carried out in the case of falling below a predeterminable TLC minimum threshold which is, for example, on the order of magnitude of 0.5 s.
Other objects, advantages and novel features of the present invention will become apparent from the following detailed description of the invention when considered in conjunction with the accompanying drawings.
FIG. 1 is a schematic side view of a travelling commercial vehicle which is equipped with an apparatus for determining the distance of the vehicle from roadway side markings; and
FIG. 2 is a schematic top view of the driving situation depicted in the side view in FIG. 1.
In the driving situation shown in the figures, a commercial vehicle 1, which is equipped with a line camera, is driving along one lane 3 of a motorway at a given speed v. The lane 3 is bounded on both sides by continuous lane markings 7, 8. Broken markings or a marking only on one side of the lane may also be provided as an alternative. The line camera 2 has a line of light-sensitive sensor elements, the number of which is typically between 128 and 1024. The line camera 2 is of normal construction and therefore does not need to be described in more detail here. It is fitted in the vehicle interior behind a windscreen 5 in the region of a rear-view mirror in the center of the vehicle. That is to say, it is located on the vehicle longitudinal axis L. In this case, the line camera 2 is inclined forward and downward in such a way that the light-sensitive sensor element line scans, with its associated scanning cone 6, a very narrow strip 4 of the roadway which, according to the application, runs at a distance of about 4 m to 8 m in front of the vehicle 1 at right angles to the vehicle longitudinal axis L.
Connected downstream of the sensor element line of the line camera 2 is an evaluation unit 20 (which is not shown in more detail). The evaluation unit 20 reads the data sequentially out of the sensor element line and analyzes the data to determine the lateral distances (aL, aR) of the vehicle 1 from the left 8 and from the right 7 lane marking. It is a precondition for this that the scanning cone 6, which is projected onto the lane 3, of the sensor element line and hence the scanned, narrow strip 4 of the roadway, extends out sideways beyond the two lane-markings 7, 8, as shown in FIG. 2. For this purpose, the above-mentioned distance of the scanned strip 4 of the roadway from the vehicle 1 and hence the comparatively somewhat greater horizontal distance (A) of the scanned strip 4 of the roadway from the line camera 2 is selected to be sufficiently large. This can be ensured by a corresponding inclination of the line camera 2 at a given height (H) above the roadway 3 and a suitable focal length of the objective lens.
The apparatus therefore permits use as a sleep warning system, for which purpose the evaluation unit 20 drives an associated acoustic and/or haptic warning indicator element. A so-called rumble strip noise, such as is produced when driving over a continuous row of roadway marking rumble strips, can serve as a particularly neat acoustic warning signal. It is produced artificially and emitted in a side-specific manner via loudspeakers arranged to the side in the vehicle interior. That is to say, it is produced on that side of the vehicle on which the vehicle threatens to cross the roadway marking. Because of the understood meaning of this noise, the driver will intuitively and hence comparatively rapidly carry out a suitable steering correction which brings the vehicle back once more in the direction of the lane center.
To detect the threatened crossing of a roadway side marking, use is preferably made of the so-called TLC method, in which the evaluation unit derives, using the determined lateral distances (aL, aR) of the vehicle from the roadway side markings, from the determined yaw angle error and the detected vehicle speed, that time duration after which the vehicle would reach the roadway side marking if the present driving condition were to be maintained. The warning is always carried out if the time duration thus determined falls below a predetermined TLC minimum threshold of, typically, about 0.5 s.
Likewise, the evaluation unit, which further processes the brightness-proportional signal coming from the sensor element line of the scanned strip 4 of the roadway, has an essentially conventional construction, as it is used in a known way for the evaluation of the signals from an image sensor element arrangement. In this arrangement, the image positions of the right-hand roadway marking 7 and of the left-hand roadway marking 8 within the image supplied by the sensor element line are determined by means of a differentiating operator and a logic unit which operates in a nonlinear manner. Compared with the conventional systems using a two-dimensional sensor element array, in the present case the quantity of data which accumulates is considerably reduced because of the use of only one single sensor element line. This makes it possible to manage the further processing of the data in the evaluation unit, as well as the differentiating operator function and the nonlinear logic function for data pre-processing by means of a conventional microprocessor system.
On the one hand, the latter keeps the requirement for space and the computing complexity for this application in a motor vehicle tolerably low and, on the other hand, allows digital processing of the sensor signal information as an alternative to analog processing. As a result of the reduced quantity of data, the conventional microprocessor is able to process the data in real time, which is a precondition for the use of the apparatus as a sleep warning system. Alternatively, the differentiating operator and the nonlinear logic unit can be realized by a suitable discrete electrical circuit, as is described in the European Patent document EP 0 586 857 A1 mentioned above, or by a simple analog or discrete differentiator circuit with a downstream nonlinearity. The circuit is fed with the analogue signal from the sequentially read sensor element line. The exact design in terms of circuitry can readily be undertaken by those skilled in the art.
The internal camera parameters, the vehicle width, the height (H) of the line camera 2 above the roadway 3, the horizontal distance (A) between the sensor element line and the scanned strip 4 of the roadway, as well as the vehicle speed (v) can be fed as further input variables to the evaluation unit. Using these additional input variables, the evaluation unit is additionally able to detect, apart from the lateral distances (aL, aR) of the vehicle from the two roadway markings 7, 8, the yaw angle error and the width of the lane 3 between the roadway side markings 7, 8. This is done from the image positions, detected by the data pre-processing of the roadway side markings 7, 8 within the image supplied by the sensor element line through a downstream Kalman filter. This information can simultaneously be used for carrying out the above-specified TLC determination. With the aid of the Kalman filter, the image position of the roadway markings 7, 8 in the signal from the sensor element line can be predicted for the respective next measurement step. In this case, the successive measurements are advantageously carried out at a cycle of about 40 ms. A comparison of the predicted marking image position with the subsequently measured marking image position yields a system behavior which is not susceptible to interference.
In addition, the optional use of a second sensor element line can be advantageous. The line scans a second narrow strip 9 of the roadway, as shown with a dashed line in FIG. 2, which runs at a predetermined distance in front of the strip 4 of the roadway scanned by the first sensor element line, likewise at right angles to the vehicle longitudinal axis (L). This makes possible both verification of the measurements from the first-scanned strip of the roadway and automatic system calibration by measuring the angular error between the vehicle longitudinal axis (L) and the optical axis of the line camera arrangement.
The above description of a preferred exemplary embodiment shows that the apparatus according to the invention realizes a system for determining the distance of a vehicle from one or more roadway side markings which requires comparatively low technical outlay and nonetheless makes possible a sufficiently reliable lane detection in real time, so that the apparatus may be used as a sleep warning system. To be emphasized in this case are the low data processing outlay as a result of the use of only one or a few light-sensitive sensor element lines, the arrangement of the sensor element lines approximately at the height of the longitudinal central plane of the vehicle, so that one single objective lens is sufficient for the optical system, as well as the capability of being able to process the data, even by digital means, in real time by means of a conventional microprocessor.
Although the invention has been described and illustrated in detail, it is to be clearly understood that the same is by way of illustration and example, and is not to be taken by way of limitation. The spirit and scope of the present invention are to be limited only by the terms of the appended claims.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4630109 *||Feb 28, 1985||Dec 16, 1986||Standard Telephones & Cables Public Limited Company||Vehicle tracking system|
|US4905151 *||Mar 7, 1988||Feb 27, 1990||Transitions Research Corporation||One dimensional image visual system for a moving vehicle|
|US4970653 *||Apr 6, 1989||Nov 13, 1990||General Motors Corporation||Vision method of detecting lane boundaries and obstacles|
|US5661472 *||Jan 26, 1996||Aug 26, 1997||Isuzu Motors Limited||Off-lane alarm apparatus|
|DE4410064A1 *||Mar 23, 1994||Sep 29, 1994||Fuji Heavy Ind Ltd||Method and system for distance recognition|
|EP0361914A2 *||Sep 28, 1989||Apr 4, 1990||Honda Giken Kogyo Kabushiki Kaisha||A driving way judging device and method|
|EP0586857A1 *||Jul 27, 1993||Mar 16, 1994||Rockwell International Corporation||Vehicle lane position detection system|
|EP0640903A1 *||Aug 30, 1994||Mar 1, 1995||Lucas Industries Public Limited Company||A driver assistance system for a vehicle|
|JPH0546242A *||Title not available|
|JPH0747864A *||Title not available|
|JPH02216340A *||Title not available|
|JPH06147887A *||Title not available|
|JPH06284332A *||Title not available|
|JPS5155535A *||Title not available|
|JPS5158228A *||Title not available|
|1||*||IEEE Transactions of Industrial Electronics , vol. 39, No. 3, Jun. 1, 1992, pp. 181 188 by J. Manigel et al. entitled Vehicle Control by Computer Vision .|
|2||IEEE Transactions of Industrial Electronics, vol. 39, No. 3, Jun. 1, 1992, pp. 181-188 by J. Manigel et al. entitled "Vehicle Control by Computer Vision".|
|3||IT + TI Informationstechnik und Technische Informatik, vol. 36, No. 1, Feb. 1, 1994, pp. 16-24 by V. Graefe entitled "Echtzeit-Bildverarbeitung fur ein Fahrer-Unterstutzungssystem zum Einsatz auf Autobahnen".|
|4||*||IT TI Informationstechnik und Technische Informatik , vol. 36, No. 1, Feb. 1, 1994, pp. 16 24 by V. Graefe entitled Echtzeit Bildverarbeitung f u r ein Fahrer Unterst u tzungssystem zum Einsatz auf Autobahnen .|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US6014595 *||Dec 23, 1997||Jan 11, 2000||Honda Giken Kogyo Kabushiki Kaisha||Determination of vehicle assistance from vehicle vibration that results when the vehicle contacts vibration generating structures on the road|
|US6317057 *||Dec 29, 2000||Nov 13, 2001||Hyundai Motor Company||Method for detecting lane deviation of vehicle|
|US6360171 *||Oct 20, 2000||Mar 19, 2002||Public Works Research Institute, Ministry Of Construction||Bumping prevention system|
|US6470273||Dec 26, 2001||Oct 22, 2002||Milton Halsted||Collision warning system|
|US6732021 *||Nov 6, 2002||May 4, 2004||Nissan Motor Co., Ltd.||Lane-keep control system for vehicle|
|US6768944 *||Aug 9, 2002||Jul 27, 2004||Intelligent Technologies International, Inc.||Method and system for controlling a vehicle|
|US6823241||Sep 14, 2001||Nov 23, 2004||Nissan Motor Co., Ltd.||Lane recognition apparatus for vehicle|
|US6937165||Sep 23, 2002||Aug 30, 2005||Honeywell International, Inc.||Virtual rumble strip|
|US7084772||Aug 24, 2004||Aug 1, 2006||Fuji Jukogyo Kabushiki Kaisha||Wakefulness estimating apparatus and method|
|US7085637||Apr 12, 2004||Aug 1, 2006||Intelligent Technologies International, Inc.||Method and system for controlling a vehicle|
|US7265657 *||May 24, 2005||Sep 4, 2007||Toyota Jidosha Kabushiki Kaisha||Lane boundary detector|
|US7365779 *||Sep 13, 2001||Apr 29, 2008||Fujitsu Ten Limited||Image processing apparatus for selectively storing specific regions of an image|
|US7551093||Nov 22, 2006||Jun 23, 2009||Robert Bosch Gmbh||Method and device for warning a driver|
|US7720580 *||Dec 22, 2005||May 18, 2010||Donnelly Corporation||Object detection system for vehicle|
|US7765066 *||Dec 11, 2002||Jul 27, 2010||Robert Bosch Gmbh||Method and device for lane keeping support in motor vehicles|
|US7877175||Apr 21, 2010||Jan 25, 2011||Donnelly Corporation||Imaging system for vehicle|
|US7991522||Dec 28, 2010||Aug 2, 2011||Donnelly Corporation||Imaging system for vehicle|
|US8055445 *||Sep 24, 2008||Nov 8, 2011||Delphi Technologies, Inc.||Probabilistic lane assignment method|
|US8116929||Jul 26, 2011||Feb 14, 2012||Donnelly Corporation||Imaging system for vehicle|
|US8212878 *||Jun 28, 2007||Jul 3, 2012||Hitachi, Ltd.||Calibration apparatus of on-vehicle camera, program, and car navigation system|
|US8239086||Feb 10, 2012||Aug 7, 2012||Donnelly Corporation||Imaging system for vehicle|
|US8289142||Sep 15, 2009||Oct 16, 2012||Donnelly Corporation||Object detection system for vehicle|
|US8386114||Aug 3, 2012||Feb 26, 2013||Donnelly Corporation||Imaging system for vehicle|
|US8421865||May 1, 2012||Apr 16, 2013||Magna Electronics Europe Gmbh & Co. Kg||Method for calibrating a vehicular camera system|
|US8543277||Feb 25, 2013||Sep 24, 2013||Magna Electronics Inc.||Imaging system for vehicle|
|US8665079||Oct 15, 2012||Mar 4, 2014||Magna Electronics Inc.||Vision system for vehicle|
|US8718919||May 21, 2010||May 6, 2014||Robert Bosch Gmbh||Method and apparatus for lane recognition for a vehicle|
|US8818042||Nov 18, 2013||Aug 26, 2014||Magna Electronics Inc.||Driver assistance system for vehicle|
|US8842176||Jan 15, 2010||Sep 23, 2014||Donnelly Corporation||Automatic vehicle exterior light control|
|US8917169||Dec 2, 2013||Dec 23, 2014||Magna Electronics Inc.||Vehicular vision system|
|US8964032||Jan 26, 2010||Feb 24, 2015||Magna Electronics Inc.||Rear illumination system|
|US8977008||Jul 8, 2013||Mar 10, 2015||Donnelly Corporation||Driver assistance system for vehicle|
|US8993951||Jul 16, 2013||Mar 31, 2015||Magna Electronics Inc.||Driver assistance system for a vehicle|
|US9008369||Aug 25, 2014||Apr 14, 2015||Magna Electronics Inc.||Vision system for vehicle|
|US9035758 *||Jul 15, 2005||May 19, 2015||Robert Bosch Gmbh||Method and device for driver information|
|US9123215||May 14, 2013||Sep 1, 2015||GM Global Technology Operations LLC||Alert systems and methods for a vehicle|
|US9132774||May 14, 2013||Sep 15, 2015||GM Global Technology Operations LLC||Alert systems and methods for a vehicle|
|US9150155||Jan 13, 2011||Oct 6, 2015||Magna Electronics Inc.||Vehicular camera and method for periodic calibration of vehicular camera|
|US9153108||May 14, 2013||Oct 6, 2015||GM Global Technology Operations LLC||Alert systems and methods for a vehicle|
|US9171217||Mar 3, 2014||Oct 27, 2015||Magna Electronics Inc.||Vision system for vehicle|
|US9191634||Apr 3, 2015||Nov 17, 2015||Magna Electronics Inc.||Vision system for vehicle|
|US9266451||May 14, 2013||Feb 23, 2016||GM Global Technology Operations LLC||Alert systems and methods for a vehicle|
|US9296337||Oct 5, 2015||Mar 29, 2016||Magna Electronics Inc.||Method of calibrating a vehicular camera|
|US9349263 *||May 14, 2013||May 24, 2016||GM Global Technology Operations LLC||Alert systems and methods for a vehicle|
|US9428192||Nov 16, 2015||Aug 30, 2016||Magna Electronics Inc.||Vision system for vehicle|
|US9436880||Jan 13, 2014||Sep 6, 2016||Magna Electronics Inc.||Vehicle vision system|
|US9440535||Jan 27, 2014||Sep 13, 2016||Magna Electronics Inc.||Vision system for vehicle|
|US9493116||May 14, 2013||Nov 15, 2016||GM Global Technology Operations LLC||Alert systems and methods for a vehicle|
|US20020030735 *||Sep 13, 2001||Mar 14, 2002||Masahiro Yamada||Image processing apparatus|
|US20030191568 *||Aug 9, 2002||Oct 9, 2003||Breed David S.||Method and system for controlling a vehicle|
|US20050046579 *||Aug 24, 2004||Mar 3, 2005||Fuji Jukogyo Kabushiki Kaisha||Wakefulness estimating apparatus and method|
|US20050060069 *||Apr 12, 2004||Mar 17, 2005||Breed David S.||Method and system for controlling a vehicle|
|US20050228588 *||Dec 11, 2002||Oct 13, 2005||Goetz Braeuchle||Lateral guidance assistance for motor vehicles|
|US20050273260 *||May 24, 2005||Dec 8, 2005||Toyota Jidosha Kabushiki Kaisha||Lane boundary detector|
|US20060184297 *||Dec 22, 2005||Aug 17, 2006||Higgins-Luthman Michael J||Object detection system for vehicle|
|US20070063855 *||Nov 22, 2006||Mar 22, 2007||Alexander Maass||Method and device for warning a driver|
|US20080007619 *||Jun 28, 2007||Jan 10, 2008||Hitachi, Ltd.||Calibration Apparatus of On-Vehicle Camera, Program, and Car Navigation System|
|US20080021608 *||Aug 26, 2005||Jan 24, 2008||Robert Bosch Gmbh||Method And Device For Driver Assistance|
|US20080061952 *||Jul 15, 2005||Mar 13, 2008||Robert Bosch Gmbh||Method And Device For Driver Information|
|US20080186154 *||Aug 19, 2005||Aug 7, 2008||Robert Bosch Gmbh||Method and Device for Driver Support|
|US20100002081 *||Sep 15, 2009||Jan 7, 2010||Donnelly Corporation||Object detection system for vehicle|
|US20100076684 *||Sep 24, 2008||Mar 25, 2010||Schiffmann Jan K||Probabilistic lane assignment method|
|US20100194888 *||Jan 26, 2010||Aug 5, 2010||Mcelroy Clarence Patrick||Rear illumination system|
|US20100228435 *||Apr 21, 2010||Sep 9, 2010||Donnelly Corporation||Object detection system for vehicle|
|US20110040468 *||May 21, 2010||Feb 17, 2011||Thilo Leineweber||Method and apparatus for lane recognition for a vehicle|
|US20110090339 *||Dec 28, 2010||Apr 21, 2011||Donnelly Corporation||Imaging system for vehicle|
|US20130342366 *||May 14, 2013||Dec 26, 2013||GM Global Technology Operations LLC||Alert systems and methods for a vehicle|
|EP1193661A1 *||Sep 10, 2001||Apr 3, 2002||Nissan Motor Company, Limited||Lane recognition apparatus for vehicle|
|EP1376514A1 *||Jun 20, 2003||Jan 2, 2004||Renault s.a.s.||Method and device to evaluate the position of a vehicule on a road lane|
|EP1510395A2 *||Aug 23, 2004||Mar 2, 2005||Fuji Jukogyo Kabushiki Kaisha||Wakefulness estimating apparatus and method|
|WO2015189511A1 *||Jun 8, 2015||Dec 17, 2015||Renault S.A.S||Detection system for a motor vehicle, for indicating with the aid of a sound stage a lack of vigilance on the part of the driver|
|WO2015189512A1 *||Jun 8, 2015||Dec 17, 2015||Renault S.A.S||Detection system for a motor vehicle, for indicating with the aid of a sound stage a lack of vigilance on the part of the driver in the presence of immediate danger|
|U.S. Classification||701/45, 701/301, 348/118|
|International Classification||G01S17/08, G01S17/93, G01S11/12, B60Q9/00, G05D1/02, B60W30/00, G01B11/14, G08G1/16, G08G1/04, G01S3/784|
|Cooperative Classification||G01S3/784, G05D1/0255, G05D1/0246, G01S11/12, B60T2201/08, G08G1/04, B60T2201/082|
|European Classification||G01S3/784, G05D1/02E6V, G08G1/04, G05D1/02E8|
|May 22, 1996||AS||Assignment|
Owner name: DAIMLER-BENZ AG, GERMANY
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FRANKE, UWE;HAHN, STEFAN;REEL/FRAME:008114/0383
Effective date: 19960306
|Aug 31, 1999||AS||Assignment|
Owner name: DAIMLERCHRYSLER AG, GERMANY
Free format text: CHANGE OF NAME;ASSIGNOR:DAIMLER-BENZ AKTIENGESELLSCHAFT;REEL/FRAME:010180/0312
Effective date: 19990108
|Sep 6, 2002||FPAY||Fee payment|
Year of fee payment: 4
|Oct 19, 2006||REMI||Maintenance fee reminder mailed|
|Mar 30, 2007||LAPS||Lapse for failure to pay maintenance fees|
|May 29, 2007||FP||Expired due to failure to pay maintenance fee|
Effective date: 20070330