US20130101174A1 - Method for Combining a Road Sign Recognition System and a Lane Detection System of a Motor Vehicle - Google Patents

Method for Combining a Road Sign Recognition System and a Lane Detection System of a Motor Vehicle Download PDF

Info

Publication number
US20130101174A1
US20130101174A1 US13/704,364 US201113704364A US2013101174A1 US 20130101174 A1 US20130101174 A1 US 20130101174A1 US 201113704364 A US201113704364 A US 201113704364A US 2013101174 A1 US2013101174 A1 US 2013101174A1
Authority
US
United States
Prior art keywords
lane
indicating
information
road
road sign
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US13/704,364
Other versions
US9177212B2 (en
Inventor
Urban Meis
Christian Gutmann
Matthias Schorn
Steen Kristensen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Conti Temic Microelectronic GmbH
Original Assignee
Conti Temic Microelectronic GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Conti Temic Microelectronic GmbH filed Critical Conti Temic Microelectronic GmbH
Assigned to CONTI TEMIC MICROELECTRONIC GMBH reassignment CONTI TEMIC MICROELECTRONIC GMBH ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SCHORN, MATTHIAS, GUTMANN, CHRISTIAN, KRISTENSEN, STEEN, MEIS, URBAN
Publication of US20130101174A1 publication Critical patent/US20130101174A1/en
Application granted granted Critical
Publication of US9177212B2 publication Critical patent/US9177212B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G06K9/00798—
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
    • B60W30/10—Path keeping
    • B60W30/12—Lane keeping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/09—Arrangements for giving variable traffic instructions
    • G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/09623—Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/04—Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/09—Arrangements for giving variable traffic instructions
    • G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
    • G08G1/096708—Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control
    • G08G1/096716—Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control where the received information does not generate an automatic action on the vehicle control
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/09—Arrangements for giving variable traffic instructions
    • G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
    • G08G1/096766—Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission
    • G08G1/096775—Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission where the origin of the information is a central station
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Definitions

  • the invention relates to a method for combining a road sign recognition system and a lane detection system of a motor vehicle according to the preamble of patent claim 1 .
  • Modern driver assistance systems assist the driver in driving his or her vehicle.
  • a great number of such systems are based on, e.g., lane detection and road sign recognition.
  • Lane departure warning, lane assignment for longitudinal control systems or a function for intervening in the steering process for the purpose of lane keeping can be realized by means of robust and reliable lane detection.
  • Such lane detection systems and road sign recognition systems are usually based on camera systems (in particular, on video camera systems) that are fastened to the interior mirror of the motor vehicle or to exterior mirrors thereof.
  • driver assistance systems obtain additional information from a navigation system and/or various driver assistance systems in order to reduce the number of assignment errors or ambiguities is known.
  • DE 10 2009 036 196 A1 describes a road sign recognition method for a vehicle, in which method road signs are searched for and detected in a region surrounding the vehicle by means of a camera.
  • map data of a navigation system are used as well as search regions for searching for the road signs in the surroundings are preselected and/or limited on the basis of lane data of a lane detection system and/or on the basis of a respective position of the road signs relative to the camera, said respective relative position being estimated by means of a sensor device.
  • lane detection is performed by means of a camera, wherein these data are supplied to an analyzing computer.
  • Navigation data and current lane detection data can be correlated in a location-related manner by means of said analyzing computer.
  • the electronically mapped and/or predictively known route data can be verified during driving by permanent lane checking.
  • the image data of the camera are also subjected to road sign recognition so that the current result data of the lane checking process and the route data are correlated with the current data of a camera-based electronic road sign recognition.
  • driver assistance systems may be restricted if the navigation-based data are not available, i.e., if the additional input signals of a satellite-based navigation system are not available to these systems.
  • the object of the invention is to advance a method of the type mentioned at the beginning in such a manner that both the road sign recognition system and the lane detection system become more robust and more reliable and the service quality of these two systems is improved without having to use information from a digital map or from a satellite-based navigation system.
  • This inventive method stands out due to the facts that meaning-indicating data for road signs are generated from the lane course information, that these meaning-indicating data for road signs are used to check the plausibility of and/or to interpret the road sign information, that furthermore data indicating the course of the lane are generated from the road sign information, and that these data indicating the course of the lane are used to check the plausibility of and/or to interpret the lane course information.
  • lane detection provides information that is also relevant to the validity of road signs, i.e., that is used for meaning analysis or interpretation.
  • the information about recognized road signs is used for lane detection.
  • a plausibility check of or an interpretation of a road sign recognized by means of the road sign recognition system is performed using lane-course-indicating data in order to ensure that a recognized road sign is relevant to the lane the vehicle is traveling in, i.e., is relevant to the driver and must therefore be observed by the driver.
  • information about the line structure of the fast lane of a pavement is preferably generated from the lane course information as meaning-indicating data for road signs, and the plausibility of road signs indicating a restriction on passing and recognized by the road sign recognition system is checked using this information about the line structure.
  • information indicating an exit ramp or an exit ramp region is generated from the lane course information as meaning-indicating data for road signs, and the plausibility of road signs indicating a speed limit and/or a restriction on passing and recognized by the road sign recognition system is checked using the information indicating this exit ramp or this exit ramp region.
  • road signs indicating a speed limit and/or a restriction on passing and assigned to the exit ramp and recognized by the road sign recognition system are outputted to a Human Machine Interface of the motor vehicle.
  • information indicating an exit ramp or an exit ramp region is generated from the lane course information concerning the current lane of the motor vehicle as meaning-indicating data for road signs, and road signs indicating a speed limit and/or a restriction on passing and recognized by the road sign recognition system are interpreted as being canceled using this information indicating an exit ramp or an exit ramp region.
  • information indicating an exit ramp or an exit ramp region is generated from the lane course information concerning the current lane as meaning-indicating data for road signs, and the plausibility of road signs that indicate “driving on the right” or “driving on the left” is checked on the basis of the frequency of the detected exit ramps or exit ramp regions.
  • construction-site-indicating information from the lane course information concerning the current lane as meaning-indicating data for road signs and to check the plausibility of road signs indicating a speed limit and/or a restriction on passing and recognized by the road sign recognition system using the information indicating a construction site.
  • the support for the lane detection system by the road sign recognition system consists in the following: Construction-site-indicating information is generated from the road sign information generated by the road sign recognition system as data indicating the course of the lane, and the sensor data are analyzed for particular lane course scenarios and/or for indicators for particular lane course scenarios, said analysis being performed by means of the lane detection system on the basis of the construction-site-indicating information.
  • the information about construction site signs recognized by the road sign recognition system may be used to analyze the image information as indicators for particular lane course scenarios with regard to particular road markings (in particular, yellow road markings), said analysis being performed by means of the lane detection system.
  • information indicating road signs indicating a speed limit and/or the road type is generated from the road sign information generated by the road sign recognition system as data indicating the course of the lane, and the information indicating road signs indicating a speed limit and/or the road type is analyzed for road-type-indicating features by means of the lane detection system or the plausibility of the identified road types is checked.
  • FIG. 1 shows a schematic block diagram of a driver assistance system of a motor vehicle.
  • Said driver assistance system is made up of a road sign recognition system 1 and a lane detection system 2 .
  • Said motor vehicle is not shown.
  • Said driver assistance system also comprises a video camera 4 with a downstream storage unit 5 .
  • the image data of the surroundings of the motor vehicle acquired by the camera 4 are stored in the form of images in said storage unit 5 .
  • Said camera 4 covers the region in front of the motor vehicle and is usually arranged on the interior mirror of the motor vehicle. In addition or alternatively, one camera 4 each may be mounted on the exterior mirrors in order to be able to cover the regions at the sides of the motor vehicle.
  • the image data of the storage unit 5 are supplied to both the road sign recognition system 1 and the lane detection system 2 .
  • the road sign recognition system 1 detects and classifies road signs from the image data by means of a detector 6 according to prior-art methods.
  • a downstream selection-and-plausibility unit 9 checks the plausibility of or selects said road signs before they are stored as recognized road signs in an output storage 7 .
  • This information about recognized road signs is then available to an output unit 3 as a Human Machine Interface, e.g., a central display or a display of an instrument cluster, for indication to the driver of the motor vehicle. It is also possible to derive therefrom warnings or vehicle interventions by means of an actuator unit 3 .
  • the lane course of the current lane and the lane courses of adjacent lanes are detected from the image data of the storage unit 5 by means of the lane detection system 2 and analyzed together with the data of a vehicle sensor system 8 that detects the ego-motion of the vehicle (longitudinal velocity, lateral velocity, yaw rate, etc.), and the result is supplied to the output-and-actuator unit 3 in order to similarly derive therefrom visual or acoustic warnings and/or vehicle interventions.
  • the data of the vehicle sensor system 8 are also supplied to other vehicle systems, e.g., to a driver assistance system (Electronic Stability Control, Traction Control System, etc.) of the motor vehicle.
  • the information that is generated by the lane detection system 2 and meaning-relevant to the recognition of the road signs is supplied to the road sign recognition system 1 and—vice versa—the information that is generated by the road sign recognition system 1 and relevant to the course of the lane is made available to the lane detection system 2 .
  • the plausibility of the road signs recognized by the road sign recognition system 1 can be checked by means of lane information by supplying said lane information to the selection-and-plausibility unit 9 , said lane information being provided by the lane detection system 2 . If several road signs are recognized, the road sign that is relevant to the lane the motor vehicle is traveling in can be selected by means of the supplied lane information. It is also possible to check the plausibility of or to interpret a recognized road sign by means of the supplied lane information, i.e., to determine whether the recognized road sign is relevant to the lane the motor vehicle is traveling in and must therefore be observed by the driver of the motor vehicle.
  • An example thereof is the recognition of a road sign indicating a restriction on passing by the road sign recognition system 1 and the plausibility check of said road sign on the basis of the detection of a continuous line structure or of a line structure that is to be interpreted as a continuous line structure between the lane the motor vehicle is traveling in and the adjacent fast lane.
  • the plausibility of speed limit signs located in exit ramp regions and only being relevant to the exit ramp regions can be checked on the basis of the exit ramp and/or exit lane detected by the lane detection system 2 .
  • the lane change indicating that the motor vehicle is driving past an exit ramp is determined by detecting the fact that the middle of the vehicle is crossing a road marking or by a detected change of direction of the motor vehicle on the basis of the yaw angle of the vehicle with respect to the current lane.
  • the fact that the motor vehicle is driving past an exit ramp can be detected on the basis of a change of the type of the right-hand road marking that changes from a continuous line to a broken line.
  • the detection of a direction indicator signal would also be suitable for this purpose.
  • the road signs indicating a speed limit and/or a restriction on passing and assigned to the exit ramp by the selection-and-plausibility unit 9 and recognized by the road sign recognition system 1 are outputted (e.g., as a visual or acoustic warning) via the output storage 7 to a Human Machine Interface 3 of the motor vehicle.
  • This may also be used to activate actuators of a vehicle assistance system in order to initiate a vehicle intervention (e.g., reducing the speed of the motor vehicle).
  • Video-based exit ramp detection is performed by, e.g., covering the further surroundings of the motor vehicle by means of the video camera 4 in order to detect the beginning and the end of the exit lane.
  • exit ramp markings detected by the lane detection system 2 may be used for the plausibility check.
  • the exit lane and the current lane are detected to be non-parallel or the types of the markings are detected and analyzed.
  • exit ramp detection may be performed by detecting an upsilon-like or lambda-like structure.
  • road signs indicating a speed limit and/or a restriction on passing and recognized by the road sign recognition system 1 may be interpreted as being canceled using the information indicating an exit ramp or an exit ramp region and generated by the lane detection system 2 , i.e., these road sign data are not stored in the output storage 7 by the selection-and-plausibility unit 9 .
  • the information generated by the lane detection system 2 with regard to detected exit ramps may also be used to check, on the basis of the frequency of the detected exit ramps or exit ramp regions, the plausibility of road signs recognized by the road sign recognition system 1 that indicate “driving on the right” or “driving on the left”.
  • the plausibility of speed limit signs may be checked using construction-site-indicating information generated by the lane detection system. It is also possible to infer the existence of a construction site with a speed limit without the previous recognition of a speed limit sign by the road sign recognition system 1 . This case may occur if, e.g., such road signs are temporarily covered by motor vehicles ahead.
  • Video-based construction site detection may be performed by, e.g., the detection of crash barriers, crash walls or raised structures as well as of colors of markings.
  • the information about recognized road signs that is generated by the road sign recognition system 1 includes information that is relevant to the course of the pavement, which relevant information is made available to the lane detection system 2 via the output storage 7 of the road sign recognition system 1 .
  • construction-site-indicating information is generated from the road sign information generated by the road sign recognition system 1 as data indicating the course of the lane, whereby the lane detection system 2 is caused to analyze the image data of the storage unit 5 for particular lane course scenarios and/or for indicators for particular lane course scenarios.
  • narrowing lane markings, additional lane markings or particular colors of lane markings are particular lane course scenarios and/or indicators for particular lane course scenarios.
  • Said construction-site-indicating information may be, e.g., construction site signs or a succession of speed limit signs causing the driver to gradually reduce the speed. Furthermore, such information of the road sign recognition system 1 may be used to select the right lane boundaries in the construction site region since the construction site markings might cover the usual lane markings.
  • said construction-site-indicating information of the road sign recognition system 1 may also be used to disable a lane function (e.g., lane departure warning or lane keeping function) of a driver assistance system of the motor vehicle.
  • a lane function e.g., lane departure warning or lane keeping function
  • information indicating road signs indicating a speed limit and/or the road type is generated from the road sign information generated by the road sign recognition system 1 as data indicating the course of the lane, and said information indicating road signs indicating a speed limit and/or the road type is analyzed for road-type-indicating features by means of the lane detection system 2 or the plausibility of identified road types is checked. For example, with a detected speed limit of 130 km/h, the plausibility of a country road identified by the lane detection system 2 can be checked. Likewise, with expressway or superhighway signs recognized by the road sign recognition system 1 , the plausibility of an identified expressway or of an identified superhighway can be checked by the lane detection system 2 .
  • the filter dynamics of a filter of the lane detection system 2 is adjusted for generating a lane course scenario, said adjustment being performed on the basis of said information that indicates road signs indicating a speed limit and/or the road type.

Abstract

The invention relates to a method for combining a road sign recognition system (1) and a lane detection system (2) of a motor vehicle, wherein the road sign recognition system (1) generates road sign information from sensor data of a camera-based or video-based sensor system (4) and the lane detection system (2) generates lane course information from said sensor data; according to the invention, meaning-indicating data for road signs are generated from the lane course information, the meaning-indicating data for road signs are used to check the plausibility of and/or to interpret the road sign information, data indicating the course of the lane are generated from the road sign information, and the data indicating the course of the lane are used to check the plausibility of and/or to interpret the lane course information.

Description

  • The invention relates to a method for combining a road sign recognition system and a lane detection system of a motor vehicle according to the preamble of patent claim 1.
  • Modern driver assistance systems assist the driver in driving his or her vehicle. A great number of such systems are based on, e.g., lane detection and road sign recognition. Lane departure warning, lane assignment for longitudinal control systems or a function for intervening in the steering process for the purpose of lane keeping can be realized by means of robust and reliable lane detection.
  • Such lane detection systems and road sign recognition systems are usually based on camera systems (in particular, on video camera systems) that are fastened to the interior mirror of the motor vehicle or to exterior mirrors thereof.
  • The fact that such driver assistance systems obtain additional information from a navigation system and/or various driver assistance systems in order to reduce the number of assignment errors or ambiguities is known.
  • For example, DE 10 2009 036 196 A1 describes a road sign recognition method for a vehicle, in which method road signs are searched for and detected in a region surrounding the vehicle by means of a camera. For searching for the road signs in the surroundings of the vehicle, map data of a navigation system are used as well as search regions for searching for the road signs in the surroundings are preselected and/or limited on the basis of lane data of a lane detection system and/or on the basis of a respective position of the road signs relative to the camera, said respective relative position being estimated by means of a sensor device.
  • Furthermore, according to a method known from DE 199 48 734 A1, lane detection is performed by means of a camera, wherein these data are supplied to an analyzing computer. Navigation data and current lane detection data can be correlated in a location-related manner by means of said analyzing computer. In this way, the electronically mapped and/or predictively known route data can be verified during driving by permanent lane checking. Furthermore, the image data of the camera are also subjected to road sign recognition so that the current result data of the lane checking process and the route data are correlated with the current data of a camera-based electronic road sign recognition.
  • However, the functionality of such driver assistance systems may be restricted if the navigation-based data are not available, i.e., if the additional input signals of a satellite-based navigation system are not available to these systems.
  • The object of the invention is to advance a method of the type mentioned at the beginning in such a manner that both the road sign recognition system and the lane detection system become more robust and more reliable and the service quality of these two systems is improved without having to use information from a digital map or from a satellite-based navigation system.
  • This object is achieved by a method with the features of patent claim 1.
  • This inventive method stands out due to the facts that meaning-indicating data for road signs are generated from the lane course information, that these meaning-indicating data for road signs are used to check the plausibility of and/or to interpret the road sign information, that furthermore data indicating the course of the lane are generated from the road sign information, and that these data indicating the course of the lane are used to check the plausibility of and/or to interpret the lane course information.
  • In this way, lane detection provides information that is also relevant to the validity of road signs, i.e., that is used for meaning analysis or interpretation. The other way round and similarly, the information about recognized road signs is used for lane detection.
  • According to a realization of the invention, a plausibility check of or an interpretation of a road sign recognized by means of the road sign recognition system is performed using lane-course-indicating data in order to ensure that a recognized road sign is relevant to the lane the vehicle is traveling in, i.e., is relevant to the driver and must therefore be observed by the driver.
  • For this purpose, information about the line structure of the fast lane of a pavement is preferably generated from the lane course information as meaning-indicating data for road signs, and the plausibility of road signs indicating a restriction on passing and recognized by the road sign recognition system is checked using this information about the line structure.
  • According to a further advantageous realization of the invention, information indicating an exit ramp or an exit ramp region is generated from the lane course information as meaning-indicating data for road signs, and the plausibility of road signs indicating a speed limit and/or a restriction on passing and recognized by the road sign recognition system is checked using the information indicating this exit ramp or this exit ramp region.
  • On the one hand, according to a realization of the invention, if the fact that the motor vehicle is driving past the exit ramp is detected in this way from the current lane detected by means of the lane detection system and/or from a lane change of the motor vehicle detected by means of the lane detection system and from the information indicating an exit ramp, those data which concern the recognized road signs indicating a speed limit and/or a restriction on passing and concerning the exit ramp are rejected by the road sign recognition system.
  • On the other hand, according to a further realization of the invention, if the fact that the motor vehicle is leaving the road is detected from the current lane detected by means of the lane detection system and/or from a lane change of the motor vehicle detected by means of the lane detection system and from the information indicating an exit ramp, road signs indicating a speed limit and/or a restriction on passing and assigned to the exit ramp and recognized by the road sign recognition system are outputted to a Human Machine Interface of the motor vehicle.
  • According to a further advantageous realization of the inventive method, information indicating an exit ramp or an exit ramp region is generated from the lane course information concerning the current lane of the motor vehicle as meaning-indicating data for road signs, and road signs indicating a speed limit and/or a restriction on passing and recognized by the road sign recognition system are interpreted as being canceled using this information indicating an exit ramp or an exit ramp region.
  • Furthermore, according to a further development, information indicating an exit ramp or an exit ramp region is generated from the lane course information concerning the current lane as meaning-indicating data for road signs, and the plausibility of road signs that indicate “driving on the right” or “driving on the left” is checked on the basis of the frequency of the detected exit ramps or exit ramp regions.
  • Finally, according to a realization of the invention, it is furthermore advantageous to generate construction-site-indicating information from the lane course information concerning the current lane as meaning-indicating data for road signs and to check the plausibility of road signs indicating a speed limit and/or a restriction on passing and recognized by the road sign recognition system using the information indicating a construction site.
  • According to an advantageous realization of the invention, the support for the lane detection system by the road sign recognition system consists in the following: Construction-site-indicating information is generated from the road sign information generated by the road sign recognition system as data indicating the course of the lane, and the sensor data are analyzed for particular lane course scenarios and/or for indicators for particular lane course scenarios, said analysis being performed by means of the lane detection system on the basis of the construction-site-indicating information. In this way, the information about construction site signs recognized by the road sign recognition system may be used to analyze the image information as indicators for particular lane course scenarios with regard to particular road markings (in particular, yellow road markings), said analysis being performed by means of the lane detection system.
  • According to a further advantageous realization of the inventive method, information indicating road signs indicating a speed limit and/or the road type is generated from the road sign information generated by the road sign recognition system as data indicating the course of the lane, and the information indicating road signs indicating a speed limit and/or the road type is analyzed for road-type-indicating features by means of the lane detection system or the plausibility of the identified road types is checked.
  • Finally, according to a preferred further development of the invention, it is particularly advantageous to generate information indicating road signs indicating a speed limit and/or the road type from the road sign information generated by the road sign recognition system as data indicating the course of the lane and to adjust the filter dynamics of a filter of the lane detection system for generating a lane course scenario, said adjustment being performed using this information that indicates road signs indicating a speed limit and/or the road type.
  • In the following, the invention will be explained in greater detail with reference to a single FIG. 1. Said FIG. 1 shows a schematic block diagram of a driver assistance system of a motor vehicle. Said driver assistance system is made up of a road sign recognition system 1 and a lane detection system 2. Said motor vehicle is not shown.
    •
  • Said driver assistance system also comprises a video camera 4 with a downstream storage unit 5. The image data of the surroundings of the motor vehicle acquired by the camera 4 are stored in the form of images in said storage unit 5. Said camera 4 covers the region in front of the motor vehicle and is usually arranged on the interior mirror of the motor vehicle. In addition or alternatively, one camera 4 each may be mounted on the exterior mirrors in order to be able to cover the regions at the sides of the motor vehicle.
  • The image data of the storage unit 5 are supplied to both the road sign recognition system 1 and the lane detection system 2.
  • The road sign recognition system 1 detects and classifies road signs from the image data by means of a detector 6 according to prior-art methods. A downstream selection-and-plausibility unit 9 checks the plausibility of or selects said road signs before they are stored as recognized road signs in an output storage 7. This information about recognized road signs is then available to an output unit 3 as a Human Machine Interface, e.g., a central display or a display of an instrument cluster, for indication to the driver of the motor vehicle. It is also possible to derive therefrom warnings or vehicle interventions by means of an actuator unit 3.
  • The lane course of the current lane and the lane courses of adjacent lanes (such as fast lane, opposite lane or exit lane) are detected from the image data of the storage unit 5 by means of the lane detection system 2 and analyzed together with the data of a vehicle sensor system 8 that detects the ego-motion of the vehicle (longitudinal velocity, lateral velocity, yaw rate, etc.), and the result is supplied to the output-and-actuator unit 3 in order to similarly derive therefrom visual or acoustic warnings and/or vehicle interventions. The data of the vehicle sensor system 8 are also supplied to other vehicle systems, e.g., to a driver assistance system (Electronic Stability Control, Traction Control System, etc.) of the motor vehicle.
  • In order to make the camera-based road sign recognition and lane detection system 1 and 2 more robust, the information that is generated by the lane detection system 2 and meaning-relevant to the recognition of the road signs is supplied to the road sign recognition system 1 and—vice versa—the information that is generated by the road sign recognition system 1 and relevant to the course of the lane is made available to the lane detection system 2.
  • Thus, the plausibility of the road signs recognized by the road sign recognition system 1 can be checked by means of lane information by supplying said lane information to the selection-and-plausibility unit 9, said lane information being provided by the lane detection system 2. If several road signs are recognized, the road sign that is relevant to the lane the motor vehicle is traveling in can be selected by means of the supplied lane information. It is also possible to check the plausibility of or to interpret a recognized road sign by means of the supplied lane information, i.e., to determine whether the recognized road sign is relevant to the lane the motor vehicle is traveling in and must therefore be observed by the driver of the motor vehicle.
  • An example thereof is the recognition of a road sign indicating a restriction on passing by the road sign recognition system 1 and the plausibility check of said road sign on the basis of the detection of a continuous line structure or of a line structure that is to be interpreted as a continuous line structure between the lane the motor vehicle is traveling in and the adjacent fast lane.
  • Furthermore, the plausibility of speed limit signs located in exit ramp regions and only being relevant to the exit ramp regions can be checked on the basis of the exit ramp and/or exit lane detected by the lane detection system 2.
  • If, in such a case, the fact that the motor vehicle is driving past the exit ramp is detected from the current lane detected by means of the lane detection system 2 and/or from a lane change of the motor vehicle detected by means of the lane detection system 2 and from the exit-ramp-indicating information of the lane detection system 2, those data which concern recognized road signs indicating a speed limit and/or a restriction on passing and concerning the exit ramp are rejected by the road sign recognition system 1, i.e., the road sign data are not stored in the output storage 7 by the selection-and-plausibility unit 9.
  • The lane change indicating that the motor vehicle is driving past an exit ramp is determined by detecting the fact that the middle of the vehicle is crossing a road marking or by a detected change of direction of the motor vehicle on the basis of the yaw angle of the vehicle with respect to the current lane.
  • Furthermore, the fact that the motor vehicle is driving past an exit ramp can be detected on the basis of a change of the type of the right-hand road marking that changes from a continuous line to a broken line. The detection of a direction indicator signal would also be suitable for this purpose.
  • If, however, the motor vehicle is not detected to be driving past the exit ramp but the fact that the motor vehicle is leaving the road is detected from the current lane detected by means of the lane detection system 2 and/or from a lane change of the motor vehicle detected by means of the lane detection system 2 and from the information indicating an exit ramp, the road signs indicating a speed limit and/or a restriction on passing and assigned to the exit ramp by the selection-and-plausibility unit 9 and recognized by the road sign recognition system 1 are outputted (e.g., as a visual or acoustic warning) via the output storage 7 to a Human Machine Interface 3 of the motor vehicle. This may also be used to activate actuators of a vehicle assistance system in order to initiate a vehicle intervention (e.g., reducing the speed of the motor vehicle).
  • Video-based exit ramp detection is performed by, e.g., covering the further surroundings of the motor vehicle by means of the video camera 4 in order to detect the beginning and the end of the exit lane. In addition, exit ramp markings detected by the lane detection system 2 may be used for the plausibility check. As features or indicators for exit ramp detection, the exit lane and the current lane are detected to be non-parallel or the types of the markings are detected and analyzed. At the level of image analysis, exit ramp detection may be performed by detecting an upsilon-like or lambda-like structure.
  • Furthermore, in connection with exit ramp detection, road signs indicating a speed limit and/or a restriction on passing and recognized by the road sign recognition system 1 may be interpreted as being canceled using the information indicating an exit ramp or an exit ramp region and generated by the lane detection system 2, i.e., these road sign data are not stored in the output storage 7 by the selection-and-plausibility unit 9.
  • Finally, the information generated by the lane detection system 2 with regard to detected exit ramps may also be used to check, on the basis of the frequency of the detected exit ramps or exit ramp regions, the plausibility of road signs recognized by the road sign recognition system 1 that indicate “driving on the right” or “driving on the left”.
  • Furthermore, the plausibility of speed limit signs may be checked using construction-site-indicating information generated by the lane detection system. It is also possible to infer the existence of a construction site with a speed limit without the previous recognition of a speed limit sign by the road sign recognition system 1. This case may occur if, e.g., such road signs are temporarily covered by motor vehicles ahead. Video-based construction site detection may be performed by, e.g., the detection of crash barriers, crash walls or raised structures as well as of colors of markings.
  • As mentioned above, also the information about recognized road signs that is generated by the road sign recognition system 1 includes information that is relevant to the course of the pavement, which relevant information is made available to the lane detection system 2 via the output storage 7 of the road sign recognition system 1.
  • For example, construction-site-indicating information is generated from the road sign information generated by the road sign recognition system 1 as data indicating the course of the lane, whereby the lane detection system 2 is caused to analyze the image data of the storage unit 5 for particular lane course scenarios and/or for indicators for particular lane course scenarios.
  • For example, narrowing lane markings, additional lane markings or particular colors of lane markings are particular lane course scenarios and/or indicators for particular lane course scenarios.
  • Said construction-site-indicating information may be, e.g., construction site signs or a succession of speed limit signs causing the driver to gradually reduce the speed. Furthermore, such information of the road sign recognition system 1 may be used to select the right lane boundaries in the construction site region since the construction site markings might cover the usual lane markings.
  • Finally, said construction-site-indicating information of the road sign recognition system 1 may also be used to disable a lane function (e.g., lane departure warning or lane keeping function) of a driver assistance system of the motor vehicle.
  • Furthermore, information indicating road signs indicating a speed limit and/or the road type is generated from the road sign information generated by the road sign recognition system 1 as data indicating the course of the lane, and said information indicating road signs indicating a speed limit and/or the road type is analyzed for road-type-indicating features by means of the lane detection system 2 or the plausibility of identified road types is checked. For example, with a detected speed limit of 130 km/h, the plausibility of a country road identified by the lane detection system 2 can be checked. Likewise, with expressway or superhighway signs recognized by the road sign recognition system 1, the plausibility of an identified expressway or of an identified superhighway can be checked by the lane detection system 2.
  • If information indicating road signs indicating a speed limit and/or the road type is generated from the road sign information generated by the road sign recognition system 1 as data indicating the course of the lane, the filter dynamics of a filter of the lane detection system 2 is adjusted for generating a lane course scenario, said adjustment being performed on the basis of said information that indicates road signs indicating a speed limit and/or the road type.

Claims (12)

1. A method for combining a road sign recognition system (1) and a lane detection system (2) of a motor vehicle, wherein the road sign recognition system (1) generates road sign information from sensor data of a camera-based or video-based sensor system (4) and the lane detection system (2) generates lane course information from said sensor data,
characterized in that
meaning-indicating data for road signs are generated from the lane course information,
the meaning-indicating data for road signs are used to check the plausibility of and/or to interpret the road sign information,
data indicating the course of the lane are generated from the road sign information, and
the data indicating the course of the lane are used to check the plausibility of and/or to interpret the lane course information.
2. The method according to claim 1,
characterized in that
a plausibility check of a road sign recognized by means of the road sign recognition system (1) is performed using lane-course-indicating data of the lane detection system (2).
3. The method according to claim 1,
characterized in that
information about a line structure of a fast lane of a pavement is generated from the lane course information of the lane detection system (2) as meaning-indicating data for road signs, and
the plausibility of road signs indicating a restriction on passing and recognized by the road sign recognition system (1) is checked using the information about the line structure.
4. The method according to claim 1,
characterized in that
information indicating an exit ramp or an exit ramp region is generated from the lane course information of the lane detection system (2) as meaning-indicating data for road signs, and
the plausibility of road signs indicating a speed limit and/or a restriction on passing and recognized by the road sign recognition system (1) is checked using the information indicating an exit ramp or an exit ramp region.
5. The method according to claim 4,
characterized in that
the fact that the motor vehicle is driving past the exit ramp is detected from the current lane detected by means of the lane detection system (2) and/or from a lane change of the motor vehicle detected by means of the lane detection system and from the information indicating an exit ramp, and
those data which concern recognized road signs indicating a speed limit and/or a restriction on passing and concerning the exit ramp are rejected by the road sign recognition system (1).
6. The method according to claim 4,
characterized in that
the fact that the motor vehicle is leaving the road is detected from the current lane detected by means of the lane detection system (2) and/or from a lane change of the motor vehicle detected by means of the lane detection system (2) and from the information indicating an exit ramp, and
road signs indicating a speed limit and/or a restriction on passing and assigned to the exit ramp and recognized by the road sign recognition system (1) are outputted to a Human Machine Interface (3) of the motor vehicle.
7. The method according to claim 1,
characterized in that
information indicating an exit ramp or an exit ramp region is generated from the lane course information of the lane detection system (2) concerning the current lane of the motor vehicle as meaning-indicating data for road signs, and
road signs indicating a speed limit and/or a restriction on passing and recognized by the road sign recognition system (1) are interpreted as being canceled using the information indicating an exit ramp or an exit ramp region.
8. The method according to claim 1
characterized in that
information indicating an exit ramp or an exit ramp region is generated from the lane course information of the lane detection system (2) concerning the current lane as meaning-indicating data for road signs, and
the plausibility of road signs indicating “driving on the right” or “driving on the left” and recognized by the road sign recognition system (1) is checked on the basis of the frequency of the detected exit ramps or exit ramp regions.
9. The method according to claim 1,
characterized in that
construction-site-indicating information is generated from the lane course information of the lane detection system (2) concerning the current lane as meaning-indicating data for road signs, and
the plausibility of road signs indicating a speed limit and/or a restriction on passing and recognized by the road sign recognition system (1) is checked using the information indicating a construction site.
10. The method according to claim 1,
characterized in that
construction-site-indicating information is generated from the road sign information generated by the road sign recognition system (1) as data indicating the course of the lane, and
the sensor data are analyzed for particular lane course scenarios and/or for indicators for particular lane course scenarios, said analysis being performed by means of the lane detection system (2) on the basis of the construction-site-indicating information.
11. The method according to claim 1,
characterized in that
information indicating road signs indicating a speed limit and/or the road type is generated from the road sign information generated by the road sign recognition system (1) as data indicating the course of the lane, and
the information indicating road signs indicating a speed limit and/or the road type is analyzed for road-type-indicating features by means of the lane detection system (2) or the plausibility of the identified road types is checked.
12. The method according to claim 1
characterized in that
information indicating road signs indicating a speed limit and/or the road type is generated from the road sign information generated by the road sign recognition system (1) as data indicating the course of the lane, and
the filter dynamics of a filter of the lane detection system (2) is adjusted for generating a lane course scenario, said adjustment being performed using the information that indicates road signs indicating a speed limit and/or the road type.
US13/704,364 2010-06-15 2011-03-19 Method for combining a road sign recognition system and a lane detection system of a motor vehicle Active 2031-12-05 US9177212B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
DE102010023791 2010-06-15
DE102010023791.4 2010-06-15
DE102010023791 2010-06-15
PCT/DE2011/000295 WO2011157251A1 (en) 2010-06-15 2011-03-19 Method for combining a road sign recognition system and a lane detection system of a motor vehicle

Publications (2)

Publication Number Publication Date
US20130101174A1 true US20130101174A1 (en) 2013-04-25
US9177212B2 US9177212B2 (en) 2015-11-03

Family

ID=44246156

Family Applications (1)

Application Number Title Priority Date Filing Date
US13/704,364 Active 2031-12-05 US9177212B2 (en) 2010-06-15 2011-03-19 Method for combining a road sign recognition system and a lane detection system of a motor vehicle

Country Status (6)

Country Link
US (1) US9177212B2 (en)
EP (1) EP2583263B1 (en)
JP (1) JP5819420B2 (en)
KR (1) KR101680023B1 (en)
DE (1) DE112011101376A5 (en)
WO (1) WO2011157251A1 (en)

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140257686A1 (en) * 2013-03-05 2014-09-11 GM Global Technology Operations LLC Vehicle lane determination
EP2830029A1 (en) * 2013-07-22 2015-01-28 Robert Bosch Gmbh A method for monitoring a vehicle driving state and a vehicle navigation device for implementing the method
US20150071496A1 (en) * 2013-09-06 2015-03-12 Robert Bosch Gmbh method and control and recording device for the plausibility checking for the wrong-way travel of a motor vehicle
US8996228B1 (en) * 2012-09-05 2015-03-31 Google Inc. Construction zone object detection using light detection and ranging
US9056395B1 (en) * 2012-09-05 2015-06-16 Google Inc. Construction zone sign detection using light detection and ranging
US20150254515A1 (en) * 2014-03-05 2015-09-10 Conti Temic Microelectronic Gmbh Method for Identification of a Projected Symbol on a Street in a Vehicle, Apparatus and Vehicle
US20150302747A1 (en) * 2014-04-22 2015-10-22 Mando Corporation Traffic signs recognition apparatus and method of outputing speed limit using the same
US9195914B2 (en) 2012-09-05 2015-11-24 Google Inc. Construction zone sign detection
US20150348418A1 (en) * 2013-03-06 2015-12-03 Bayerische Motoren Werke Aktiengesellschaft Driver Assistance System and Method for Assisting the Driver of a Motor Vehicle When Leaving a Determined Lane
US9233688B2 (en) 2014-01-30 2016-01-12 Mobileye Vision Technologies Ltd. Systems and methods for lane end recognition
CN105313897A (en) * 2014-07-28 2016-02-10 现代摩比斯株式会社 System and method of recognizing travelled lane of vehicle
US9470537B2 (en) 2014-10-22 2016-10-18 Volkswagen Ag Accurate position determination near exit lanes
US20160350606A1 (en) * 2015-05-29 2016-12-01 Denso Corporation Driving assistance apparatus and driving assistance method
US9547805B1 (en) * 2013-01-22 2017-01-17 The Boeing Company Systems and methods for identifying roads in images
FR3039309A1 (en) * 2015-07-24 2017-01-27 Renault Sa METHOD AND SYSTEM FOR DISPLAYING A DIRECTION PANEL OF THE ROAD SCENE FOR A MOTOR VEHICLE
US9685009B2 (en) 2015-04-01 2017-06-20 Caterpillar Inc. System and method for managing mixed fleet worksites using video and audio analytics
DE102016202973A1 (en) * 2016-02-25 2017-08-31 Bayerische Motoren Werke Aktiengesellschaft Method for recognizing a road construction site
US9898668B2 (en) 2015-08-27 2018-02-20 Qualcomm Incorporated System and method of object detection
US9959624B2 (en) 2014-12-22 2018-05-01 Volkswagen Ag Early detection of turning condition identification using perception technology
US10025996B2 (en) * 2014-12-22 2018-07-17 Volkswagen Ag Early detection of exit only and shared lanes using perception technology
US10207631B2 (en) * 2016-06-17 2019-02-19 Lg Electronics Inc. Control device mounted on vehicle and method for controlling the same
US10324433B2 (en) 2015-04-01 2019-06-18 Caterpillar Inc. System and method for determination of machine state based on video and audio analytics
US10464560B2 (en) * 2016-07-12 2019-11-05 Nissan Motor Co., Ltd. Travel control method and travel control apparatus
EP3499480A4 (en) * 2016-08-09 2020-04-01 Hitachi Automotive Systems, Ltd. Displayed content recognition device and vehicle control device
US20210335132A1 (en) * 2020-04-27 2021-10-28 Here Global B.V. Methods and systems for detecting a speed funnel in a region
US11170237B2 (en) * 2017-05-15 2021-11-09 Bayerische Motoren Werke Aktiengesellschaft Method, device, and system for determining a road construction site
US11288526B2 (en) * 2019-07-09 2022-03-29 Mobiltech Method of collecting road sign information using mobile mapping system
EP4246092A1 (en) 2022-03-15 2023-09-20 FERRARI S.p.A. Vehicle control method with exit intention recognition
EP4246093A1 (en) 2022-03-15 2023-09-20 FERRARI S.p.A. Vehicle control method with road sign recognition

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012025067A1 (en) * 2012-12-19 2014-06-26 Valeo Schalter Und Sensoren Gmbh Driver assistance system for motor vehicle, has computing device to identify longitudinal markings mounted on road-way, and to determine wether identified traffic signs for motor vehicle are applied or not, based on longitudinal markings
US9141107B2 (en) * 2013-04-10 2015-09-22 Google Inc. Mapping active and inactive construction zones for autonomous driving
DE102013219909A1 (en) 2013-10-01 2015-04-02 Conti Temic Microelectronic Gmbh Method and device for detecting traffic signs
DE102014000432A1 (en) * 2014-01-16 2015-07-16 Audi Ag Method for operating a driver assistance system and motor vehicle designed for at least partially automatic vehicle guidance
CN112923936B (en) 2015-02-10 2023-04-18 御眼视觉技术有限公司 Navigation system, method, and computer readable medium for vehicle
DE102015106575A1 (en) 2015-04-29 2016-11-03 Knorr-Bremse Systeme für Nutzfahrzeuge GmbH Method and device for regulating the speed of a vehicle
DE102018108358A1 (en) * 2018-04-09 2019-10-10 Valeo Schalter Und Sensoren Gmbh Method for detecting a construction site and driver assistance system for carrying out such a method
US10762364B2 (en) 2018-04-19 2020-09-01 Here Global B.V. Method, apparatus, and system for traffic sign learning
US10976164B2 (en) 2018-12-12 2021-04-13 Here Global B.V. Methods and systems for route generation through an area
US11010617B2 (en) 2018-12-12 2021-05-18 Here Global B.V. Methods and systems for determining roadwork zone extension based on lane marking data
US11322025B2 (en) 2018-12-12 2022-05-03 Here Global B.V. Method and system for validating existence of roadwork
US10900804B2 (en) 2018-12-12 2021-01-26 Here Global B.V. Methods and systems for roadwork extension identification using speed funnels
US11262209B2 (en) 2018-12-12 2022-03-01 Here Global B.V. Methods and systems for road work extension identification
US11448513B2 (en) 2019-09-17 2022-09-20 Here Global B.V. Methods and systems for generating parallel road data of a region utilized when performing navigational routing functions
FR3108194B1 (en) 2020-03-11 2022-02-25 Psa Automobiles Sa Methods and systems for interpreting messages from variable message signs

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050232469A1 (en) * 2004-04-15 2005-10-20 Kenneth Schofield Imaging system for vehicle
US20070050134A1 (en) * 2005-08-24 2007-03-01 Denso Corporation Navigation apparatus, method and program for vehicle
US20120083960A1 (en) * 2010-10-05 2012-04-05 Google Inc. System and method for predicting behaviors of detected objects

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0785400A (en) * 1993-09-20 1995-03-31 Mitsubishi Motors Corp Automobile running controller
DE19842176A1 (en) 1998-09-15 2000-03-16 Bosch Gmbh Robert Method to identify traffic signs in surroundings of vehicle and for vehicle navigation, involves including satellite-based navigation system and unit to identify vehicle signs, which are used to update data from each other
DE19948734A1 (en) 1999-10-09 2001-04-12 Volkswagen Ag Navigation-assisted traveling over road routes involves using electronically mapped and/or predictive route data verified during travel by permanent checking with correlated check data
JP3964230B2 (en) * 2002-03-01 2007-08-22 アルパイン株式会社 Car navigation system
DE10311240B4 (en) 2003-03-14 2017-03-02 Robert Bosch Gmbh Method and device for tracking a vehicle
DE10334620B4 (en) 2003-07-30 2023-07-06 Robert Bosch Gmbh Generation of traffic information by interpreting traffic sign scenarios and navigation information in a vehicle
DE10343941A1 (en) 2003-09-23 2005-05-12 Bosch Gmbh Robert Method for issuing traffic rules and driver information device
DE102004013440A1 (en) 2004-03-18 2005-10-06 Siemens Ag Method and device for specifying the driving instructions of a navigation system
DE102005052175A1 (en) 2005-11-02 2007-05-24 Robert Bosch Gmbh Information outputting method for use in motor vehicle, involves detecting surrounding of vehicle using image detection unit, and determining momentary driving region and/or momentary driving street type from detected image
JP4572826B2 (en) * 2005-12-06 2010-11-04 トヨタ自動車株式会社 Road marking line detection device
JP2007293390A (en) * 2006-04-20 2007-11-08 Fujifilm Corp Backward travel warning device
DE102006023544A1 (en) 2006-05-19 2007-11-22 GM Global Technology Operations, Inc., Detroit Method for operating a motor vehicle comprises distinguishing between different classes of surroundings based on data measured by a camera and activating the operation of a support function depending on each determined surroundings data
JP2008068751A (en) * 2006-09-14 2008-03-27 Mazda Motor Corp Driving controller for vehicle
JP4914160B2 (en) * 2006-09-26 2012-04-11 日立オートモティブシステムズ株式会社 Vehicle control device
EP2383713B1 (en) 2006-12-06 2013-05-29 Mobileye Technologies Limited Detecting and recognizing traffic signs
DE102007002562A1 (en) 2007-01-17 2008-07-24 Audi Ag Method and device for the dynamic classification of objects and / or traffic situations
DE102007010013A1 (en) 2007-03-01 2008-09-04 Siemens Ag Control device for driver assistance system for vehicle, has input for receiving identification information of country, component for assigning country-specific regulations related to road traffic of respective country
DE102007021576A1 (en) 2007-05-08 2008-11-13 Hella Kgaa Hueck & Co. Method and device for determining the position of a traffic sign
JP5194679B2 (en) 2007-09-26 2013-05-08 日産自動車株式会社 Vehicle periphery monitoring device and video display method
WO2009072507A1 (en) * 2007-12-05 2009-06-11 Nec Corporation Pavement marker recognition device, pavement marker recognition method and pavement marker recognition program
DE102008010968A1 (en) 2008-02-25 2009-09-17 Robert Bosch Gmbh Display of a relevant traffic sign or a relevant traffic facility
DE102008001677A1 (en) 2008-05-09 2009-11-12 Robert Bosch Gmbh Assistance system for driver assistance in vehicles
DE102009036196A1 (en) 2009-08-05 2010-05-06 Daimler Ag Traffic sign recognition method for vehicle, involves recording traffic signs within surrounding of vehicle by optical detection unit, where estimated current relative position of traffic signs is selected or limited within surrounding
DE102009039450A1 (en) 2009-08-31 2010-05-12 Daimler Ag Method for recognizing lane for car during e.g. snowfall, involves determining correctness of detected lane data based on arrangement of reflection markings, where lane data are corrected if required
DE102009057553A1 (en) 2009-12-09 2011-06-16 Conti Temic Microelectronic Gmbh A method for assisting the driver of a road-bound vehicle in the vehicle guidance
JP5454179B2 (en) * 2010-02-02 2014-03-26 トヨタ自動車株式会社 Driving assistance device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050232469A1 (en) * 2004-04-15 2005-10-20 Kenneth Schofield Imaging system for vehicle
US20070050134A1 (en) * 2005-08-24 2007-03-01 Denso Corporation Navigation apparatus, method and program for vehicle
US20120083960A1 (en) * 2010-10-05 2012-04-05 Google Inc. System and method for predicting behaviors of detected objects

Cited By (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9489601B2 (en) 2012-09-05 2016-11-08 X Development Llc Construction zone sign detection
US8996228B1 (en) * 2012-09-05 2015-03-31 Google Inc. Construction zone object detection using light detection and ranging
US9056395B1 (en) * 2012-09-05 2015-06-16 Google Inc. Construction zone sign detection using light detection and ranging
USRE48322E1 (en) 2012-09-05 2020-11-24 Waymo Llc Construction zone sign detection
US9193355B2 (en) * 2012-09-05 2015-11-24 Google Inc. Construction zone sign detection using light detection and ranging
US9195914B2 (en) 2012-09-05 2015-11-24 Google Inc. Construction zone sign detection
US9199641B2 (en) * 2012-09-05 2015-12-01 Google Inc. Construction zone object detection using light detection and ranging
US9547805B1 (en) * 2013-01-22 2017-01-17 The Boeing Company Systems and methods for identifying roads in images
US20140257686A1 (en) * 2013-03-05 2014-09-11 GM Global Technology Operations LLC Vehicle lane determination
US20150348418A1 (en) * 2013-03-06 2015-12-03 Bayerische Motoren Werke Aktiengesellschaft Driver Assistance System and Method for Assisting the Driver of a Motor Vehicle When Leaving a Determined Lane
EP2830029A1 (en) * 2013-07-22 2015-01-28 Robert Bosch Gmbh A method for monitoring a vehicle driving state and a vehicle navigation device for implementing the method
CN104331703A (en) * 2013-07-22 2015-02-04 博世汽车部件(苏州)有限公司 Method of monitoring vehicle running state and automobile navigation equipment for implementing method
US20150071496A1 (en) * 2013-09-06 2015-03-12 Robert Bosch Gmbh method and control and recording device for the plausibility checking for the wrong-way travel of a motor vehicle
US10002298B2 (en) * 2013-09-06 2018-06-19 Robert Bosch Gmbh Method and control and recording device for the plausibility checking for the wrong-way travel of a motor vehicle
US9233688B2 (en) 2014-01-30 2016-01-12 Mobileye Vision Technologies Ltd. Systems and methods for lane end recognition
US9536157B2 (en) * 2014-03-05 2017-01-03 Conti Temic Microelectronic Gmbh Method for identification of a projected symbol on a street in a vehicle, apparatus and vehicle
US20150254515A1 (en) * 2014-03-05 2015-09-10 Conti Temic Microelectronic Gmbh Method for Identification of a Projected Symbol on a Street in a Vehicle, Apparatus and Vehicle
US20150302747A1 (en) * 2014-04-22 2015-10-22 Mando Corporation Traffic signs recognition apparatus and method of outputing speed limit using the same
CN105313897A (en) * 2014-07-28 2016-02-10 现代摩比斯株式会社 System and method of recognizing travelled lane of vehicle
US9824283B2 (en) * 2014-07-28 2017-11-21 Hyundai Mobis Co., Ltd. System and method of recognizing travelled lane of vehicle
US9470537B2 (en) 2014-10-22 2016-10-18 Volkswagen Ag Accurate position determination near exit lanes
US9959624B2 (en) 2014-12-22 2018-05-01 Volkswagen Ag Early detection of turning condition identification using perception technology
US10152638B2 (en) 2014-12-22 2018-12-11 Volkswagen Ag Early detection of exit only and shared lanes using perception technology
US10025996B2 (en) * 2014-12-22 2018-07-17 Volkswagen Ag Early detection of exit only and shared lanes using perception technology
US10324433B2 (en) 2015-04-01 2019-06-18 Caterpillar Inc. System and method for determination of machine state based on video and audio analytics
US9685009B2 (en) 2015-04-01 2017-06-20 Caterpillar Inc. System and method for managing mixed fleet worksites using video and audio analytics
US20160350606A1 (en) * 2015-05-29 2016-12-01 Denso Corporation Driving assistance apparatus and driving assistance method
US10169669B2 (en) * 2015-05-29 2019-01-01 Denso Corporation Driving assistance apparatus and driving assistance method
FR3039309A1 (en) * 2015-07-24 2017-01-27 Renault Sa METHOD AND SYSTEM FOR DISPLAYING A DIRECTION PANEL OF THE ROAD SCENE FOR A MOTOR VEHICLE
WO2017017359A1 (en) * 2015-07-24 2017-02-02 Renault S.A.S Method and system for displaying a direction sign of the road scene for a motor vehicle
US9898668B2 (en) 2015-08-27 2018-02-20 Qualcomm Incorporated System and method of object detection
US10878258B2 (en) * 2016-02-25 2020-12-29 Bayerische Motoren Werke Aktiengesellschaft Method for detecting roadworks
US20180365507A1 (en) * 2016-02-25 2018-12-20 Bayerische Motoren Werke Aktiengesellschaft Method for Detecting Roadworks
DE102016202973A1 (en) * 2016-02-25 2017-08-31 Bayerische Motoren Werke Aktiengesellschaft Method for recognizing a road construction site
DE102016202973B4 (en) 2016-02-25 2018-05-17 Bayerische Motoren Werke Aktiengesellschaft Method for recognizing a road construction site
US10207631B2 (en) * 2016-06-17 2019-02-19 Lg Electronics Inc. Control device mounted on vehicle and method for controlling the same
US10464560B2 (en) * 2016-07-12 2019-11-05 Nissan Motor Co., Ltd. Travel control method and travel control apparatus
EP3499480A4 (en) * 2016-08-09 2020-04-01 Hitachi Automotive Systems, Ltd. Displayed content recognition device and vehicle control device
US11170237B2 (en) * 2017-05-15 2021-11-09 Bayerische Motoren Werke Aktiengesellschaft Method, device, and system for determining a road construction site
US11288526B2 (en) * 2019-07-09 2022-03-29 Mobiltech Method of collecting road sign information using mobile mapping system
US20210335132A1 (en) * 2020-04-27 2021-10-28 Here Global B.V. Methods and systems for detecting a speed funnel in a region
US11527161B2 (en) * 2020-04-27 2022-12-13 Here Global B.V. Methods and systems for detecting a speed funnel in a region
EP4246092A1 (en) 2022-03-15 2023-09-20 FERRARI S.p.A. Vehicle control method with exit intention recognition
EP4246093A1 (en) 2022-03-15 2023-09-20 FERRARI S.p.A. Vehicle control method with road sign recognition

Also Published As

Publication number Publication date
WO2011157251A1 (en) 2011-12-22
EP2583263A1 (en) 2013-04-24
KR20130109097A (en) 2013-10-07
US9177212B2 (en) 2015-11-03
DE112011101376A5 (en) 2013-02-21
JP5819420B2 (en) 2015-11-24
EP2583263B1 (en) 2014-03-19
JP2013531850A (en) 2013-08-08
KR101680023B1 (en) 2016-11-28

Similar Documents

Publication Publication Date Title
US9177212B2 (en) Method for combining a road sign recognition system and a lane detection system of a motor vehicle
US10169669B2 (en) Driving assistance apparatus and driving assistance method
JP5233816B2 (en) Driving support device, driving support method, and driving support program
US8600673B2 (en) Driving assistance apparatus
CN102481931B (en) Vehicle Controller
US9500491B2 (en) Method for position determination
US9767686B2 (en) Method and control and detection device for determining the plausibility of a wrong-way travel of a motor vehicle
US8560220B2 (en) Method and apparatus for determining a plausible lane for guiding a vehicle and an automobile
US20120188374A1 (en) Method for operating a driver assist system of an automobile providing a recommendation relating to a passing maneuver, and an automobile
WO2010035781A1 (en) Lane determining device and navigation system
US20120242505A1 (en) Road-vehicle cooperative driving safety support device
US7777616B2 (en) Intersection information provision system and driving assist system
US20160210855A1 (en) Method and traffic monitoring device for detecting a wrong-way driving incidnet of a motor vehicle
JP5898539B2 (en) Vehicle driving support system
CN101727759A (en) Driver assistant system for automobile
JP2007153031A (en) Vehicle position calculation method and onboard device
JP4948338B2 (en) Inter-vehicle distance measuring device
JP4876147B2 (en) Lane judgment device and navigation system
JP2008298699A (en) Own vehicle position recognition device and own vehicle position recognition method
JP4891745B2 (en) Exit detection device
JP4968369B2 (en) In-vehicle device and vehicle recognition method
KR101281499B1 (en) Automatic vehicle driving system
KR20200141796A (en) Vehicle and control method thereof
JP2005018461A (en) Vehicular surrounding circumstance determining device
JP2020051943A (en) Stereo camera device for vehicles

Legal Events

Date Code Title Description
AS Assignment

Owner name: CONTI TEMIC MICROELECTRONIC GMBH, GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MEIS, URBAN;GUTMANN, CHRISTIAN;SCHORN, MATTHIAS;AND OTHERS;SIGNING DATES FROM 20121214 TO 20121222;REEL/FRAME:029605/0204

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8