EP1530186A2 - Method and apparatus for discriminating the colour of road markings - Google Patents
Method and apparatus for discriminating the colour of road markings Download PDFInfo
- Publication number
- EP1530186A2 EP1530186A2 EP04256766A EP04256766A EP1530186A2 EP 1530186 A2 EP1530186 A2 EP 1530186A2 EP 04256766 A EP04256766 A EP 04256766A EP 04256766 A EP04256766 A EP 04256766A EP 1530186 A2 EP1530186 A2 EP 1530186A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- colour
- road
- camera
- intensity
- areas
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 24
- 239000003086 colorant Substances 0.000 claims abstract description 15
- 238000000862 absorption spectrum Methods 0.000 claims description 4
- 244000025254 Cannabis sativa Species 0.000 description 2
- 239000010426 asphalt Substances 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000003973 paint Substances 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
- G01J3/50—Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
- G01J3/50—Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors
- G01J3/51—Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors using colour filters
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/161—Decentralised systems, e.g. inter-vehicle communication
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60T—VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
- B60T2201/00—Particular use of vehicle brake systems; Special systems using also the brakes; Special software modules within the brake system controller
- B60T2201/08—Lane monitoring; Lane Keeping Systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60T—VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
- B60T2201/00—Particular use of vehicle brake systems; Special systems using also the brakes; Special software modules within the brake system controller
- B60T2201/08—Lane monitoring; Lane Keeping Systems
- B60T2201/089—Lane monitoring; Lane Keeping Systems using optical detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
- G01J2003/466—Coded colour; Recognition of predetermined colour; Determining proximity to predetermined colour
Definitions
- This invention relates to a method of and apparatus for discriminating the colour of road markings, especially but not exclusively in the field of lane departure warning systems.
- Lane Departure Warning and other automotive guidance systems use optical cameras to view the road markings ahead.
- LDW Lane Departure Warning
- a method of discriminating between road markings of at least two colours comprising:
- first and second colour responses we may mean that the camera is more or less sensitive to one or more colours in the first area with respect to the second area.
- This method therefore provides a simple method of discriminating the colour of a road marking without requiring the use of a colour camera.
- monochrome we mean that the camera is a black and white camera in that it is capable of measuring the intensity but not the hue of an image.
- the camera may be fitted to a vehicle, and the method may be adapted to determine the colour of a road marking from a vehicle.
- the method may also detect the edge of the road.
- the edge of a road may be recognised by a change in intensity due to the change of material from a road surface (for example, asphalt) to that surrounding the road (for example, mud or grass).
- the difference in colour response may provide more information as to the position of the edge of the road than intensity alone, especially when the difference in intensity over the edge is low.
- the step of determining the change in intensity of the captured image may comprise the step of comparing the intensity of the portions in the first and second areas and discriminating between the two colours according to the contrast in intensity between the two areas.
- the step of capturing the image may comprise viewing the image through filter means, wherein sections of the filter means of different absorbance spectra provide the different colour response of the first and second areas. At least one of the sections may be coloured, and may be close to or the same as one of the colours of road markings to be discriminated.
- a marking may be determined to be of similar colour to the coloured section if the change between the two sections is less than a certain limit, which may be an absolute (that is, the measured intensity changes by a given amount) or a relative (that is, the measured intensity changes by a given ratio) limit.
- the markings may be lane boundaries marked on the road.
- the coloured section is yellow.
- the method may further include providing the marking colour determination to an automotive guidance system.
- automotive guidance system we may include lane departure warning systems, automatic cruise control systems and the like.
- the method may further include the step of discriminating between further colours of road marking by providing the camera with at least one further area in the field of view, each of which having a colour response different to the first and second areas.
- the filter means may be provided with at least one further coloured section, which may be a different colour to the coloured section and any other further coloured sections. This enables the method to discriminate, between a plurality of colours, the colour of different colour road markings from measured changes in intensity of the image of the road between the first, second and further areas.
- the coloured section may be yellow and there may be provided red and blue further coloured sections.
- an apparatus arranged to be fitted to a vehicle and capable of discriminating between at least a first colour and a second colour of road markings, comprising:
- first and second colour responses we may mean that the camera is more or less sensitive to one or more colours in the first area with respect to the second area.
- This provides an apparatus that can distinguish between different colour road markings whilst still being able to use a black and white (monochrome) camera.
- the apparatus may also be arranged to detect the edge of the road.
- the edge of a road may be recognised by a change in intensity due to the change of material from a road surface (for example, asphalt) to that surrounding the road (for example, mud or grass).
- the difference in colour response may provide more information as to the position of the edge of the road than intensity alone, especially when the difference in intensity over the edge is low.
- the camera may be provided with filter means wherein sections of the filter means of different absorbance spectra provide the different colour response of the first and second areas. At least one of the sections may be coloured, and may be close to or the same as one of the colours of road markings to be discriminated.
- the filter means may be of the form of a background (which may be uncoloured), preferably having a band of colour forming the coloured area.
- the band may be straight, and may be horizontal. This is advantageous, as most road markings will appear substantially vertical to a vehicle-mounted camera.
- the filter means may be a filter, which may comprise a single filter component.
- the filter may comprise a plurality of filter components.
- the camera may have a lens, and the filter means may be provided between the lens and the image to be captured.
- the filter may be provided between the lens and a sensor element.
- the coloured section of the filter means may cover an area greater than one adjacent pixel in the image as captured. Indeed, it may cover an area greater than 10 or 100 pixels in the image as captured.
- the filter means may cover a majority of the field of view.
- the coloured area is yellow.
- the camera may be provided with at least one further area in the field of view, each of which having a colour response different to the first and second areas.
- a plurality of coloured areas may be provided, which may each have at least one boundary in the field of view of the camera.
- the coloured sections may be of different colours to one another.
- the processing unit may be adapted to determine the colour of the road markings from the change in intensity of the captured image of the road markings over the, or each, boundary. There may be coloured sections coloured yellow, red and blue.
- the apparatus may form part of an automotive guidance system, such as a lane departure warning system or an automatic cruise control system.
- the apparatus may be arranged to carry out the method of the first aspect of the invention.
- a vehicle fitted with the apparatus of the second aspect of the invention.
- the vehicle 100 depicted in Figure 1 of the accompanying drawings has been fitted with a lane departure warning system.
- This comprises a monochrome video camera 102 connected to a processing unit 103, which is arranged to capture images from the video camera 102.
- the processing unit then analyses the images to determine the position of the lanes as is known in the prior art, such as in PCT publication number WO 03/087724 published 23 October 2003, and to give a user of the vehicle an indication of when they are leaving a marked lane.
- the camera 102 is fitted with a filter 104, which is depicted in more detail in Figure 2 of the accompanying drawings.
- This comprises a generally clear background 110 overlaid with a horizontal yellow filter section 112.
- the processing unit 103 may be able to determine whether the lane markings are yellow or white by comparing the measured intensity of the captured image of the relevant lane marking at either side of the yellow filter section 112 and within the yellow filter section 112. This can be determined by measuring the intensity along each detected lane marking as it crosses the yellow filter section 112. This can be seen in more detail in Figures 4a and 4b of the accompanying drawings.
- Figures 4a and 4b of the accompanying drawings show the measured intensity along the two lane markings 115 and 117 depicted in Figure 3 of the accompanying drawings.
- Figure 4a depicts the measured intensity along line Y-Y' along yellow line 115
- Figure 4b depicts the measured intensity along line W-W' along white line 117.
- the intensity measured within the yellow filter section 112 is the same as measured in the clear background 110 and as such the intensity does not greatly change, indicating a yellow lane marking 115.
- Figure 4b shows the effect that the yellow filter section 112 has on white line 117. A significant drop in measured intensity occurs over the yellow filter area 112, thereby indicating the presence of a white lane marking 115.
- the processing unit 103 can determine whether the lane markings are white or yellow. In a preferred embodiment, the processing unit determines that the lane marking is yellow if the difference in the measured intensities is less than a predetermined ratio.
- the processing unit can then act on its determination. For example, yellow lane markings may take precedence over white lane markings, such that the lane departure warning system preferentially follows yellow lane markings rather than white lane markings. Alternatively, the system may simply display which lane markings are which to the user.
- the filter 104 above is replaced with the alternative filter 150 shown in Figure 5 of the accompanying drawings.
- a clear background 151 is provided as before, but in this embodiment a plurality (in this case, three) different colour filter sections 152a, 152b, 152c are provided each separated by an area of clear background 151. Any number of colour filter sections may be provided, the colour of each corresponding with a lane marking which it is desired to differentiate from other, generally white, lane markings.
- colour filter section 152a may be yellow
- colour filter section 152b may be blue
- colour filter section 152c may be red.
- the changes in intensity along each detected lane marking over the different colour filter sections 152 may be determined.
- a small change in intensity (typically measured as a ratio) over a given colour filter section 152 implies that the lane marking is of that colour, whilst no significant changes in intensity over any of the colour filter sections 152 implying a white marking.
Abstract
Description
- This invention relates to a method of and apparatus for discriminating the colour of road markings, especially but not exclusively in the field of lane departure warning systems.
- Lane Departure Warning (LDW) and other automotive guidance systems use optical cameras to view the road markings ahead. For economy, it is common practice to use a black and white (monochrome) camera.
- In some countries, road works or other diversion lanes are marked in coloured paint and the original (generally white) lines are not deleted. Black and white LDW systems may find it hard to discriminate between the two. Distinguishing between white and other colour lines by using absolute intensity is susceptible to local changes in ambient light (such as shadows) and faded paint. It is therefore desirable to be able to detect the difference between different coloured road markings. Herein, "determining" should be read to include distinguishing between two or more different possible colours for a road marking.
- According to a first aspect of the invention, we provide a method of discriminating between road markings of at least two colours, comprising:
- capturing an image of a road and at least one road marking with a monochrome camera having a first colour response in a first area of a field of view of the camera and a second colour response in a second area of the field of view; and
- determining the change in intensity of the captured image of the road marking between the first and second areas.
-
- By first and second colour responses, we may mean that the camera is more or less sensitive to one or more colours in the first area with respect to the second area.
- This method therefore provides a simple method of discriminating the colour of a road marking without requiring the use of a colour camera.
- By monochrome, we mean that the camera is a black and white camera in that it is capable of measuring the intensity but not the hue of an image. The camera may be fitted to a vehicle, and the method may be adapted to determine the colour of a road marking from a vehicle.
- The method may also detect the edge of the road. The edge of a road may be recognised by a change in intensity due to the change of material from a road surface (for example, asphalt) to that surrounding the road (for example, mud or grass). The difference in colour response may provide more information as to the position of the edge of the road than intensity alone, especially when the difference in intensity over the edge is low.
- The step of determining the change in intensity of the captured image may comprise the step of comparing the intensity of the portions in the first and second areas and discriminating between the two colours according to the contrast in intensity between the two areas.
- The step of capturing the image may comprise viewing the image through filter means, wherein sections of the filter means of different absorbance spectra provide the different colour response of the first and second areas. At least one of the sections may be coloured, and may be close to or the same as one of the colours of road markings to be discriminated.
- From the change in intensity, it may be determined whether the road marking is of similar colour to the coloured section or is of a different colour. A marking may be determined to be of similar colour to the coloured section if the change between the two sections is less than a certain limit, which may be an absolute (that is, the measured intensity changes by a given amount) or a relative (that is, the measured intensity changes by a given ratio) limit.
- The markings may be lane boundaries marked on the road. In a preferred embodiment, the coloured section is yellow.
- The method may further include providing the marking colour determination to an automotive guidance system. By automotive guidance system, we may include lane departure warning systems, automatic cruise control systems and the like.
- The method may further include the step of discriminating between further colours of road marking by providing the camera with at least one further area in the field of view, each of which having a colour response different to the first and second areas. In the case where filter means are provided, the filter means may be provided with at least one further coloured section, which may be a different colour to the coloured section and any other further coloured sections. This enables the method to discriminate, between a plurality of colours, the colour of different colour road markings from measured changes in intensity of the image of the road between the first, second and further areas. The coloured section may be yellow and there may be provided red and blue further coloured sections.
- According to the second aspect of the invention, there is provided an apparatus arranged to be fitted to a vehicle and capable of discriminating between at least a first colour and a second colour of road markings, comprising:
- a monochrome camera arranged to view the road ahead of the vehicle, and
- a processing unit, arranged to capture images from the camera and determine from the captured images the position of road markings; in which the camera has a first colour response in a first area of a field of view of the camera and a second colour response in a second area of the field of view; and in which the processing unit is arrange to discriminate between the first and second colour of the road markings from the change in intensity of the captured image of the road markings between first and second areas.
-
- By first and second colour responses, we may mean that the camera is more or less sensitive to one or more colours in the first area with respect to the second area.
- This provides an apparatus that can distinguish between different colour road markings whilst still being able to use a black and white (monochrome) camera.
- The apparatus may also be arranged to detect the edge of the road. The edge of a road may be recognised by a change in intensity due to the change of material from a road surface (for example, asphalt) to that surrounding the road (for example, mud or grass). The difference in colour response may provide more information as to the position of the edge of the road than intensity alone, especially when the difference in intensity over the edge is low.
- The camera may be provided with filter means wherein sections of the filter means of different absorbance spectra provide the different colour response of the first and second areas. At least one of the sections may be coloured, and may be close to or the same as one of the colours of road markings to be discriminated.
- The filter means may be of the form of a background (which may be uncoloured), preferably having a band of colour forming the coloured area. The band may be straight, and may be horizontal. This is advantageous, as most road markings will appear substantially vertical to a vehicle-mounted camera.
- The filter means may be a filter, which may comprise a single filter component. Alternatively, the filter may comprise a plurality of filter components.
- The camera may have a lens, and the filter means may be provided between the lens and the image to be captured. Alternatively, the filter may be provided between the lens and a sensor element. The coloured section of the filter means may cover an area greater than one adjacent pixel in the image as captured. Indeed, it may cover an area greater than 10 or 100 pixels in the image as captured. The filter means may cover a majority of the field of view.
- In a preferred embodiment, the coloured area is yellow.
- The camera may be provided with at least one further area in the field of view, each of which having a colour response different to the first and second areas. In the case where filter means are provided, a plurality of coloured areas may be provided, which may each have at least one boundary in the field of view of the camera. The coloured sections may be of different colours to one another. The processing unit may be adapted to determine the colour of the road markings from the change in intensity of the captured image of the road markings over the, or each, boundary. There may be coloured sections coloured yellow, red and blue.
- The apparatus may form part of an automotive guidance system, such as a lane departure warning system or an automatic cruise control system.
- The apparatus may be arranged to carry out the method of the first aspect of the invention.
- According to a third aspect of the invention, there is provided a vehicle fitted with the apparatus of the second aspect of the invention.
- There now follows, by way of example, an embodiment of the present invention, described with reference to the accompanying drawings, in which:
- Figure 1 shows a vehicle fitted with a lane departure warning sensor according to the present invention;
- Figure 2 shows a first embodiment of the filter used in the present invention;
- Figure 3 shows a view of lane markings as captured through the filter of Figure 2;
- Figures 4a and 4b show the measured intensities along lines Y-Y' and W-W' of Figure 3, respectively; and
- Figure 5 shows an alternate embodiment of the filter used in the present invention.
-
- The
vehicle 100 depicted in Figure 1 of the accompanying drawings has been fitted with a lane departure warning system. This comprises amonochrome video camera 102 connected to aprocessing unit 103, which is arranged to capture images from thevideo camera 102. The processing unit then analyses the images to determine the position of the lanes as is known in the prior art, such as in PCT publication number WO 03/087724 published 23 October 2003, and to give a user of the vehicle an indication of when they are leaving a marked lane. - In order that the
monochrome video camera 102 is able to distinguish between white and yellow lane markings, thecamera 102 is fitted with afilter 104, which is depicted in more detail in Figure 2 of the accompanying drawings. This comprises a generallyclear background 110 overlaid with a horizontalyellow filter section 112. - Accordingly, when the
processing unit 103 captures images of lanes, such as the exemplary image of Figure 3 of the accompanying drawings, theprocessing unit 103 may be able to determine whether the lane markings are yellow or white by comparing the measured intensity of the captured image of the relevant lane marking at either side of theyellow filter section 112 and within theyellow filter section 112. This can be determined by measuring the intensity along each detected lane marking as it crosses theyellow filter section 112. This can be seen in more detail in Figures 4a and 4b of the accompanying drawings. - Figures 4a and 4b of the accompanying drawings show the measured intensity along the two
lane markings yellow line 115, and Figure 4b depicts the measured intensity along line W-W' alongwhite line 117. As can be seen in Figure 4a, the intensity measured within theyellow filter section 112 is the same as measured in theclear background 110 and as such the intensity does not greatly change, indicating a yellow lane marking 115. However, Figure 4b shows the effect that theyellow filter section 112 has onwhite line 117. A significant drop in measured intensity occurs over theyellow filter area 112, thereby indicating the presence of a white lane marking 115. - From the difference in intensities within and without the
yellow filter section 112, theprocessing unit 103 can determine whether the lane markings are white or yellow. In a preferred embodiment, the processing unit determines that the lane marking is yellow if the difference in the measured intensities is less than a predetermined ratio. - The processing unit can then act on its determination. For example, yellow lane markings may take precedence over white lane markings, such that the lane departure warning system preferentially follows yellow lane markings rather than white lane markings. Alternatively, the system may simply display which lane markings are which to the user.
- It is appreciated that different territories, states and countries may have different coloured lane markings. In an alternative embodiment, the
filter 104 above is replaced with thealternative filter 150 shown in Figure 5 of the accompanying drawings. Aclear background 151 is provided as before, but in this embodiment a plurality (in this case, three) differentcolour filter sections clear background 151. Any number of colour filter sections may be provided, the colour of each corresponding with a lane marking which it is desired to differentiate from other, generally white, lane markings. In the present embodiment, colour filter section 152a may be yellow,colour filter section 152b may be blue andcolour filter section 152c may be red. - In the same way as in the first embodiment, the changes in intensity along each detected lane marking over the different
colour filter sections 152 may be determined. A small change in intensity (typically measured as a ratio) over a givencolour filter section 152 implies that the lane marking is of that colour, whilst no significant changes in intensity over any of thecolour filter sections 152 implying a white marking.
Claims (21)
- A method of discriminating between road markings of at least two colours, comprising:capturing an image of a road and at least one road marking with a monochrome camera having a first colour response in a first area of a field of view of the camera and a second colour response in a second area of the field of view; anddetermining the change in intensity of the captured image of the road marking between the first and second areas.
- The method of claim 1 in which the step of determining the change in intensity of the captured image comprises the step of comparing the intensity of the portions in the first and second areas and discriminating between the two colours according to the contrast in intensity between the two areas.
- The method of claim 1 or claim 2 in which the method is adapted to determine the colour of a road marking from a vehicle and the camera is adapted to be fitted to a vehicle.
- The method of any preceding claim in which the step of capturing the image comprises viewing the image through filter means, wherein sections of the filter means of different absorbance spectra provide the different colour response of the first and second areas.
- The method of claim 4 in which at least one of the sections of the filter means are coloured, and from the change in intensity, it is determined whether the road marking is of similar colour to the coloured section or is of a different colour.
- The method of any preceding claim in which the markings are lane boundaries marked on the road.
- The method of any preceding claim, further including providing the marking colour determination to an automotive guidance system.
- The method of any preceding claim, further including the step of discriminating between further colours of road marking by providing the camera with at least one further area in the field of view, the or each further area having a colour response different to the first and second areas.
- The method of any preceding claim in which the method discriminates the colour of different colour road markings from measured changes in intensity of the image of the road between the first, second and further areas.
- The method of any preceding claim, which detects the edge of a road.
- An apparatus arranged to be fitted to a vehicle and capable of discriminating between at least a first colour and a second colour of road markings, comprising:a monochrome camera arranged to view the road ahead of the vehicle, anda processing unit, arranged to capture images from the camera and determine from the captured images the position of road markings;
- The apparatus of claim 11 in which the camera is provided with filter means wherein sections of the filter means of different absorbance spectra provide the different colour response of the first and second areas.
- The apparatus of claim 12 in which at least one of the sections is coloured, and is close to or the same colour as one of the colours of road markings to be discriminated.
- The apparatus of claim 13 in which the filter means are of the form of a background having a band of colour forming the coloured area.
- The apparatus of claim 14 in which the band is straight and horizontal.
- The apparatus of any one of claims 12 to 15 in which the camera has a lens, and the filter means are provided between the lens and the image to be captured.
- The apparatus of any one of claims 12 to 16 in which the filter means covers a majority of the field of view.
- The apparatus of any one of claims 11 to 17 in which the camera is provided with at least one further area in the field of view, each of which having a colour response different to the first and second areas.
- The apparatus of any one of claims 11 to 18 in which the apparatus is arranged to detect the edge of a road.
- The apparatus of any one of claims 11 to 19 in which the apparatus forms part of an automotive guidance system, such as a lane departure warning system or an automatic cruise control system.
- A vehicle fitted with the apparatus of any one of claims 11 to 20.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB0325990 | 2003-11-07 | ||
GBGB0325990.0A GB0325990D0 (en) | 2003-11-07 | 2003-11-07 | Method and apparatus for discriminating the colour of road markings |
Publications (3)
Publication Number | Publication Date |
---|---|
EP1530186A2 true EP1530186A2 (en) | 2005-05-11 |
EP1530186A3 EP1530186A3 (en) | 2005-09-07 |
EP1530186B1 EP1530186B1 (en) | 2006-12-20 |
Family
ID=29726111
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP04256766A Active EP1530186B1 (en) | 2003-11-07 | 2004-11-03 | Method and apparatus for discriminating the colour of road markings |
Country Status (5)
Country | Link |
---|---|
US (1) | US7613326B2 (en) |
EP (1) | EP1530186B1 (en) |
DE (1) | DE602004003771T2 (en) |
ES (1) | ES2279302T3 (en) |
GB (1) | GB0325990D0 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2007036695A1 (en) * | 2005-09-27 | 2007-04-05 | Trw Limited | Image analysis |
US20120033074A1 (en) * | 2009-02-04 | 2012-02-09 | Hella Kgaa Hueck & Co. | Method and device for determining a valid lane marking |
EP3121760A1 (en) * | 2015-07-20 | 2017-01-25 | Dura Operating, LLC | System and method for generating and communicating lane information from a host vehicle to a vehicle-to-vehicle network |
EP3121762A1 (en) * | 2015-07-20 | 2017-01-25 | Dura Operating, LLC | Sensor fusion of camera and v2v data for vehicles |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4143521B2 (en) * | 2003-11-12 | 2008-09-03 | 三菱電機株式会社 | In-vehicle camera |
US8676492B2 (en) * | 2006-01-19 | 2014-03-18 | GM Global Technology Operations LLC | Map-aided vision-based lane sensing |
DE102007017293A1 (en) * | 2007-04-12 | 2008-10-16 | Continental Automotive Gmbh | Evaluation device for use in motor vehicle, has determination unit determining roadway limits using both image information captured by black-and-white camera and color camera which is aligned in rear side of vehicle |
DE102008031861B4 (en) * | 2008-07-05 | 2019-09-05 | Hans-Heinrich Götting jun. | Track sensor for detecting optical marks on a web |
US9811743B2 (en) * | 2015-06-29 | 2017-11-07 | Sharp Laboratories Of America, Inc. | Tracking road boundaries |
DE102016220647A1 (en) * | 2016-10-20 | 2018-04-26 | Audi Ag | A method of presenting at least one supplementary difference lane equipment |
KR101946334B1 (en) * | 2016-12-07 | 2019-05-10 | 주식회사 만도 | Apparatus and method for normal route driving of vehicle |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS60157611A (en) * | 1984-01-28 | 1985-08-17 | Toshiba Corp | Controller of unmanned conveying car |
EP0409642A2 (en) * | 1989-07-20 | 1991-01-23 | Fujitsu Limited | Automatic guidance of vehicles along guide lines |
EP0697641A2 (en) * | 1994-07-12 | 1996-02-21 | Honda Giken Kogyo Kabushiki Kaisha | Lane image processing system for vehicle |
US6038496A (en) * | 1995-03-07 | 2000-03-14 | Daimlerchrysler Ag | Vehicle with optical scanning device for a lateral road area |
US6493614B1 (en) * | 2001-12-24 | 2002-12-10 | Samsung Electronics Co., Ltd. | Automatic guided system and control method thereof |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA1229392A (en) * | 1984-02-28 | 1987-11-17 | Hirosato Yamane | Method and apparatus for detection of surface defects of hot metal body |
US6091833A (en) * | 1996-08-28 | 2000-07-18 | Matsushita Electric Industrial Co., Ltd. | Local positioning apparatus, and a method therefor |
US6591000B1 (en) | 1998-04-21 | 2003-07-08 | Denso Corporation | Apparatus and method for preprocessing a picked-up image, lane mark recognizing system, related vehicle traveling control system, and recording media |
DE19852631C2 (en) * | 1998-11-14 | 2001-09-06 | Daimler Chrysler Ag | Device and method for traffic sign recognition |
JP3830748B2 (en) | 2000-10-13 | 2006-10-11 | 株式会社豊田中央研究所 | Lane mark emphasis device |
JP4861574B2 (en) * | 2001-03-28 | 2012-01-25 | パナソニック株式会社 | Driving assistance device |
-
2003
- 2003-11-07 GB GBGB0325990.0A patent/GB0325990D0/en not_active Ceased
-
2004
- 2004-11-03 EP EP04256766A patent/EP1530186B1/en active Active
- 2004-11-03 DE DE602004003771T patent/DE602004003771T2/en active Active
- 2004-11-03 ES ES04256766T patent/ES2279302T3/en active Active
- 2004-11-05 US US10/982,171 patent/US7613326B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS60157611A (en) * | 1984-01-28 | 1985-08-17 | Toshiba Corp | Controller of unmanned conveying car |
EP0409642A2 (en) * | 1989-07-20 | 1991-01-23 | Fujitsu Limited | Automatic guidance of vehicles along guide lines |
EP0697641A2 (en) * | 1994-07-12 | 1996-02-21 | Honda Giken Kogyo Kabushiki Kaisha | Lane image processing system for vehicle |
US6038496A (en) * | 1995-03-07 | 2000-03-14 | Daimlerchrysler Ag | Vehicle with optical scanning device for a lateral road area |
US6493614B1 (en) * | 2001-12-24 | 2002-12-10 | Samsung Electronics Co., Ltd. | Automatic guided system and control method thereof |
Non-Patent Citations (1)
Title |
---|
PATENT ABSTRACTS OF JAPAN vol. 009, no. 334 (P-417), 27 December 1985 (1985-12-27) & JP 60 157611 A (TOSHIBA KK), 17 August 1985 (1985-08-17) * |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2007036695A1 (en) * | 2005-09-27 | 2007-04-05 | Trw Limited | Image analysis |
US20120033074A1 (en) * | 2009-02-04 | 2012-02-09 | Hella Kgaa Hueck & Co. | Method and device for determining a valid lane marking |
JP2012517058A (en) * | 2009-02-04 | 2012-07-26 | ヘラ コマンディートゲゼルシャフト アウフ アクチエン フエック ウント コンパニー | Method and apparatus for determining valid lane markings |
US9626571B2 (en) | 2009-02-04 | 2017-04-18 | Hella Kgaa Hueck & Co. | Method and device for determining a valid lane marking |
US10183666B2 (en) | 2009-02-04 | 2019-01-22 | Hella Kgaa Hueck & Co. | Method and device for determining a valid lane marking |
EP3121760A1 (en) * | 2015-07-20 | 2017-01-25 | Dura Operating, LLC | System and method for generating and communicating lane information from a host vehicle to a vehicle-to-vehicle network |
EP3121762A1 (en) * | 2015-07-20 | 2017-01-25 | Dura Operating, LLC | Sensor fusion of camera and v2v data for vehicles |
CN106373417A (en) * | 2015-07-20 | 2017-02-01 | 德韧营运有限责任公司 | System and method for generating and communicating lane information from a host vehicle to a vehicle-to-vehicle network |
US9922565B2 (en) | 2015-07-20 | 2018-03-20 | Dura Operating Llc | Sensor fusion of camera and V2V data for vehicles |
US10282997B2 (en) | 2015-07-20 | 2019-05-07 | Dura Operating, Llc | System and method for generating and communicating lane information from a host vehicle to a vehicle-to-vehicle network |
Also Published As
Publication number | Publication date |
---|---|
US20050129279A1 (en) | 2005-06-16 |
EP1530186B1 (en) | 2006-12-20 |
GB0325990D0 (en) | 2003-12-10 |
ES2279302T3 (en) | 2007-08-16 |
US7613326B2 (en) | 2009-11-03 |
EP1530186A3 (en) | 2005-09-07 |
DE602004003771T2 (en) | 2007-10-11 |
DE602004003771D1 (en) | 2007-02-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10387735B2 (en) | Monitoring unit for a motor vehicle, having partial color encoding | |
US10078789B2 (en) | Vehicle parking assist system with vision-based parking space detection | |
US9883148B2 (en) | Color mask for an image sensor of a vehicle camera | |
US20160325682A1 (en) | Vehicle vision system with road line sensing algorithm and lane departure warning | |
EP2674323B1 (en) | Rear obstruction detection | |
EP1530186B1 (en) | Method and apparatus for discriminating the colour of road markings | |
JP3782322B2 (en) | In-vehicle image processing camera device | |
KR101913876B1 (en) | Method of processing images and apparatus | |
KR101742490B1 (en) | System for inspecting vehicle in violation by intervention and the method thereof | |
JP2009071836A (en) | Automobile driving assistance device comprising a stereoscopic image capturing system | |
JP3926673B2 (en) | Vehicle type identification device | |
US20100214455A1 (en) | Camera set-up and method for ascertaining picture signals having color values | |
KR20190123720A (en) | Apparatus and method for detecting a phase of a traffic light for a vehicle | |
US7369172B2 (en) | Vehicular camera | |
EP3163867A1 (en) | Automated vehicle imager device with improved infrared sensitivity | |
WO2010115020A2 (en) | Color and pattern detection system | |
KR101651061B1 (en) | Method and device for lane detection | |
JP4674572B2 (en) | Adjusted image creation device | |
JPH1038562A (en) | Obstacle detector for vehicle | |
US20160080659A1 (en) | Assistance System of a Motor Vehicle, with a Camera Comprising an Image Sensor, as well as Image Sensor of a Camera | |
Wueller | Colors challenges in navigating autonomous vehicles | |
WO2007036695A1 (en) | Image analysis | |
GB2618782A (en) | Environment detection system | |
KR20050119874A (en) | An image pre-processing apparatus of a traffic lane departure warning system and method thereof | |
KR20170034539A (en) | Driving assistant apparatus and driving assistant method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LU MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL HR LT LV MK YU |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LU MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL HR LT LV MK YU |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: 7G 05D 1/02 A Ipc: 7G 06K 9/46 B |
|
17P | Request for examination filed |
Effective date: 20060303 |
|
AKX | Designation fees paid |
Designated state(s): DE ES FR GB IT |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G01J 3/51 20060101ALI20060720BHEP Ipc: G08G 1/16 20060101AFI20060720BHEP |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE ES FR GB IT |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REF | Corresponds to: |
Ref document number: 602004003771 Country of ref document: DE Date of ref document: 20070201 Kind code of ref document: P |
|
ET | Fr: translation filed | ||
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2279302 Country of ref document: ES Kind code of ref document: T3 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20070921 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20130815 AND 20130821 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 13 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 14 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20181031 Year of fee payment: 4 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20191202 Year of fee payment: 16 Ref country code: FR Payment date: 20191125 Year of fee payment: 16 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20191127 Year of fee payment: 16 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602004003771 Country of ref document: DE Owner name: ZF AUTOMOTIVE UK LIMITED, SOLIHULL, GB Free format text: FORMER OWNER: TRW LTD., SOLIHULL, WEST MIDLANDS, GB Ref country code: DE Ref legal event code: R082 Ref document number: 602004003771 Country of ref document: DE Representative=s name: OESTREICHER, LUCAS, DIPL.-ING. (FH), DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191103 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20201103 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201130 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201103 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20220131 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201104 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230628 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602004003771 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G05D0001020000 Ipc: G05D0001430000 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230906 Year of fee payment: 20 |