US9796390B2 - Vehicle sensing grid having dynamic sensing cell size - Google Patents

Vehicle sensing grid having dynamic sensing cell size Download PDF

Info

Publication number
US9796390B2
US9796390B2 US15/089,446 US201615089446A US9796390B2 US 9796390 B2 US9796390 B2 US 9796390B2 US 201615089446 A US201615089446 A US 201615089446A US 9796390 B2 US9796390 B2 US 9796390B2
Authority
US
United States
Prior art keywords
vehicle
sensing
cell size
sensing cell
change criteria
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US15/089,446
Other versions
US20170247036A1 (en
Inventor
Bibhrajit HALDER
Sowmya GADE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Faraday and Future Inc
Original Assignee
Faraday and Future Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Faraday and Future Inc filed Critical Faraday and Future Inc
Priority to US15/089,446 priority Critical patent/US9796390B2/en
Assigned to FARADAY&FUTURE INC. reassignment FARADAY&FUTURE INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GADE, SOWMYA, HALDER, BIBHRAJIT
Priority to CN201780013979.8A priority patent/CN108698604B/en
Priority to PCT/US2017/020043 priority patent/WO2017151679A1/en
Publication of US20170247036A1 publication Critical patent/US20170247036A1/en
Application granted granted Critical
Publication of US9796390B2 publication Critical patent/US9796390B2/en
Assigned to SEASON SMART LIMITED reassignment SEASON SMART LIMITED SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FARADAY&FUTURE INC.
Assigned to FARADAY&FUTURE INC. reassignment FARADAY&FUTURE INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: SEASON SMART LIMITED
Assigned to BIRCH LAKE FUND MANAGEMENT, LP reassignment BIRCH LAKE FUND MANAGEMENT, LP SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CITY OF SKY LIMITED, EAGLE PROP HOLDCO LLC, Faraday & Future Inc., FARADAY FUTURE LLC, FARADAY SPE, LLC, FE EQUIPMENT LLC, FF HONG KONG HOLDING LIMITED, FF INC., FF MANUFACTURING LLC, ROBIN PROP HOLDCO LLC, SMART KING LTD., SMART TECHNOLOGY HOLDINGS LTD.
Assigned to ROYOD LLC, AS SUCCESSOR AGENT reassignment ROYOD LLC, AS SUCCESSOR AGENT ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Assignors: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
Assigned to BIRCH LAKE FUND MANAGEMENT, LP reassignment BIRCH LAKE FUND MANAGEMENT, LP SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ROYOD LLC
Assigned to ARES CAPITAL CORPORATION, AS SUCCESSOR AGENT reassignment ARES CAPITAL CORPORATION, AS SUCCESSOR AGENT ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Assignors: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
Assigned to ROBIN PROP HOLDCO LLC, FF INC., FF HONG KONG HOLDING LIMITED, FF MANUFACTURING LLC, FARADAY SPE, LLC, SMART TECHNOLOGY HOLDINGS LTD., FARADAY FUTURE LLC, FF EQUIPMENT LLC, Faraday & Future Inc., EAGLE PROP HOLDCO LLC, SMART KING LTD., CITY OF SKY LIMITED reassignment ROBIN PROP HOLDCO LLC RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069 Assignors: ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT
Assigned to FF SIMPLICY VENTURES LLC reassignment FF SIMPLICY VENTURES LLC SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FARADAY&FUTURE INC.
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/02Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
    • G01S13/06Systems determining position data of a target
    • G01S13/42Simultaneous measurement of distance and other co-ordinates
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/93Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/165Anti-collision systems for passive traffic, e.g. including static obstacles, trees
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/167Driving aids for lane monitoring, lane changing, e.g. blind spot detection
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/168Driving aids for parking, e.g. acoustic or visual feedback on parking space
    • B60W2550/10
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20004Adaptive image processing
    • G06T2207/20012Locally adaptive
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20021Dividing image into blocks, subimages or windows
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems

Definitions

  • This relates generally to sensing grid-based sensing of a vehicle's surroundings, and more particularly, to such sensing using a sensing grid having dynamically variable sensing cell size.
  • Vehicles especially automobiles, increasingly include various sensors for detecting and gathering information about the vehicles' surroundings. Some vehicles may discretize such information about the vehicles' surroundings by utilizing a sensing grid having fixed, discrete sensing cells to determine this information. However, fixed sensing cells may not provide optimal balance between the resulting resolution of the information and computing power requirements in different circumstances.
  • Examples of the disclosure are directed to dynamically altering sensing cell size in a sensing grid based on various considerations such as characteristics about objects in a vehicle's surroundings, characteristics about roads on which the vehicle is traveling, and characteristics about the vehicle itself, among other considerations.
  • the vehicle can obtain high resolution information about its surroundings when desired, and can reduce computing power requirements for determining information about its surroundings when high resolution information is not needed.
  • FIG. 1A illustrates an exemplary vehicle and sensing grid according to examples of the disclosure.
  • FIG. 1B illustrates an exemplary vehicle and sensing grid having sensing cells that are smaller than sensing cells in FIG. 1A according to examples of the disclosure.
  • FIG. 1C illustrates an exemplary vehicle and sensing grid having different sized sensing cells in different portions of the sensing grid according to examples of the disclosure.
  • FIG. 2A illustrates another exemplary vehicle and sensing grid according to examples of the disclosure.
  • FIG. 2B illustrates another exemplary vehicle and sensing grid having sensing cells that are smaller than sensing cells in FIG. 2A according to examples of the disclosure.
  • FIG. 3 illustrates an exemplary process for determining and setting the sensing cell size of a sensing grid according to examples of the disclosure.
  • FIG. 4 illustrates an exemplary system block diagram of a vehicle control system according to examples of the disclosure.
  • Some vehicles may include various sensors for detecting and gathering information about the vehicles' surroundings. Some vehicles may discretize such information about the vehicles' surroundings by utilizing a sensing grid having fixed, discrete sensing cells to determine this information. However, fixed sensing cells may not provide optimal balance between the resulting resolution of the information and computing power requirements in different circumstances. Examples of the disclosure are directed to dynamically altering sensing cell size in a sensing grid based on various considerations such as characteristics about objects in a vehicle's surroundings, characteristics about roads on which the vehicle is traveling, and characteristics about the vehicle itself, among other considerations. In this way, the vehicle can obtain high resolution information about its surroundings when desired, and can reduce computing power requirements for determining information about its surroundings when high resolution information is not needed.
  • FIG. 1A illustrates exemplary vehicle 100 and sensing grid 102 according to examples of the disclosure.
  • Vehicle 100 can include various sensors and systems for determining one or more characteristics about the vehicle's surroundings, such as the locations of objects in the vehicle's surroundings, the curvature, paths and/or locations of roads in the vehicles surroundings or on which the vehicle is traveling, the movements of other vehicles in the vehicle's surroundings, the types of objects in the vehicle's surroundings, etc.
  • These sensors can include ultrasonic sensors, laser sensors, radar sensors, optical cameras, LIDAR sensors, or any other sensors that can be used to detect one or more characteristics about the vehicle's surroundings.
  • Vehicle 100 can process data from one or more of these sensors to make automated or semi-automated decisions to facilitate appropriate vehicle action (e.g., during automated parking, during automated driving, etc.).
  • vehicle 100 can make such determinations by partitioning its surroundings into sensing cells 104 in sensing grid 102 —in some examples, referred to as an “occupancy grid.” Once partitioned, vehicle 100 can make determinations about its surroundings on a per-sensing cell 104 basis. For example, vehicle 100 can determine that sensing cell 104 A includes an object (e.g., an object to avoid during automated parking procedures), or that sensing cell 104 B includes a curved portion of a road on which the vehicle is traveling (e.g., a curved portion of the road to follow during automated driving procedures). Vehicle 100 can make any number of determinations about the characteristics of its surroundings on a per-sensing cell 104 basis. Making such determinations on a per-sensing cell 104 basis can require less computing and/or processing power on vehicle 100 than analyzing the surroundings of the vehicle without discretizing the surroundings using sensing grid 102 .
  • object e.g., an object to avoid during automated parking procedures
  • sensing cell 104 B includes a
  • vehicle 100 can be located at the center of sensing grid 102 , though in other examples, the vehicle can be located at a different location of the sensing grid.
  • sensing grid 102 can include sensing cells 104 , which can correspond to different locations in the surroundings of vehicle 100 .
  • Sensing cells 104 can have shapes and/or sizes determined by vehicle 100 (e.g., 50 cm ⁇ 50 cm squares, or any other size or shape). The shapes and/or sizes of sensing cells 104 can affect the accuracy with which vehicle 100 determines information about its surroundings, and the computing power required for the vehicle to determine such information.
  • relatively large sensing cells 104 can require relatively less computing power to determine one or more characteristics of the surroundings of vehicle 100 corresponding to the area of the sensing grid (e.g., because the sensing grid can include relatively few sensing cells about which the vehicle must make determinations), while providing lower resolution information about the vehicle's surroundings.
  • relatively small sensing cells 104 can require relatively more computing power to determine one or more characteristics of the surroundings of vehicle 100 corresponding to the area of sensing grid 102 (e.g., because the sensing grid can include relatively many sensing cells about which the vehicle must make determinations), while providing higher resolution information about the vehicle's surroundings.
  • sensing cell 104 size and computing power requirements can be inversely related to one another.
  • vehicle 100 can change the sizes of sensing cells 104 dynamically based on various considerations.
  • the vehicle can configure sensing grid 102 to have relatively large sensing cell 104 size and can reduce the corresponding computing power requirements for processing information in the sensing grid, and when high-resolution information about the surroundings of the vehicle is desired, the vehicle can configure the sensing grid to have relatively small sensing cell size and can improve the resolution of information about the vehicle's surroundings.
  • FIG. 1B illustrates exemplary vehicle 100 and sensing grid 102 having sensing cells 105 that are smaller than sensing cells 104 in FIG. 1A according to examples of the disclosure.
  • vehicle 100 can have split each sensing cell 104 in FIG. 1A into four sensing cells 105 , while maintaining the total size of sensing grid 102 .
  • sensing cell 104 A in FIG. 1A can be split into four smaller sensing cells 105 A, 105 B, 105 C and 105 D (e.g., four smaller square sensing cells).
  • FIG. 1B can allow for vehicle 100 to determine information about its surroundings with higher resolution than does sensing grid 102 in FIG. 1A .
  • vehicle 100 can determine that object 112 exists somewhere in sensing cell 104 A (e.g., the vehicle can mark sensing cell 104 A as being occupied, and can thus avoid the real world location corresponding to sensing cell 104 A during automated driving or parking procedures)
  • FIG. 1B the vehicle can more precisely determine that object 112 exists in sensing cell 105 B, but that sensing cells 105 A, 105 C and 105 D do not include any objects. Therefore, the smaller sensing cell size of sensing grid 102 in FIG. 1B can provide for higher-resolution information determination about the surroundings of vehicle 100 than the larger sensing cell size of sensing grid 102 in FIG. 1A .
  • vehicle 100 can dynamically configure sensing grid 102 to have the larger sensing cell 104 size of FIG. 1A or the smaller sensing cell 105 size of FIG. 1B based on the speed at which the vehicle is traveling. Specifically, when vehicle 100 is moving below a speed threshold, the vehicle can select the smaller sensing cell size of FIG. 1B (e.g., to provide higher resolution information about the vehicle's surroundings for parking or other tight maneuvering actions). When vehicle 100 is moving above a speed threshold, the vehicle can select the larger sensing cell size of FIG. 1A . It is understood that the smaller and larger sensing cell sizes provided in FIGS.
  • sensing cell sizes selected by the vehicle can be variable and not selected from a number of fixed and/or predetermined sensing cell sizes.
  • vehicle 100 can determine sensing cell size based on characteristics of objects in the vehicle's surroundings (e.g., within the boundaries of sensing grid 102 , or more generally, within a predetermined distance of the vehicle). Specifically, if greater than a threshold number of objects in the surroundings of vehicle 100 are smaller than a size threshold, the vehicle can select the smaller sensing cell size of FIG. 1B to be able to resolve those small objects, and can otherwise select the larger sensing cell size of FIG. 1A .
  • the sensing cell size selected by vehicle 100 can be based on the sizes of the objects in the vehicle's surroundings (e.g., a multiple of the size of the smallest object in the vehicle's surroundings). In some examples, in addition or alternatively to the factors discussed above, if greater than a threshold number of objects are in the surroundings of vehicle 100 , the vehicle can select the smaller sensing cell size of FIG. 1B , and can otherwise select the larger sensing cell size of FIG. 1A . In some examples, in addition or alternatively to the factors discussed above, if the density of objects in the surroundings of vehicle 100 is greater than a density threshold, the vehicle can select the smaller sensing cell size of FIG. 1B , and can otherwise select the larger sensing cell size of FIG. 1A .
  • vehicle 100 can determine sensing cell size based on characteristics of the vehicle itself; for example, a current driving mode of the vehicle. For example, if vehicle 100 is in an automated parking mode, the vehicle can select the smaller sensing cell size of FIG. 1B to provide higher resolution information about the vehicle's surroundings for use during automated parking maneuvers.
  • vehicle 100 can select a medium sensing cell size
  • vehicle if the vehicle is in a parking mode (e.g., for traveling a low speeds), the vehicle can select a small sensing cell size, and if the vehicle is in a highway driving mode (e.g., for traveling at high speeds), the vehicle can select a large sensing cell size.
  • vehicle 100 if vehicle 100 is in reverse gear, the vehicle can select the smaller sensing cell size of FIG. 1B to provide for higher resolution information about the vehicle's surroundings while the driver of the vehicle, or the vehicle itself, moves backwards.
  • vehicle 100 can select different sensing cell sizes in different portions of sensing grid 102 based on one or more of the factors described above and throughout this disclosure.
  • FIG. 1C illustrates exemplary vehicle 100 and sensing grid 102 having different sized sensing cells in different portions of the sensing grid according to examples of the disclosure.
  • Sensing grid 102 can include one or more regions in which the sensing cells have a first size (e.g., a larger size, such as sensing cell 104 B), and one or more regions in which the sensing cells have a second size, different from the first size (e.g., a smaller size, such as sensing cells 105 A- 105 D).
  • vehicle 100 can initialize sensing grid 102 to initially have relatively large sensing cells, such as sensing cell 104 B, and can split those sensing cells in which objects are detected into smaller sensing cells, such as sensing cells 105 A- 105 D. In this way, vehicle 100 can determine relatively high-resolution information about areas in its surroundings in which objects are present, while maintaining the lower computing power benefits of larger sensing cells in areas in which objects are not present. It is understood that other considerations for vehicle 100 selecting non-uniform sensing cell sizes in different regions of sensing grid 102 in accordance with the examples provided in this disclosure are also within the scope of this disclosure, such as considerations based on one or more of the sensing cell size-factors described throughout this disclosure.
  • the vehicle of this disclosure can determine sensing cell size based on characteristics of the roads on which the vehicle is located or traveling.
  • FIG. 2A illustrates exemplary vehicle 200 and sensing grid 202 according to examples of the disclosure. The details of sensing grid 202 can be substantially the same as those of sensing grid 102 in FIG. 1A .
  • Vehicle 200 can be traveling on road 214 .
  • the vehicle can determine that road 214 , within a predetermined distance of the vehicle (e.g., within sensing grid 102 ), has relatively low curvature (e.g., the road does not include a curve having greater than a threshold curvature within the predetermined distance of the vehicle, the road has less than a threshold number of curves within the predetermined distance of the vehicle, the road has less than a threshold number of curves having greater than a threshold curvature within the predetermined distance of the vehicle, etc.).
  • a predetermined distance of the vehicle e.g., within sensing grid 102
  • the road has relatively low curvature (e.g., the road does not include a curve having greater than a threshold curvature within the predetermined distance of the vehicle, the road has less than a threshold number of curves within the predetermined distance of the vehicle, the road has less than a threshold number of curves having greater than a threshold curvature within the predetermined distance of the vehicle, etc.).
  • vehicle 200 can select a relatively large sensing cell 204 size for sensing grid 202 , because the vehicle may not require high-resolution information about the low curvature road to accurately determine a path on the road for the vehicle to follow (e.g., for automated driving purposes).
  • FIG. 2B illustrates exemplary vehicle 200 and sensing grid 202 having sensing cells 205 that are smaller than sensing cells 204 in FIG. 2A according to examples of the disclosure.
  • the details of sensing grid 202 can be substantially the same as those of sensing grid 102 in FIG. 1B .
  • Vehicle 200 can be traveling on road 216 .
  • the vehicle can determine that road 216 , within a predetermined distance of the vehicle (e.g., within sensing grid 102 ), has relatively high curvature (e.g., the road includes a curve having greater than a threshold curvature within the predetermined distance of the vehicle, the road has greater than a threshold number of curves within the predetermined distance of the vehicle, the road has greater than a threshold number of curves having greater than a threshold curvature within the predetermined distance of the vehicle, etc.).
  • vehicle 200 can select a relatively small sensing cell 205 size for sensing grid 202 —smaller than the sizes of sensing cells 204 in FIG. 2A —because the vehicle may require high-resolution information about the high curvature road to accurately determine a path on the road for the vehicle to follow (e.g., for automated driving purposes).
  • vehicle 200 can determine sensing cell size based on one or more characteristics about the location of the vehicle. For example, using Global Positioning System (GPS) data from an on-board GPS receiver on vehicle 200 , the vehicle can determine its location, and based on that location, can determine sensing cell size. For example, if vehicle 200 determines that it is in a city (or other dense or highly-populated area, such as an area having a population density greater than a population density threshold), it can select a relatively small sensing cell 205 size (e.g., as illustrated in FIG. 2B ).
  • GPS Global Positioning System
  • vehicle 200 determines that it is in a rural area (or other sparse or lightly-populated area, such as an area having a population density less than the population density threshold), it can select a relatively large sensing cell 204 size (e.g., as illustrated in FIG. 2A ).
  • FIG. 3 illustrates an exemplary process 300 for determining and setting the sensing cell size of a sensing grid according to examples of the disclosure.
  • Process 300 can be performed continuously or repeatedly by the vehicle whenever information about the vehicle's surroundings is needed (e.g., during automated or non-automated parking procedures, during automated or non-automated driving procedures, etc.).
  • the speed of the vehicle can be monitored (e.g., as described with reference to FIGS. 1A-1C ).
  • the speed of the vehicle can be determined using a speed sensor coupled to the wheels of the vehicle, a GPS receiver on the vehicle, or any other sensor on the vehicle that can determine the vehicle's speed.
  • one or more characteristics of the road(s) in the vehicle's surroundings can be monitored (e.g., as described with reference to FIGS. 2A-2B ). For example, the number and/or degree of road curves in the vehicle's surroundings (e.g., within the boundaries of the sensing grid) can be monitored. In some examples, only the characteristics of the road on which the vehicle is traveling may be monitored at 304 . In some examples, the characteristics of the road(s) in the vehicle's surroundings can be monitored using one or more of optical cameras, ultrasonic sensors, GPS sensors, radar sensors, LIDAR sensors, and any other sensor that can be used to determine the characteristics of roads in the vehicle's surroundings.
  • one or more characteristics of the current driving mode of the vehicle can be monitored (e.g., as described with reference to FIGS. 1A-1C ). For example, it can be determined whether the vehicle is in a parking mode, a city driving mode, a highway driving mode, or any other driving mode. In some examples, these modes can be automatically initiated by the vehicle based on how a driver is using the vehicle and/or where the vehicle is located, while in some examples, these modes can be manually initiated by a driver of the vehicle (e.g., in response to a button press by the driver).
  • one or more characteristics of objects in the vehicle's surroundings can be monitored (e.g., as described with reference to FIGS. 1A-C ). For example, a number of objects in the vehicle's surroundings, the sizes of objects in the vehicle's surroundings, the types of objects in the vehicle's surroundings (e.g., static objects, moving objects, such as other vehicles, etc.), or any other characteristics of the objects in the vehicle's surroundings can be monitored at 308 .
  • the characteristics of the objects in the vehicle's surroundings can be monitored using one or more of optical cameras, ultrasonic sensors, GPS sensors, radar sensors, LIDAR sensors, and any other sensor that can be used to determine the characteristics of objects in the vehicle's surroundings.
  • one or more characteristics of the vehicle's location can be monitored (e.g., as described with reference to FIGS. 2A-2B ). For example, using GPS data received from a GPS receiver on the vehicle, the vehicle can determine its location, whether that location is in a city or in a rural area, or any other information about the vehicle's location. In some examples, the characteristics of the vehicle's location can be monitored using one or more of optical cameras, ultrasonic sensors, GPS sensors, radar sensors, LIDAR sensors, and any other sensor that can be used to determine the characteristics of the vehicle's location.
  • the vehicle can determine a desired sensing cell size based on the results of one or more of steps 302 , 304 , 306 , 308 and 310 (e.g., as described with reference to FIGS. 1A-1C and 2A-2B ).
  • This determination can include determining a constant sensing cell size to be used throughout the entirety of the sensing grid, or can include determining different sensing cell sizes to be used in different portions of the sensing grid.
  • this determination at 312 can include selecting from a predetermined number of sensing cell sizes (e.g., small, medium, and large), or can include determining a sensing cell size that is not selected from a predetermined number of sensing cell sizes (e.g., variable, unconstrained sensing cell sizes).
  • sensing cell sizes can be determined based on a predetermined relationship between sensing cells of different sizes.
  • the vehicle can utilize a quadtree sensing cell data structure (e.g., an “Octomap”) in which every sensing cell has four “children” sensing cells.
  • the vehicle when the vehicle determines that a smaller sensing cell size should be selected, it can move down the quadtree to split one sensing cell into four smaller sensing cells (e.g., as described with reference to FIGS. 1A-1C and 2A-2B ). The vehicle can continue moving down the quadtree in this way until the desired sensing cell size is reached. Analogously, if the vehicle determines that a larger sensing cell size should be selected, it can move up the quadtree to combine four smaller sensing cells into one larger sensing cell. Using a quadtree sensing cell data structure (or any other predetermined sensing cell size relationship) provides an easy and predictable way for the vehicle to change sensing cell size dynamically, as described in this disclosure.
  • the sensing cell size in a sensing grid can be set based on the determination at 312 (e.g., as described with reference to FIGS. 1A-1C and 2A-2B ).
  • the sensing cell size set at 314 can be used in the sensing grid for any one or more of mapping, vehicle localization and vehicle path planning, among other applications.
  • Mapping can entail determining the locations of objects in the vehicle's surroundings, and mapping those locations relative to the vehicle.
  • Vehicle localization can entail matching a predetermined (e.g., pre-stored) map of the vehicle's surroundings with features or objects detected in the vehicle's surroundings to localize the vehicle within the predetermined map.
  • Vehicle path planning can entail determining one or more optimal paths for the vehicle to move from a first location to a second location based on features or objects detected by the vehicle in its surroundings. Additional processes can similarly utilize the sensing grid, and thus the dynamically variable sensing cell size, of this disclosure.
  • FIG. 4 illustrates an exemplary system block diagram of vehicle control system 400 according to examples of the disclosure.
  • Vehicle control system 400 can perform any of the methods described with reference to FIGS. 1A-1C, 2A-2B and 3 .
  • System 400 can be incorporated into a vehicle, such as a consumer automobile.
  • Other example vehicles that may incorporate the system 400 include, without limitation, airplanes, boats, or industrial automobiles.
  • Vehicle control system 400 can include one or more cameras 406 capable of capturing image data (e.g., video data) for determining various characteristics of the vehicle's surroundings, as described with reference to FIGS. 1A-1C, 2A-2B and 3 .
  • Vehicle control system 400 can also include one or more other sensors 407 (e.g., radar, ultrasonic, LIDAR, etc.) capable of detecting various characteristics of the vehicle's surroundings, and a Global Positioning System (GPS) receiver 408 capable of determining the location of the vehicle.
  • Vehicle control system 400 can include an on-board computer 410 that is coupled to the cameras 406 , sensors 407 and GPS receiver 408 , and that is capable of receiving the image data from the cameras and/or outputs from the sensors 407 and the GPS receiver 408 .
  • the on-board computer 410 can be capable of determining and setting sensing cell size in a sensing grid around the vehicle, as described in this disclosure.
  • On-board computer 410 can include storage 412 , memory 416 , and a processor 414 .
  • Processor 414 can perform any of the methods described with reference to FIGS. 1A-1C, 2A-2B and 3 .
  • storage 412 and/or memory 416 can store data and instructions for performing any of the methods described with reference to FIGS. 1A-1C, 2A-2B and 3 .
  • Storage 412 and/or memory 416 can be any non-transitory computer readable storage medium, such as a solid-state drive or a hard disk drive, among other possibilities.
  • the vehicle control system 400 can also include a controller 420 capable of controlling one or more aspects of vehicle operation, such as performing autonomous parking or driving operations using the sensing cells and sensing grids determined by the on-board computer 410 .
  • the vehicle control system 400 can be connected to (e.g., via controller 420 ) one or more actuator systems 430 in the vehicle and one or more indicator systems 440 in the vehicle.
  • the one or more actuator systems 430 can include, but are not limited to, a motor 431 or engine 432 , battery system 433 , transmission gearing 434 , suspension setup 435 , brakes 436 , steering system 437 and door system 438 .
  • the vehicle control system 400 can control, via controller 420 , one or more of these actuator systems 430 during vehicle operation; for example, to open or close one or more of the doors of the vehicle using the door actuator system 438 , to control the vehicle during autonomous driving or parking operations, which can utilize the sensing cells and sensing grids determined by the on-board computer 410 , using the motor 431 or engine 432 , battery system 433 , transmission gearing 434 , suspension setup 435 , brakes 436 and/or steering system 437 , etc.
  • the one or more indicator systems 440 can include, but are not limited to, one or more speakers 441 in the vehicle (e.g., as part of an entertainment system in the vehicle), one or more lights 442 in the vehicle, one or more displays 443 in the vehicle (e.g., as part of a control or entertainment system in the vehicle) and one or more tactile actuators 444 in the vehicle (e.g., as part of a steering wheel or seat in the vehicle).
  • the vehicle control system 400 can control, via controller 420 , one or more of these indicator systems 440 to provide indications to a driver of the vehicle of one or more characteristics of the vehicle's surroundings that are determined using the sensing cells and sensing grids configured by the on-board computer 410 .
  • the examples of the disclosure provide various ways to dynamically adjust the sizes of sensing cells in a sensing grid surrounding a vehicle.
  • some examples of the disclosure are directed to a system comprising: one or more processors; and a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising: at a first time, determining one or more characteristics about an area surrounding a vehicle using a first sensing grid including first sensing cells of a first size; at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria; and in response to the determination: in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using a second sensing grid including second sensing cells of a second size, different from the first size; and in accordance with a determination that the sensing cell size data does not satisfy the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the first sensing grid including the first sensing cells of the first size.
  • the second sensing grid includes the second sensing cells of the second size and the first sensing cells of the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the second sensing grid does not include the first sensing cells of the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the second size is smaller than the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, a total size of the first sensing grid equals a total size of the second sensing grid. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the area surrounding the vehicle comprises an area within a predetermined distance of the vehicle.
  • the one or more characteristics about the area surrounding the vehicle include one or more locations of objects surrounding the vehicle, a path of a road on which the vehicle is traveling, types of objects surrounding the vehicle, or movements of objects surrounding the vehicle.
  • the sensing cell size data includes data indicative of a speed of the vehicle, and the sensing cell size change criteria include a criterion that is satisfied when the speed of the vehicle is below a threshold speed. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data includes data indicative of characteristics of one or more objects in the area surrounding the vehicle.
  • the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold number of objects in the area surrounding the vehicle are smaller than a size threshold. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold number of objects are in the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold density of objects is in the area surrounding the vehicle.
  • the sensing cell size data includes data indicative of a driving mode of the vehicle
  • the sensing cell size change criteria include a criterion that is satisfied when the driving mode of the vehicle is a first driving mode, and not satisfied when the driving mode of the vehicle is a second driving mode, different from the first driving mode.
  • the first driving mode and the second driving mode comprise one or more of an automated parking mode, an automated driving mode, a city driving mode, a highway driving mode, and a reverse driving mode.
  • the sensing cell size data includes data indicative of characteristics of a road on which the vehicle is traveling. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when the road includes a curve having greater than a threshold curvature within the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when the road has greater than a threshold number of curves within the area surrounding the vehicle.
  • the sensing cell size change criteria include a criterion that is satisfied when the road has greater than a threshold number of curves having greater than a threshold curvature within the area surrounding the vehicle.
  • the sensing cell size data includes data indicative of a location of the vehicle, and the sensing cell size change criteria include a criterion that is satisfied when the location of the vehicle is a first location, and not satisfied when the location of the vehicle is a second location, different from the first location.
  • the first location corresponds to an area with a population density greater than a population density threshold
  • the second location corresponds to an area with a population density less than the population density threshold.
  • Some examples of the disclosure are directed to a non-transitory computer-readable medium including instructions, which when executed by one or more processors, cause the one or more processors to perform a method comprising: at a first time, determining one or more characteristics about an area surrounding a vehicle using a first sensing grid including first sensing cells of a first size; at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria; and in response to the determination: in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using a second sensing grid including second sensing cells of a second size, different from the first size; and in accordance with a determination that the sensing cell size data does not satisfy the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the first sensing grid including the first sensing cells of the first size.
  • Some examples of the disclosure are directed to a vehicle comprising: one or more sensors; one or more processors coupled to the one or more sensors; and a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising: at a first time, determining one or more characteristics about an area surrounding a vehicle using a first sensing grid including first sensing cells of a first size, the determination based on outputs from the one or more sensors; at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria; and in response to the determination: in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using a second sensing grid including second sensing cells of a second size, different from the first size, the determination based on outputs from the one or more sensors; and in accordance with a determination that the sensing cell size data does not satisfy the sensing cell size
  • Some examples of the disclosure are directed to a system comprising: one or more sensors; one or more processors coupled to the one or more sensors; and a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising: at a first time, determining one or more characteristics about an area surrounding a vehicle using the one or more sensors, the one or more sensors configured to use a first sensing grid including first sensing cells of a first size; at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria, wherein: the sensing cell size data includes data indicative of: one or more characteristics of the vehicle, one or more characteristics of a road on which the vehicle is traveling, or one or more characteristics of a location of the vehicle, and the sensing cell size change criteria include: a criterion that is satisfied when the one or more characteristics of the vehicle include a first characteristic, a criterion that is satisfied when the one or more characteristics of the road include a second characteristic
  • the second sensing grid does not include the first sensing cells of the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the second size is smaller than the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, a total size of the first sensing grid equals a total size of the second sensing grid. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the area surrounding the vehicle comprises an area within a predetermined distance of the vehicle.
  • the one or more characteristics about the area surrounding the vehicle include one or more locations of objects surrounding the vehicle, a path of a road on which the vehicle is traveling, types of objects surrounding the vehicle, or movements of objects surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics of the vehicle include a speed of the vehicle, and the sensing cell size data satisfies the sensing cell size change criteria when the speed of the vehicle is below a threshold speed. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data further includes data indicative of characteristics of one or more objects in the area surrounding the vehicle.
  • the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold number of objects in the area surrounding the vehicle are smaller than a size threshold. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold number of objects are in the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold density of objects is in the area surrounding the vehicle.
  • the one or more characteristics of the vehicle include a driving mode of the vehicle, and the sensing cell size data satisfies the sensing cell size change criteria when the driving mode of the vehicle is a first driving mode, and does not satisfy the sensing cell size change criteria when the driving mode of the vehicle is a second driving mode, different from the first driving mode.
  • the first driving mode and the second driving mode comprise one or more of an automated parking mode, an automated driving mode, a city driving mode, a highway driving mode, and a reverse driving mode.
  • the sensing cell size data satisfies the sensing cell size change criteria when the road includes a curve having greater than a threshold curvature within the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data satisfies the sensing cell size change criteria when the road has greater than a threshold number of curves within the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data satisfies the sensing cell size change criteria when the road has greater than a threshold number of curves having greater than a threshold curvature within the area surrounding the vehicle.
  • the sensing cell size data satisfies the sensing cell size change criteria when the location of the vehicle is a first location, and does not satisfy the sensing cell size change criteria when the location of the vehicle is a second location, different from the first location.
  • the first location corresponds to an area with a population density greater than a population density threshold
  • the second location corresponds to an area with a population density less than the population density threshold.
  • Some examples of the disclosure are directed to a non-transitory computer-readable medium including instructions, which when executed by one or more processors, cause the one or more processors to perform a method comprising: at a first time, determining one or more characteristics about an area surrounding a vehicle using one or more sensors, the one or more sensors configured to use a first sensing grid including first sensing cells of a first size; at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria, wherein: the sensing cell size data includes data indicative of: one or more characteristics of the vehicle, one or more characteristics of a road on which the vehicle is traveling, or one or more characteristics of a location of the vehicle, and the sensing cell size change criteria include: a criterion that is satisfied when the one or more characteristics of the vehicle include a first characteristic, a criterion that is satisfied when the one or more characteristics of the road include a second characteristic, or a criterion that is satisfied when the one or more characteristics of the
  • Some examples of the disclosure are directed to a vehicle comprising: one or more sensors; one or more processors coupled to the one or more sensors; and a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising: at a first time, determining one or more characteristics about an area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use a first sensing grid including first sensing cells of a first size; at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria, wherein: the sensing cell size data includes data indicative of: one or more characteristics of the vehicle, one or more characteristics of a road on which the vehicle is traveling, or one or more characteristics of a location of the vehicle, and the sensing cell size change criteria include: a criterion that is satisfied when the one or more characteristics of the vehicle include a first characteristic, a criterion that is satisfied when the one or more characteristics of the road include a second characteristic,

Abstract

A system that performs a method is disclosed. At a first time, characteristics about an area surrounding a vehicle are determined using a first sensing grid including first sensing cells of a first size. At a second time, after the first time, whether sensing cell size data satisfies sensing cell size change criteria is determined. In response to the determination: in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, characteristics about the area surrounding the vehicle are determined using a second sensing grid including second sensing cells of a second size, different from the first size. In accordance with a determination that the sensing cell size data does not satisfy the sensing cell size change criteria, characteristics about the area surrounding the vehicle are determined using the first sensing grid including the first sensing cells of the first size.

Description

CROSS-REFERENCE TO RELATED APPLICATION
This application claims the benefit under 35 U.S.C. §119(e) of U.S. Provisional Patent Application No. 62/301,480, filed Feb. 29, 2016, the content of which is incorporated by reference herein in its entirety for all purposes.
FIELD OF THE DISCLOSURE
This relates generally to sensing grid-based sensing of a vehicle's surroundings, and more particularly, to such sensing using a sensing grid having dynamically variable sensing cell size.
BACKGROUND OF THE DISCLOSURE
Vehicles, especially automobiles, increasingly include various sensors for detecting and gathering information about the vehicles' surroundings. Some vehicles may discretize such information about the vehicles' surroundings by utilizing a sensing grid having fixed, discrete sensing cells to determine this information. However, fixed sensing cells may not provide optimal balance between the resulting resolution of the information and computing power requirements in different circumstances.
SUMMARY OF THE DISCLOSURE
Examples of the disclosure are directed to dynamically altering sensing cell size in a sensing grid based on various considerations such as characteristics about objects in a vehicle's surroundings, characteristics about roads on which the vehicle is traveling, and characteristics about the vehicle itself, among other considerations. In this way, the vehicle can obtain high resolution information about its surroundings when desired, and can reduce computing power requirements for determining information about its surroundings when high resolution information is not needed.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1A illustrates an exemplary vehicle and sensing grid according to examples of the disclosure.
FIG. 1B illustrates an exemplary vehicle and sensing grid having sensing cells that are smaller than sensing cells in FIG. 1A according to examples of the disclosure.
FIG. 1C illustrates an exemplary vehicle and sensing grid having different sized sensing cells in different portions of the sensing grid according to examples of the disclosure.
FIG. 2A illustrates another exemplary vehicle and sensing grid according to examples of the disclosure.
FIG. 2B illustrates another exemplary vehicle and sensing grid having sensing cells that are smaller than sensing cells in FIG. 2A according to examples of the disclosure.
FIG. 3 illustrates an exemplary process for determining and setting the sensing cell size of a sensing grid according to examples of the disclosure.
FIG. 4 illustrates an exemplary system block diagram of a vehicle control system according to examples of the disclosure.
DETAILED DESCRIPTION
In the following description of examples, reference is made to the accompanying drawings which form a part hereof, and in which it is shown by way of illustration specific examples that can be practiced. It is to be understood that other examples can be used and structural changes can be made without departing from the scope of the disclosed examples.
Some vehicles, such as automobiles, may include various sensors for detecting and gathering information about the vehicles' surroundings. Some vehicles may discretize such information about the vehicles' surroundings by utilizing a sensing grid having fixed, discrete sensing cells to determine this information. However, fixed sensing cells may not provide optimal balance between the resulting resolution of the information and computing power requirements in different circumstances. Examples of the disclosure are directed to dynamically altering sensing cell size in a sensing grid based on various considerations such as characteristics about objects in a vehicle's surroundings, characteristics about roads on which the vehicle is traveling, and characteristics about the vehicle itself, among other considerations. In this way, the vehicle can obtain high resolution information about its surroundings when desired, and can reduce computing power requirements for determining information about its surroundings when high resolution information is not needed.
FIG. 1A illustrates exemplary vehicle 100 and sensing grid 102 according to examples of the disclosure. Vehicle 100 can include various sensors and systems for determining one or more characteristics about the vehicle's surroundings, such as the locations of objects in the vehicle's surroundings, the curvature, paths and/or locations of roads in the vehicles surroundings or on which the vehicle is traveling, the movements of other vehicles in the vehicle's surroundings, the types of objects in the vehicle's surroundings, etc. These sensors can include ultrasonic sensors, laser sensors, radar sensors, optical cameras, LIDAR sensors, or any other sensors that can be used to detect one or more characteristics about the vehicle's surroundings. Vehicle 100 can process data from one or more of these sensors to make automated or semi-automated decisions to facilitate appropriate vehicle action (e.g., during automated parking, during automated driving, etc.).
In some examples, vehicle 100 can make such determinations by partitioning its surroundings into sensing cells 104 in sensing grid 102—in some examples, referred to as an “occupancy grid.” Once partitioned, vehicle 100 can make determinations about its surroundings on a per-sensing cell 104 basis. For example, vehicle 100 can determine that sensing cell 104A includes an object (e.g., an object to avoid during automated parking procedures), or that sensing cell 104B includes a curved portion of a road on which the vehicle is traveling (e.g., a curved portion of the road to follow during automated driving procedures). Vehicle 100 can make any number of determinations about the characteristics of its surroundings on a per-sensing cell 104 basis. Making such determinations on a per-sensing cell 104 basis can require less computing and/or processing power on vehicle 100 than analyzing the surroundings of the vehicle without discretizing the surroundings using sensing grid 102.
In some examples, vehicle 100 can be located at the center of sensing grid 102, though in other examples, the vehicle can be located at a different location of the sensing grid. As mentioned above, sensing grid 102 can include sensing cells 104, which can correspond to different locations in the surroundings of vehicle 100. Sensing cells 104 can have shapes and/or sizes determined by vehicle 100 (e.g., 50 cm×50 cm squares, or any other size or shape). The shapes and/or sizes of sensing cells 104 can affect the accuracy with which vehicle 100 determines information about its surroundings, and the computing power required for the vehicle to determine such information. For example, for a given sensing grid 102 size, relatively large sensing cells 104 can require relatively less computing power to determine one or more characteristics of the surroundings of vehicle 100 corresponding to the area of the sensing grid (e.g., because the sensing grid can include relatively few sensing cells about which the vehicle must make determinations), while providing lower resolution information about the vehicle's surroundings. Analogously, relatively small sensing cells 104 can require relatively more computing power to determine one or more characteristics of the surroundings of vehicle 100 corresponding to the area of sensing grid 102 (e.g., because the sensing grid can include relatively many sensing cells about which the vehicle must make determinations), while providing higher resolution information about the vehicle's surroundings. In other words, sensing cell 104 size and computing power requirements can be inversely related to one another. In a system of potentially limited computing power and/or energy resources, such as a computing system on vehicle 100, it can be beneficial to maintain low computing power requirements. However, it can also be beneficial for vehicle 100 to, at appropriate times, have high resolution information about its surroundings, such as during automated parking procedures. As such, in some examples, vehicle 100 can change the sizes of sensing cells 104 dynamically based on various considerations. In this way, when high-resolution information about the surroundings of vehicle 100 is not needed, the vehicle can configure sensing grid 102 to have relatively large sensing cell 104 size and can reduce the corresponding computing power requirements for processing information in the sensing grid, and when high-resolution information about the surroundings of the vehicle is desired, the vehicle can configure the sensing grid to have relatively small sensing cell size and can improve the resolution of information about the vehicle's surroundings.
FIG. 1B illustrates exemplary vehicle 100 and sensing grid 102 having sensing cells 105 that are smaller than sensing cells 104 in FIG. 1A according to examples of the disclosure. In FIG. 1B, vehicle 100 can have split each sensing cell 104 in FIG. 1A into four sensing cells 105, while maintaining the total size of sensing grid 102. For example, sensing cell 104A in FIG. 1A can be split into four smaller sensing cells 105A, 105B, 105C and 105D (e.g., four smaller square sensing cells). As previously described, because sensing cells 105 can be smaller than sensing cells 104 in FIG. 1A, sensing grid 102 in FIG. 1B can allow for vehicle 100 to determine information about its surroundings with higher resolution than does sensing grid 102 in FIG. 1A. For example, whereas in FIG. 1A, vehicle 100 can determine that object 112 exists somewhere in sensing cell 104A (e.g., the vehicle can mark sensing cell 104A as being occupied, and can thus avoid the real world location corresponding to sensing cell 104A during automated driving or parking procedures), in FIG. 1B, the vehicle can more precisely determine that object 112 exists in sensing cell 105B, but that sensing cells 105A, 105C and 105D do not include any objects. Therefore, the smaller sensing cell size of sensing grid 102 in FIG. 1B can provide for higher-resolution information determination about the surroundings of vehicle 100 than the larger sensing cell size of sensing grid 102 in FIG. 1A.
In some examples, vehicle 100 can dynamically configure sensing grid 102 to have the larger sensing cell 104 size of FIG. 1A or the smaller sensing cell 105 size of FIG. 1B based on the speed at which the vehicle is traveling. Specifically, when vehicle 100 is moving below a speed threshold, the vehicle can select the smaller sensing cell size of FIG. 1B (e.g., to provide higher resolution information about the vehicle's surroundings for parking or other tight maneuvering actions). When vehicle 100 is moving above a speed threshold, the vehicle can select the larger sensing cell size of FIG. 1A. It is understood that the smaller and larger sensing cell sizes provided in FIGS. 1A-1B, and throughout this disclosure, are exemplary only, and that the vehicle of the disclosure can select any number of sensing cell sizes, not just those described here, based on the various considerations referenced in this disclosure. Additionally, the sensing cell sizes selected by the vehicle can be variable and not selected from a number of fixed and/or predetermined sensing cell sizes.
In some examples, in addition or alternatively to vehicle speed, vehicle 100 can determine sensing cell size based on characteristics of objects in the vehicle's surroundings (e.g., within the boundaries of sensing grid 102, or more generally, within a predetermined distance of the vehicle). Specifically, if greater than a threshold number of objects in the surroundings of vehicle 100 are smaller than a size threshold, the vehicle can select the smaller sensing cell size of FIG. 1B to be able to resolve those small objects, and can otherwise select the larger sensing cell size of FIG. 1A. In some examples, in addition or alternatively to the factors discussed above, the sensing cell size selected by vehicle 100 can be based on the sizes of the objects in the vehicle's surroundings (e.g., a multiple of the size of the smallest object in the vehicle's surroundings). In some examples, in addition or alternatively to the factors discussed above, if greater than a threshold number of objects are in the surroundings of vehicle 100, the vehicle can select the smaller sensing cell size of FIG. 1B, and can otherwise select the larger sensing cell size of FIG. 1A. In some examples, in addition or alternatively to the factors discussed above, if the density of objects in the surroundings of vehicle 100 is greater than a density threshold, the vehicle can select the smaller sensing cell size of FIG. 1B, and can otherwise select the larger sensing cell size of FIG. 1A.
In some examples, in addition or alternatively to the factors discussed above, vehicle 100 can determine sensing cell size based on characteristics of the vehicle itself; for example, a current driving mode of the vehicle. For example, if vehicle 100 is in an automated parking mode, the vehicle can select the smaller sensing cell size of FIG. 1B to provide higher resolution information about the vehicle's surroundings for use during automated parking maneuvers. As another example, if vehicle 100 is in a city driving mode (e.g., for traveling at moderate speeds above parking speeds and below highway speeds), the vehicle can select a medium sensing cell size, if the vehicle is in a parking mode (e.g., for traveling a low speeds), the vehicle can select a small sensing cell size, and if the vehicle is in a highway driving mode (e.g., for traveling at high speeds), the vehicle can select a large sensing cell size. As another example, if vehicle 100 is in reverse gear, the vehicle can select the smaller sensing cell size of FIG. 1B to provide for higher resolution information about the vehicle's surroundings while the driver of the vehicle, or the vehicle itself, moves backwards.
In some examples, vehicle 100 can select different sensing cell sizes in different portions of sensing grid 102 based on one or more of the factors described above and throughout this disclosure. FIG. 1C illustrates exemplary vehicle 100 and sensing grid 102 having different sized sensing cells in different portions of the sensing grid according to examples of the disclosure. Sensing grid 102 can include one or more regions in which the sensing cells have a first size (e.g., a larger size, such as sensing cell 104B), and one or more regions in which the sensing cells have a second size, different from the first size (e.g., a smaller size, such as sensing cells 105A-105D). In some examples, vehicle 100 can initialize sensing grid 102 to initially have relatively large sensing cells, such as sensing cell 104B, and can split those sensing cells in which objects are detected into smaller sensing cells, such as sensing cells 105A-105D. In this way, vehicle 100 can determine relatively high-resolution information about areas in its surroundings in which objects are present, while maintaining the lower computing power benefits of larger sensing cells in areas in which objects are not present. It is understood that other considerations for vehicle 100 selecting non-uniform sensing cell sizes in different regions of sensing grid 102 in accordance with the examples provided in this disclosure are also within the scope of this disclosure, such as considerations based on one or more of the sensing cell size-factors described throughout this disclosure.
In some examples, in addition or alternatively to the factors discussed above, the vehicle of this disclosure can determine sensing cell size based on characteristics of the roads on which the vehicle is located or traveling. FIG. 2A illustrates exemplary vehicle 200 and sensing grid 202 according to examples of the disclosure. The details of sensing grid 202 can be substantially the same as those of sensing grid 102 in FIG. 1A. Vehicle 200 can be traveling on road 214. Using one or more sensor systems on vehicle 200, the vehicle can determine that road 214, within a predetermined distance of the vehicle (e.g., within sensing grid 102), has relatively low curvature (e.g., the road does not include a curve having greater than a threshold curvature within the predetermined distance of the vehicle, the road has less than a threshold number of curves within the predetermined distance of the vehicle, the road has less than a threshold number of curves having greater than a threshold curvature within the predetermined distance of the vehicle, etc.). As a result, vehicle 200 can select a relatively large sensing cell 204 size for sensing grid 202, because the vehicle may not require high-resolution information about the low curvature road to accurately determine a path on the road for the vehicle to follow (e.g., for automated driving purposes).
In comparison, FIG. 2B illustrates exemplary vehicle 200 and sensing grid 202 having sensing cells 205 that are smaller than sensing cells 204 in FIG. 2A according to examples of the disclosure. The details of sensing grid 202 can be substantially the same as those of sensing grid 102 in FIG. 1B. Vehicle 200 can be traveling on road 216. Using one or more sensor systems on vehicle 200, the vehicle can determine that road 216, within a predetermined distance of the vehicle (e.g., within sensing grid 102), has relatively high curvature (e.g., the road includes a curve having greater than a threshold curvature within the predetermined distance of the vehicle, the road has greater than a threshold number of curves within the predetermined distance of the vehicle, the road has greater than a threshold number of curves having greater than a threshold curvature within the predetermined distance of the vehicle, etc.). As a result, vehicle 200 can select a relatively small sensing cell 205 size for sensing grid 202—smaller than the sizes of sensing cells 204 in FIG. 2A—because the vehicle may require high-resolution information about the high curvature road to accurately determine a path on the road for the vehicle to follow (e.g., for automated driving purposes).
In some examples, in addition or alternatively to the factors discussed above, vehicle 200 can determine sensing cell size based on one or more characteristics about the location of the vehicle. For example, using Global Positioning System (GPS) data from an on-board GPS receiver on vehicle 200, the vehicle can determine its location, and based on that location, can determine sensing cell size. For example, if vehicle 200 determines that it is in a city (or other dense or highly-populated area, such as an area having a population density greater than a population density threshold), it can select a relatively small sensing cell 205 size (e.g., as illustrated in FIG. 2B). If, on the other hand, vehicle 200 determines that it is in a rural area (or other sparse or lightly-populated area, such as an area having a population density less than the population density threshold), it can select a relatively large sensing cell 204 size (e.g., as illustrated in FIG. 2A).
FIG. 3 illustrates an exemplary process 300 for determining and setting the sensing cell size of a sensing grid according to examples of the disclosure. Process 300 can be performed continuously or repeatedly by the vehicle whenever information about the vehicle's surroundings is needed (e.g., during automated or non-automated parking procedures, during automated or non-automated driving procedures, etc.).
At 302, the speed of the vehicle can be monitored (e.g., as described with reference to FIGS. 1A-1C). In some examples, the speed of the vehicle can be determined using a speed sensor coupled to the wheels of the vehicle, a GPS receiver on the vehicle, or any other sensor on the vehicle that can determine the vehicle's speed.
At 304, one or more characteristics of the road(s) in the vehicle's surroundings can be monitored (e.g., as described with reference to FIGS. 2A-2B). For example, the number and/or degree of road curves in the vehicle's surroundings (e.g., within the boundaries of the sensing grid) can be monitored. In some examples, only the characteristics of the road on which the vehicle is traveling may be monitored at 304. In some examples, the characteristics of the road(s) in the vehicle's surroundings can be monitored using one or more of optical cameras, ultrasonic sensors, GPS sensors, radar sensors, LIDAR sensors, and any other sensor that can be used to determine the characteristics of roads in the vehicle's surroundings.
At 306, one or more characteristics of the current driving mode of the vehicle can be monitored (e.g., as described with reference to FIGS. 1A-1C). For example, it can be determined whether the vehicle is in a parking mode, a city driving mode, a highway driving mode, or any other driving mode. In some examples, these modes can be automatically initiated by the vehicle based on how a driver is using the vehicle and/or where the vehicle is located, while in some examples, these modes can be manually initiated by a driver of the vehicle (e.g., in response to a button press by the driver).
At 308, one or more characteristics of objects in the vehicle's surroundings can be monitored (e.g., as described with reference to FIGS. 1A-C). For example, a number of objects in the vehicle's surroundings, the sizes of objects in the vehicle's surroundings, the types of objects in the vehicle's surroundings (e.g., static objects, moving objects, such as other vehicles, etc.), or any other characteristics of the objects in the vehicle's surroundings can be monitored at 308. In some examples, the characteristics of the objects in the vehicle's surroundings can be monitored using one or more of optical cameras, ultrasonic sensors, GPS sensors, radar sensors, LIDAR sensors, and any other sensor that can be used to determine the characteristics of objects in the vehicle's surroundings.
At 310, one or more characteristics of the vehicle's location can be monitored (e.g., as described with reference to FIGS. 2A-2B). For example, using GPS data received from a GPS receiver on the vehicle, the vehicle can determine its location, whether that location is in a city or in a rural area, or any other information about the vehicle's location. In some examples, the characteristics of the vehicle's location can be monitored using one or more of optical cameras, ultrasonic sensors, GPS sensors, radar sensors, LIDAR sensors, and any other sensor that can be used to determine the characteristics of the vehicle's location.
At 312, the vehicle can determine a desired sensing cell size based on the results of one or more of steps 302, 304, 306, 308 and 310 (e.g., as described with reference to FIGS. 1A-1C and 2A-2B). This determination can include determining a constant sensing cell size to be used throughout the entirety of the sensing grid, or can include determining different sensing cell sizes to be used in different portions of the sensing grid. Further, in some examples, this determination at 312 can include selecting from a predetermined number of sensing cell sizes (e.g., small, medium, and large), or can include determining a sensing cell size that is not selected from a predetermined number of sensing cell sizes (e.g., variable, unconstrained sensing cell sizes). In some examples, sensing cell sizes can be determined based on a predetermined relationship between sensing cells of different sizes. For example, the vehicle can utilize a quadtree sensing cell data structure (e.g., an “Octomap”) in which every sensing cell has four “children” sensing cells. In this way, when the vehicle determines that a smaller sensing cell size should be selected, it can move down the quadtree to split one sensing cell into four smaller sensing cells (e.g., as described with reference to FIGS. 1A-1C and 2A-2B). The vehicle can continue moving down the quadtree in this way until the desired sensing cell size is reached. Analogously, if the vehicle determines that a larger sensing cell size should be selected, it can move up the quadtree to combine four smaller sensing cells into one larger sensing cell. Using a quadtree sensing cell data structure (or any other predetermined sensing cell size relationship) provides an easy and predictable way for the vehicle to change sensing cell size dynamically, as described in this disclosure.
At 314, the sensing cell size in a sensing grid can be set based on the determination at 312 (e.g., as described with reference to FIGS. 1A-1C and 2A-2B). In some examples, the sensing cell size set at 314 can be used in the sensing grid for any one or more of mapping, vehicle localization and vehicle path planning, among other applications. Mapping, for example, can entail determining the locations of objects in the vehicle's surroundings, and mapping those locations relative to the vehicle. Vehicle localization can entail matching a predetermined (e.g., pre-stored) map of the vehicle's surroundings with features or objects detected in the vehicle's surroundings to localize the vehicle within the predetermined map. Vehicle path planning can entail determining one or more optimal paths for the vehicle to move from a first location to a second location based on features or objects detected by the vehicle in its surroundings. Additional processes can similarly utilize the sensing grid, and thus the dynamically variable sensing cell size, of this disclosure.
FIG. 4 illustrates an exemplary system block diagram of vehicle control system 400 according to examples of the disclosure. Vehicle control system 400 can perform any of the methods described with reference to FIGS. 1A-1C, 2A-2B and 3. System 400 can be incorporated into a vehicle, such as a consumer automobile. Other example vehicles that may incorporate the system 400 include, without limitation, airplanes, boats, or industrial automobiles. Vehicle control system 400 can include one or more cameras 406 capable of capturing image data (e.g., video data) for determining various characteristics of the vehicle's surroundings, as described with reference to FIGS. 1A-1C, 2A-2B and 3. Vehicle control system 400 can also include one or more other sensors 407 (e.g., radar, ultrasonic, LIDAR, etc.) capable of detecting various characteristics of the vehicle's surroundings, and a Global Positioning System (GPS) receiver 408 capable of determining the location of the vehicle. Vehicle control system 400 can include an on-board computer 410 that is coupled to the cameras 406, sensors 407 and GPS receiver 408, and that is capable of receiving the image data from the cameras and/or outputs from the sensors 407 and the GPS receiver 408. The on-board computer 410 can be capable of determining and setting sensing cell size in a sensing grid around the vehicle, as described in this disclosure. On-board computer 410 can include storage 412, memory 416, and a processor 414. Processor 414 can perform any of the methods described with reference to FIGS. 1A-1C, 2A-2B and 3. Additionally, storage 412 and/or memory 416 can store data and instructions for performing any of the methods described with reference to FIGS. 1A-1C, 2A-2B and 3. Storage 412 and/or memory 416 can be any non-transitory computer readable storage medium, such as a solid-state drive or a hard disk drive, among other possibilities. The vehicle control system 400 can also include a controller 420 capable of controlling one or more aspects of vehicle operation, such as performing autonomous parking or driving operations using the sensing cells and sensing grids determined by the on-board computer 410.
In some examples, the vehicle control system 400 can be connected to (e.g., via controller 420) one or more actuator systems 430 in the vehicle and one or more indicator systems 440 in the vehicle. The one or more actuator systems 430 can include, but are not limited to, a motor 431 or engine 432, battery system 433, transmission gearing 434, suspension setup 435, brakes 436, steering system 437 and door system 438. The vehicle control system 400 can control, via controller 420, one or more of these actuator systems 430 during vehicle operation; for example, to open or close one or more of the doors of the vehicle using the door actuator system 438, to control the vehicle during autonomous driving or parking operations, which can utilize the sensing cells and sensing grids determined by the on-board computer 410, using the motor 431 or engine 432, battery system 433, transmission gearing 434, suspension setup 435, brakes 436 and/or steering system 437, etc. The one or more indicator systems 440 can include, but are not limited to, one or more speakers 441 in the vehicle (e.g., as part of an entertainment system in the vehicle), one or more lights 442 in the vehicle, one or more displays 443 in the vehicle (e.g., as part of a control or entertainment system in the vehicle) and one or more tactile actuators 444 in the vehicle (e.g., as part of a steering wheel or seat in the vehicle). The vehicle control system 400 can control, via controller 420, one or more of these indicator systems 440 to provide indications to a driver of the vehicle of one or more characteristics of the vehicle's surroundings that are determined using the sensing cells and sensing grids configured by the on-board computer 410.
Thus, the examples of the disclosure provide various ways to dynamically adjust the sizes of sensing cells in a sensing grid surrounding a vehicle.
Therefore, according to the above, some examples of the disclosure are directed to a system comprising: one or more processors; and a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising: at a first time, determining one or more characteristics about an area surrounding a vehicle using a first sensing grid including first sensing cells of a first size; at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria; and in response to the determination: in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using a second sensing grid including second sensing cells of a second size, different from the first size; and in accordance with a determination that the sensing cell size data does not satisfy the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the first sensing grid including the first sensing cells of the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the second sensing grid includes the second sensing cells of the second size and the first sensing cells of the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the second sensing grid does not include the first sensing cells of the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the second size is smaller than the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, a total size of the first sensing grid equals a total size of the second sensing grid. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the area surrounding the vehicle comprises an area within a predetermined distance of the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the area surrounding the vehicle include one or more locations of objects surrounding the vehicle, a path of a road on which the vehicle is traveling, types of objects surrounding the vehicle, or movements of objects surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data includes data indicative of a speed of the vehicle, and the sensing cell size change criteria include a criterion that is satisfied when the speed of the vehicle is below a threshold speed. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data includes data indicative of characteristics of one or more objects in the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold number of objects in the area surrounding the vehicle are smaller than a size threshold. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold number of objects are in the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold density of objects is in the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data includes data indicative of a driving mode of the vehicle, and the sensing cell size change criteria include a criterion that is satisfied when the driving mode of the vehicle is a first driving mode, and not satisfied when the driving mode of the vehicle is a second driving mode, different from the first driving mode. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the first driving mode and the second driving mode comprise one or more of an automated parking mode, an automated driving mode, a city driving mode, a highway driving mode, and a reverse driving mode. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data includes data indicative of characteristics of a road on which the vehicle is traveling. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when the road includes a curve having greater than a threshold curvature within the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when the road has greater than a threshold number of curves within the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when the road has greater than a threshold number of curves having greater than a threshold curvature within the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data includes data indicative of a location of the vehicle, and the sensing cell size change criteria include a criterion that is satisfied when the location of the vehicle is a first location, and not satisfied when the location of the vehicle is a second location, different from the first location. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the first location corresponds to an area with a population density greater than a population density threshold, and the second location corresponds to an area with a population density less than the population density threshold.
Some examples of the disclosure are directed to a non-transitory computer-readable medium including instructions, which when executed by one or more processors, cause the one or more processors to perform a method comprising: at a first time, determining one or more characteristics about an area surrounding a vehicle using a first sensing grid including first sensing cells of a first size; at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria; and in response to the determination: in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using a second sensing grid including second sensing cells of a second size, different from the first size; and in accordance with a determination that the sensing cell size data does not satisfy the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the first sensing grid including the first sensing cells of the first size.
Some examples of the disclosure are directed to a vehicle comprising: one or more sensors; one or more processors coupled to the one or more sensors; and a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising: at a first time, determining one or more characteristics about an area surrounding a vehicle using a first sensing grid including first sensing cells of a first size, the determination based on outputs from the one or more sensors; at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria; and in response to the determination: in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using a second sensing grid including second sensing cells of a second size, different from the first size, the determination based on outputs from the one or more sensors; and in accordance with a determination that the sensing cell size data does not satisfy the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the first sensing grid including the first sensing cells of the first size, the determination based on outputs from the one or more sensors.
Some examples of the disclosure are directed to a system comprising: one or more sensors; one or more processors coupled to the one or more sensors; and a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising: at a first time, determining one or more characteristics about an area surrounding a vehicle using the one or more sensors, the one or more sensors configured to use a first sensing grid including first sensing cells of a first size; at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria, wherein: the sensing cell size data includes data indicative of: one or more characteristics of the vehicle, one or more characteristics of a road on which the vehicle is traveling, or one or more characteristics of a location of the vehicle, and the sensing cell size change criteria include: a criterion that is satisfied when the one or more characteristics of the vehicle include a first characteristic, a criterion that is satisfied when the one or more characteristics of the road include a second characteristic, or a criterion that is satisfied when the one or more characteristics of the location of the vehicle include a third characteristic; and in response to the determination: in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use a second sensing grid including second sensing cells of a second size, different from the first size; and in accordance with a determination that the sensing cell size data does not satisfy the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use the first sensing grid including the first sensing cells of the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the second sensing grid does not include the first sensing cells of the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the second size is smaller than the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, a total size of the first sensing grid equals a total size of the second sensing grid. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the area surrounding the vehicle comprises an area within a predetermined distance of the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics about the area surrounding the vehicle include one or more locations of objects surrounding the vehicle, a path of a road on which the vehicle is traveling, types of objects surrounding the vehicle, or movements of objects surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics of the vehicle include a speed of the vehicle, and the sensing cell size data satisfies the sensing cell size change criteria when the speed of the vehicle is below a threshold speed. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data further includes data indicative of characteristics of one or more objects in the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold number of objects in the area surrounding the vehicle are smaller than a size threshold. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold number of objects are in the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold density of objects is in the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more characteristics of the vehicle include a driving mode of the vehicle, and the sensing cell size data satisfies the sensing cell size change criteria when the driving mode of the vehicle is a first driving mode, and does not satisfy the sensing cell size change criteria when the driving mode of the vehicle is a second driving mode, different from the first driving mode. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the first driving mode and the second driving mode comprise one or more of an automated parking mode, an automated driving mode, a city driving mode, a highway driving mode, and a reverse driving mode. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data satisfies the sensing cell size change criteria when the road includes a curve having greater than a threshold curvature within the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data satisfies the sensing cell size change criteria when the road has greater than a threshold number of curves within the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data satisfies the sensing cell size change criteria when the road has greater than a threshold number of curves having greater than a threshold curvature within the area surrounding the vehicle. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the sensing cell size data satisfies the sensing cell size change criteria when the location of the vehicle is a first location, and does not satisfy the sensing cell size change criteria when the location of the vehicle is a second location, different from the first location. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the first location corresponds to an area with a population density greater than a population density threshold, and the second location corresponds to an area with a population density less than the population density threshold.
Some examples of the disclosure are directed to a non-transitory computer-readable medium including instructions, which when executed by one or more processors, cause the one or more processors to perform a method comprising: at a first time, determining one or more characteristics about an area surrounding a vehicle using one or more sensors, the one or more sensors configured to use a first sensing grid including first sensing cells of a first size; at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria, wherein: the sensing cell size data includes data indicative of: one or more characteristics of the vehicle, one or more characteristics of a road on which the vehicle is traveling, or one or more characteristics of a location of the vehicle, and the sensing cell size change criteria include: a criterion that is satisfied when the one or more characteristics of the vehicle include a first characteristic, a criterion that is satisfied when the one or more characteristics of the road include a second characteristic, or a criterion that is satisfied when the one or more characteristics of the location of the vehicle include a third characteristic; and in response to the determination: in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use a second sensing grid including second sensing cells of a second size, different from the first size; and in accordance with a determination that the sensing cell size data does not satisfy the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use the first sensing grid including the first sensing cells of the first size.
Some examples of the disclosure are directed to a vehicle comprising: one or more sensors; one or more processors coupled to the one or more sensors; and a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising: at a first time, determining one or more characteristics about an area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use a first sensing grid including first sensing cells of a first size; at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria, wherein: the sensing cell size data includes data indicative of: one or more characteristics of the vehicle, one or more characteristics of a road on which the vehicle is traveling, or one or more characteristics of a location of the vehicle, and the sensing cell size change criteria include: a criterion that is satisfied when the one or more characteristics of the vehicle include a first characteristic, a criterion that is satisfied when the one or more characteristics of the road include a second characteristic, or a criterion that is satisfied when the one or more characteristics of the location of the vehicle include a third characteristic; and in response to the determination: in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use a second sensing grid including second sensing cells of a second size, different from the first size; and in accordance with a determination that the sensing cell size data does not satisfy the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use the first sensing grid including the first sensing cells of the first size.
Although examples of this disclosure have been fully described with reference to the accompanying drawings, it is to be noted that various changes and modifications will become apparent to those skilled in the art. Such changes and modifications are to be understood as being included within the scope of examples of this disclosure as defined by the appended claims.

Claims (20)

The invention claimed is:
1. A system comprising:
one or more sensors;
one or more processors coupled to the one or more sensors; and
a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising:
at a first time, determining one or more characteristics about an area surrounding a vehicle using the one or more sensors, the one or more sensors configured to use a first sensing grid including first sensing cells of a first size;
at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria, wherein:
the sensing cell size data includes data indicative of:
one or more characteristics of the vehicle,
one or more characteristics of a road on which the vehicle is traveling, or
one or more characteristics of a location of the vehicle, and
the sensing cell size change criteria include:
a criterion that is satisfied when the one or more characteristics of the vehicle include a first characteristic,
a criterion that is satisfied when the one or more characteristics of the road include a second characteristic, or
a criterion that is satisfied when the one or more characteristics of the location of the vehicle include a third characteristic; and
in response to the determination:
in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use a second sensing grid including second sensing cells of a second size, different from the first size; and
in accordance with a determination that the sensing cell size data does not satisfy the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use the first sensing grid including the first sensing cells of the first size.
2. The system of claim 1, wherein the second sensing grid does not include the first sensing cells of the first size.
3. The system of claim 1, wherein the second size is smaller than the first size.
4. The system of claim 1, wherein a total size of the first sensing grid equals a total size of the second sensing grid.
5. The system of claim 1, wherein the area surrounding the vehicle comprises an area within a predetermined distance of the vehicle.
6. The system of claim 1, wherein the one or more characteristics about the area surrounding the vehicle include one or more locations of objects surrounding the vehicle, a path of a road on which the vehicle is traveling, types of objects surrounding the vehicle, or movements of objects surrounding the vehicle.
7. The system of claim 1, wherein:
the one or more characteristics of the vehicle include a speed of the vehicle, and
the sensing cell size data satisfies the sensing cell size change criteria when the speed of the vehicle is below a threshold speed.
8. The system of claim 1, wherein:
the sensing cell size data further includes data indicative of characteristics of one or more objects in the area surrounding the vehicle.
9. The system of claim 8, wherein:
the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold number of objects in the area surrounding the vehicle are smaller than a size threshold.
10. The system of claim 8, wherein:
the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold number of objects are in the area surrounding the vehicle.
11. The system of claim 8, wherein:
the sensing cell size change criteria include a criterion that is satisfied when greater than a threshold density of objects is in the area surrounding the vehicle.
12. The system of claim 1, wherein:
the one or more characteristics of the vehicle include a driving mode of the vehicle, and
the sensing cell size data satisfies the sensing cell size change criteria when the driving mode of the vehicle is a first driving mode, and does not satisfy the sensing cell size change criteria when the driving mode of the vehicle is a second driving mode, different from the first driving mode.
13. The system of claim 12, wherein the first driving mode and the second driving mode comprise one or more of an automated parking mode, an automated driving mode, a city driving mode, a highway driving mode, and a reverse driving mode.
14. The system of claim 1, wherein:
the sensing cell size data satisfies the sensing cell size change criteria when the road includes a curve having greater than a threshold curvature within the area surrounding the vehicle.
15. The system of claim 1, wherein:
the sensing cell size data satisfies the sensing cell size change criteria when the road has greater than a threshold number of curves within the area surrounding the vehicle.
16. The system of claim 1, wherein:
the sensing cell size data satisfies the sensing cell size change criteria when the road has greater than a threshold number of curves having greater than a threshold curvature within the area surrounding the vehicle.
17. The system of claim 1, wherein:
the sensing cell size data satisfies the sensing cell size change criteria when the location of the vehicle is a first location, and does not satisfy the sensing cell size change criteria when the location of the vehicle is a second location, different from the first location.
18. The system of claim 17, wherein:
the first location corresponds to an area with a population density greater than a population density threshold, and the second location corresponds to an area with a population density less than the population density threshold.
19. A non-transitory computer-readable medium including instructions, which when executed by one or more processors, cause the one or more processors to perform a method comprising:
at a first time, determining one or more characteristics about an area surrounding a vehicle using one or more sensors, the one or more sensors configured to use a first sensing grid including first sensing cells of a first size;
at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria, wherein:
the sensing cell size data includes data indicative of:
one or more characteristics of the vehicle,
one or more characteristics of a road on which the vehicle is traveling, or
one or more characteristics of a location of the vehicle, and
the sensing cell size change criteria include:
a criterion that is satisfied when the one or more characteristics of the vehicle include a first characteristic,
a criterion that is satisfied when the one or more characteristics of the road include a second characteristic, or
a criterion that is satisfied when the one or more characteristics of the location of the vehicle include a third characteristic; and
in response to the determination:
in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use a second sensing grid including second sensing cells of a second size, different from the first size; and
in accordance with a determination that the sensing cell size data does not satisfy the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use the first sensing grid including the first sensing cells of the first size.
20. A vehicle comprising:
one or more sensors;
one or more processors coupled to the one or more sensors; and
a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising:
at a first time, determining one or more characteristics about an area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use a first sensing grid including first sensing cells of a first size;
at a second time, after the first time, determining whether sensing cell size data satisfies sensing cell size change criteria, wherein:
the sensing cell size data includes data indicative of:
one or more characteristics of the vehicle,
one or more characteristics of a road on which the vehicle is traveling, or
one or more characteristics of a location of the vehicle, and
the sensing cell size change criteria include:
a criterion that is satisfied when the one or more characteristics of the vehicle include a first characteristic,
a criterion that is satisfied when the one or more characteristics of the road include a second characteristic, or
a criterion that is satisfied when the one or more characteristics of the location of the vehicle include a third characteristic; and
in response to the determination:
in accordance with a determination that the sensing cell size data satisfies the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use a second sensing grid including second sensing cells of a second size, different from the first size; and
in accordance with a determination that the sensing cell size data does not satisfy the sensing cell size change criteria, determining one or more characteristics about the area surrounding the vehicle using the one or more sensors, the one or more sensors configured to use the first sensing grid including the first sensing cells of the first size.
US15/089,446 2016-02-29 2016-04-01 Vehicle sensing grid having dynamic sensing cell size Active US9796390B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US15/089,446 US9796390B2 (en) 2016-02-29 2016-04-01 Vehicle sensing grid having dynamic sensing cell size
CN201780013979.8A CN108698604B (en) 2016-02-29 2017-02-28 Vehicle sensing grid with dynamic sensing unit size
PCT/US2017/020043 WO2017151679A1 (en) 2016-02-29 2017-02-28 Vehicle sensing grid having dynamic sensing cell size

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201662301480P 2016-02-29 2016-02-29
US15/089,446 US9796390B2 (en) 2016-02-29 2016-04-01 Vehicle sensing grid having dynamic sensing cell size

Publications (2)

Publication Number Publication Date
US20170247036A1 US20170247036A1 (en) 2017-08-31
US9796390B2 true US9796390B2 (en) 2017-10-24

Family

ID=59678857

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/089,446 Active US9796390B2 (en) 2016-02-29 2016-04-01 Vehicle sensing grid having dynamic sensing cell size

Country Status (3)

Country Link
US (1) US9796390B2 (en)
CN (1) CN108698604B (en)
WO (1) WO2017151679A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11193787B2 (en) * 2018-07-10 2021-12-07 Furuno Electric Co., Ltd. Graph generating device
US20220113371A1 (en) * 2019-06-21 2022-04-14 Huawei Technologies Co., Ltd. Sensor Control Method and Apparatus, and Sensor
US20220144287A1 (en) * 2020-11-11 2022-05-12 Hyundai Mobis Co., Ltd. Radar system for vehicles and method for operating the same

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6674846B2 (en) * 2016-05-31 2020-04-01 株式会社小松製作所 Shape measuring system, work machine and shape measuring method
JP6662454B2 (en) * 2016-06-29 2020-03-11 日本電産株式会社 Moving object guidance system, moving object, guidance device, and computer program
KR101927912B1 (en) * 2016-11-01 2018-12-11 현대자동차주식회사 Terminal Device, Vehicle, Personal Mobility, method for controlling the terminal device and method for controlling the vehicle
US10195992B2 (en) * 2017-04-03 2019-02-05 Ford Global Technologies, Llc Obstacle detection systems and methods
US9987981B1 (en) * 2017-07-21 2018-06-05 Feniex Industries, Inc. Apparatus and method for vehicle related work zone intrusion detection
US11077756B2 (en) * 2017-11-23 2021-08-03 Intel Corporation Area occupancy determining device
DK201970115A1 (en) 2018-11-08 2020-06-09 Aptiv Technologies Limited Deep learning for object detection using pillars
US20210101616A1 (en) * 2019-10-08 2021-04-08 Mobileye Vision Technologies Ltd. Systems and methods for vehicle navigation
GB2591171B (en) 2019-11-14 2023-09-13 Motional Ad Llc Sequential fusion for 3D object detection
US11242057B2 (en) * 2019-11-22 2022-02-08 Baidu Usa Llc Method for optimizing three-point turn of autonomous driving vehicles
KR20210065259A (en) * 2019-11-26 2021-06-04 삼성전자주식회사 Radar apparatus and method of operating the same
KR20220027359A (en) * 2020-08-26 2022-03-08 현대자동차주식회사 Method for adjusting grid interval of height map for autonomous driving
WO2023236024A1 (en) * 2022-06-06 2023-12-14 Nokia Shanghai Bell Co., Ltd. On-demand sensing of dynamic sensing area

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030146841A1 (en) * 2000-08-29 2003-08-07 Winfried Koenig Method and device for diagnosing in a motor vehicle a driver's fitness drive
US20050033517A1 (en) * 2003-08-08 2005-02-10 Nissan Motor Co., Ltd Driving assist system for vehicle
US20060023917A1 (en) 2004-07-01 2006-02-02 Daimlerchrysler Ag Object detection method for vehicles
US20070282530A1 (en) * 2003-11-28 2007-12-06 Dirk Meister Method And Device For Warning The Driver Of A Motor Vehicle
US20090125160A1 (en) * 2007-11-13 2009-05-14 Desai Shitalkumar V Relieving Urban Traffic Congestion
US20090303234A1 (en) 2007-03-15 2009-12-10 Jan-Carsten Becker Method for object formation
US20110046843A1 (en) * 2009-08-24 2011-02-24 Toyota Motor Engin. & Manufact. N.A.(TEMA) Systems and methods of vehicular path prediction for cooperative driving applications through digital map and dynamic vehicle model fusion
DE102011113016A1 (en) 2011-09-09 2012-03-29 Daimler Ag Method for representing environment of vehicle, involves increasing detail information level of hierarchical data structure corresponding to object with high uncertainty than that of other objects identified in environment of vehicle
US20120176234A1 (en) * 2011-01-10 2012-07-12 Bendix Commercial Vehicle Systems, Llc Acc and am braking range variable based on internal and external factors
US20150003683A1 (en) 2012-06-19 2015-01-01 Conti Temic Microelectronic Gmbh Method for Representing the Surroundings of a Vehicle
JP2015055541A (en) 2013-09-11 2015-03-23 トヨタ自動車株式会社 Surrounding object detection apparatus
US20150353083A1 (en) 2013-01-14 2015-12-10 Robert Bosch Gmbh Creation of an obstacle map
US20160114798A1 (en) * 2014-10-27 2016-04-28 Hyundai Motor Company Driver assistance apparatus and method for operating the same

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030146841A1 (en) * 2000-08-29 2003-08-07 Winfried Koenig Method and device for diagnosing in a motor vehicle a driver's fitness drive
US20050033517A1 (en) * 2003-08-08 2005-02-10 Nissan Motor Co., Ltd Driving assist system for vehicle
US20070282530A1 (en) * 2003-11-28 2007-12-06 Dirk Meister Method And Device For Warning The Driver Of A Motor Vehicle
US20060023917A1 (en) 2004-07-01 2006-02-02 Daimlerchrysler Ag Object detection method for vehicles
US20090303234A1 (en) 2007-03-15 2009-12-10 Jan-Carsten Becker Method for object formation
US20090125160A1 (en) * 2007-11-13 2009-05-14 Desai Shitalkumar V Relieving Urban Traffic Congestion
US20110046843A1 (en) * 2009-08-24 2011-02-24 Toyota Motor Engin. & Manufact. N.A.(TEMA) Systems and methods of vehicular path prediction for cooperative driving applications through digital map and dynamic vehicle model fusion
US20120176234A1 (en) * 2011-01-10 2012-07-12 Bendix Commercial Vehicle Systems, Llc Acc and am braking range variable based on internal and external factors
DE102011113016A1 (en) 2011-09-09 2012-03-29 Daimler Ag Method for representing environment of vehicle, involves increasing detail information level of hierarchical data structure corresponding to object with high uncertainty than that of other objects identified in environment of vehicle
US20150003683A1 (en) 2012-06-19 2015-01-01 Conti Temic Microelectronic Gmbh Method for Representing the Surroundings of a Vehicle
US20150353083A1 (en) 2013-01-14 2015-12-10 Robert Bosch Gmbh Creation of an obstacle map
JP2015055541A (en) 2013-09-11 2015-03-23 トヨタ自動車株式会社 Surrounding object detection apparatus
US20160114798A1 (en) * 2014-10-27 2016-04-28 Hyundai Motor Company Driver assistance apparatus and method for operating the same

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
International Search Report dated Jul. 20, 2017, for PCT/US2017/020043, filed Feb. 28, 2017, three pages.

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11193787B2 (en) * 2018-07-10 2021-12-07 Furuno Electric Co., Ltd. Graph generating device
US20220113371A1 (en) * 2019-06-21 2022-04-14 Huawei Technologies Co., Ltd. Sensor Control Method and Apparatus, and Sensor
US20220144287A1 (en) * 2020-11-11 2022-05-12 Hyundai Mobis Co., Ltd. Radar system for vehicles and method for operating the same

Also Published As

Publication number Publication date
WO2017151679A1 (en) 2017-09-08
CN108698604A (en) 2018-10-23
US20170247036A1 (en) 2017-08-31
CN108698604B (en) 2020-06-12

Similar Documents

Publication Publication Date Title
US9796390B2 (en) Vehicle sensing grid having dynamic sensing cell size
CN109421742B (en) Method and apparatus for monitoring autonomous vehicles
CN111208813B (en) Dynamics prediction control system and method for automatic driving vehicle
EP3359436B1 (en) Method and system for operating autonomous driving vehicles based on motion plans
CN109421739B (en) Method and apparatus for monitoring autonomous vehicles
CN106553644B (en) Autopilot facility and automated driving system
US9828001B2 (en) Confidence icons for apprising a driver of confidence in an autonomous operation of a vehicle
US9558584B1 (en) 3D position estimation of objects from a monocular camera using a set of known 3D points on an underlying surface
US10232848B2 (en) Detection of left turn across path/opposite direction oncoming objects
US20140303827A1 (en) Systems and Methods for Transitioning Control of an Autonomous Vehicle to a Driver
JP7097439B2 (en) Adjustable vertical field of view
US9956958B2 (en) Vehicle driving control device and control device
CN111204340A (en) System and method for controlling an autonomous vehicle
CN113525373B (en) Lane changing control system, control method and lane changing controller for vehicle
CN108501951B (en) Method and system for performance capability of autonomous vehicle
CN112445226A (en) Method for autonomous driving of a maneuver plan navigating around a parked vehicle
US20150158487A1 (en) Method for chassis control and chassis control system
US11292487B2 (en) Methods and systems for controlling automated driving features of a vehicle
JP7448624B2 (en) Driving support devices, driving support methods, and programs
US20200387161A1 (en) Systems and methods for training an autonomous vehicle
CN111231929B (en) Method for detecting lateral control oscillations in vehicle behaviour
JP2020124962A (en) Vehicle travel control system
US11479241B1 (en) Vehicle stabilization system and method using clutch-kick maneuver
EP4074581A1 (en) A method for generating a map of an area to be used for guiding a vehicle
US11479268B2 (en) Autonomous control of vehicle driving modes in certain traffic situations

Legal Events

Date Code Title Description
AS Assignment

Owner name: FARADAY&FUTURE INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HALDER, BIBHRAJIT;GADE, SOWMYA;REEL/FRAME:038184/0561

Effective date: 20160331

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: SEASON SMART LIMITED, VIRGIN ISLANDS, BRITISH

Free format text: SECURITY INTEREST;ASSIGNOR:FARADAY&FUTURE INC.;REEL/FRAME:044969/0023

Effective date: 20171201

AS Assignment

Owner name: FARADAY&FUTURE INC., CALIFORNIA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:SEASON SMART LIMITED;REEL/FRAME:048069/0704

Effective date: 20181231

AS Assignment

Owner name: BIRCH LAKE FUND MANAGEMENT, LP, ILLINOIS

Free format text: SECURITY INTEREST;ASSIGNORS:CITY OF SKY LIMITED;EAGLE PROP HOLDCO LLC;FARADAY FUTURE LLC;AND OTHERS;REEL/FRAME:050234/0069

Effective date: 20190429

AS Assignment

Owner name: ROYOD LLC, AS SUCCESSOR AGENT, CALIFORNIA

Free format text: ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT;ASSIGNOR:BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT;REEL/FRAME:052102/0452

Effective date: 20200227

AS Assignment

Owner name: BIRCH LAKE FUND MANAGEMENT, LP, ILLINOIS

Free format text: SECURITY INTEREST;ASSIGNOR:ROYOD LLC;REEL/FRAME:054076/0157

Effective date: 20201009

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

AS Assignment

Owner name: ARES CAPITAL CORPORATION, AS SUCCESSOR AGENT, NEW YORK

Free format text: ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT;ASSIGNOR:BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT;REEL/FRAME:057019/0140

Effective date: 20210721

AS Assignment

Owner name: FARADAY SPE, LLC, CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069;ASSIGNOR:ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT;REEL/FRAME:060314/0263

Effective date: 20220607

Owner name: SMART TECHNOLOGY HOLDINGS LTD., CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069;ASSIGNOR:ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT;REEL/FRAME:060314/0263

Effective date: 20220607

Owner name: SMART KING LTD., CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069;ASSIGNOR:ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT;REEL/FRAME:060314/0263

Effective date: 20220607

Owner name: ROBIN PROP HOLDCO LLC, CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069;ASSIGNOR:ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT;REEL/FRAME:060314/0263

Effective date: 20220607

Owner name: FF MANUFACTURING LLC, CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069;ASSIGNOR:ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT;REEL/FRAME:060314/0263

Effective date: 20220607

Owner name: FF INC., CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069;ASSIGNOR:ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT;REEL/FRAME:060314/0263

Effective date: 20220607

Owner name: FF HONG KONG HOLDING LIMITED, CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069;ASSIGNOR:ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT;REEL/FRAME:060314/0263

Effective date: 20220607

Owner name: FF EQUIPMENT LLC, CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069;ASSIGNOR:ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT;REEL/FRAME:060314/0263

Effective date: 20220607

Owner name: FARADAY FUTURE LLC, CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069;ASSIGNOR:ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT;REEL/FRAME:060314/0263

Effective date: 20220607

Owner name: FARADAY & FUTURE INC., CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069;ASSIGNOR:ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT;REEL/FRAME:060314/0263

Effective date: 20220607

Owner name: EAGLE PROP HOLDCO LLC, CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069;ASSIGNOR:ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT;REEL/FRAME:060314/0263

Effective date: 20220607

Owner name: CITY OF SKY LIMITED, CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069;ASSIGNOR:ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT;REEL/FRAME:060314/0263

Effective date: 20220607

AS Assignment

Owner name: FF SIMPLICY VENTURES LLC, NEW YORK

Free format text: SECURITY INTEREST;ASSIGNOR:FARADAY&FUTURE INC.;REEL/FRAME:061176/0756

Effective date: 20220814