WO2012136345A3 - System and method for visually displaying information on real objects - Google Patents

System and method for visually displaying information on real objects Download PDF

Info

Publication number
WO2012136345A3
WO2012136345A3 PCT/EP2012/001459 EP2012001459W WO2012136345A3 WO 2012136345 A3 WO2012136345 A3 WO 2012136345A3 EP 2012001459 W EP2012001459 W EP 2012001459W WO 2012136345 A3 WO2012136345 A3 WO 2012136345A3
Authority
WO
WIPO (PCT)
Prior art keywords
projection unit
location
information
visually displaying
real objects
Prior art date
Application number
PCT/EP2012/001459
Other languages
German (de)
French (fr)
Other versions
WO2012136345A2 (en
Inventor
Peter Keitler
Björn SCHWERDTFEGER
Nicolas Heuser
Beatriz JÍMENEZ-FRIEDEN
Original Assignee
EXTEND3D GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by EXTEND3D GmbH filed Critical EXTEND3D GmbH
Priority to EP12722290.9A priority Critical patent/EP2695383A2/en
Priority to US14/009,531 priority patent/US20140160115A1/en
Publication of WO2012136345A2 publication Critical patent/WO2012136345A2/en
Publication of WO2012136345A3 publication Critical patent/WO2012136345A3/en
Priority to US15/285,568 priority patent/US20170054954A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
    • G01B11/03—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness by measuring coordinates of points
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3185—Geometric adjustment, e.g. keystone or convergence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H04N9/3194—Testing thereof including sensor feedback
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30108—Industrial image inspection
    • G06T2207/30164—Workpiece; Machine component
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Abstract

A system for visually displaying information on real objects comprises a projection unit (14) for graphically or pictorially transmitting an item of information to an object and is characterized by a dynamic tracking device having a 3D sensor system for determining and keeping track of the position and/or location of the object and/or of the projection unit (14) in space, and a control device for the projection unit (14), which control device adapts the transmission of the information to the current position and/or location of the object and/or of the projection unit (14), as determined by the tracking device. A method for visually displaying information on real objects using a projection unit (14) comprises the steps of: determining the current position and/or location of the object and/or of the projection unit (14) in space; graphically or pictorially transmitting an item of information to the object on the basis of the determined position and/or location; detecting and determining a change in the position and/or location of the object and/or of the projection unit (14); and adapting the transmission of the information to the changed position and/or location of the object and/or of the projection unit (14).
PCT/EP2012/001459 2011-04-04 2012-04-02 System and method for visually displaying information on real objects WO2012136345A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP12722290.9A EP2695383A2 (en) 2011-04-04 2012-04-02 System and method for visually displaying information on real objects
US14/009,531 US20140160115A1 (en) 2011-04-04 2012-04-02 System And Method For Visually Displaying Information On Real Objects
US15/285,568 US20170054954A1 (en) 2011-04-04 2016-10-05 System and method for visually displaying information on real objects

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102011015987.8 2011-04-04
DE102011015987A DE102011015987A1 (en) 2011-04-04 2011-04-04 System and method for visual presentation of information on real objects

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US14/009,531 A-371-Of-International US20140160115A1 (en) 2011-04-04 2012-04-02 System And Method For Visually Displaying Information On Real Objects
US15/285,568 Division US20170054954A1 (en) 2011-04-04 2016-10-05 System and method for visually displaying information on real objects

Publications (2)

Publication Number Publication Date
WO2012136345A2 WO2012136345A2 (en) 2012-10-11
WO2012136345A3 true WO2012136345A3 (en) 2012-12-20

Family

ID=46146807

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2012/001459 WO2012136345A2 (en) 2011-04-04 2012-04-02 System and method for visually displaying information on real objects

Country Status (4)

Country Link
US (1) US20140160115A1 (en)
EP (1) EP2695383A2 (en)
DE (1) DE102011015987A1 (en)
WO (1) WO2012136345A2 (en)

Families Citing this family (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9947112B2 (en) * 2012-12-18 2018-04-17 Koninklijke Philips N.V. Scanning device and method for positioning a scanning device
US9881383B2 (en) 2013-01-28 2018-01-30 Virtek Vision International Ulc Laser projection system with motion compensation and method
US20140358298A1 (en) * 2013-05-31 2014-12-04 DWFritz Automation, Inc. Alignment tool
WO2015016798A2 (en) * 2013-07-31 2015-02-05 Imcom Yazilim Elektronik Sanayi Ltd. Sti. A system for an augmented reality application
DE102013114707A1 (en) * 2013-12-20 2015-06-25 EXTEND3D GmbH Method for carrying out and controlling a processing step on a workpiece
DE102014102773A1 (en) * 2014-03-03 2015-09-03 De-Sta-Co Europe Gmbh Process for reproducing a manufacturing process in a virtual environment
DE102014104514B4 (en) * 2014-03-31 2018-12-13 EXTEND3D GmbH Method for measuring data visualization and apparatus for carrying out the method
FR3021784B1 (en) 2014-05-27 2017-10-13 European Aeronautic Defence & Space Co Eads France METHOD FOR PROJECTING VIRTUAL DATA AND DEVICE FOR SAID PROJECTION
WO2016022154A1 (en) * 2014-08-08 2016-02-11 Robotic Vision Technologies, LLC Detection and tracking of item features
US9412205B2 (en) 2014-08-25 2016-08-09 Daqri, Llc Extracting sensor data for augmented reality content
US20160086372A1 (en) * 2014-09-22 2016-03-24 Huntington Ingalls Incorporated Three Dimensional Targeting Structure for Augmented Reality Applications
US9710960B2 (en) 2014-12-04 2017-07-18 Vangogh Imaging, Inc. Closed-form 3D model generation of non-rigid complex objects from incomplete and noisy scans
US9978135B2 (en) * 2015-02-27 2018-05-22 Cognex Corporation Detecting object presence on a target surface
DE102016203377A1 (en) * 2015-03-02 2016-11-24 Virtek Vision International Inc. Laser projection system with video overlay
US20160358382A1 (en) * 2015-06-04 2016-12-08 Vangogh Imaging, Inc. Augmented Reality Using 3D Depth Sensor and 3D Projection
DE102015213124A1 (en) 2015-07-14 2017-01-19 Thyssenkrupp Ag Method for producing a molded component and device for carrying out the method
US10824312B2 (en) 2015-12-01 2020-11-03 Vinci Construction Method and system for assisting installation of elements in a construction work
US10739670B2 (en) * 2015-12-04 2020-08-11 Augmency Teknoloji Sanayi Anonim Sirketi Physical object reconstruction through a projection display system
US11062383B2 (en) * 2016-05-10 2021-07-13 Lowe's Companies, Inc. Systems and methods for displaying a simulated room and portions thereof
EP3244286B1 (en) * 2016-05-13 2020-11-04 Accenture Global Solutions Limited Installation of a physical element
DE102016215860A1 (en) * 2016-08-24 2018-03-01 Siemens Aktiengesellschaft Trackingless projection-based "Augmented Reality [AR]" method and system for assembly support of production goods, in particular for locating sliding blocks for component mounting in wagon construction
WO2018056919A1 (en) * 2016-09-21 2018-03-29 Anadolu Universitesi Rektorlugu Augmented reality based guide system
US10380762B2 (en) 2016-10-07 2019-08-13 Vangogh Imaging, Inc. Real-time remote collaboration and virtual presence using simultaneous localization and mapping to construct a 3D model and update a scene based on sparse data
JP2018116037A (en) * 2017-01-13 2018-07-26 株式会社エンプラス Unit for mounting marker and method for manufacturing the same
JP2018116036A (en) * 2017-01-13 2018-07-26 株式会社エンプラス Unit for mounting marker
JP2018116035A (en) * 2017-01-13 2018-07-26 株式会社エンプラス Unit for mounting marker
US11270510B2 (en) * 2017-04-04 2022-03-08 David Peter Warhol System and method for creating an augmented reality interactive environment in theatrical structure
DE102017206772A1 (en) * 2017-04-21 2018-10-25 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. System for marking parts and / or areas on surfaces of parts or the position of a part
DE102017005353A1 (en) * 2017-06-01 2018-12-06 Vdeh-Betriebsforschungsinstitut Gmbh Visualization of quality information
CN107160397B (en) * 2017-06-09 2023-07-18 浙江立镖机器人有限公司 Robot walking module landmark, landmark and robot thereof
JP6831772B2 (en) * 2017-12-22 2021-02-17 株式会社Ｓｕｂａｒｕ Image projection device
JP6718429B2 (en) * 2017-12-22 2020-07-08 株式会社Ｓｕｂａｒｕ Image projection device
CN108062776B (en) * 2018-01-03 2019-05-24 百度在线网络技术（北京）有限公司 Camera Attitude Tracking method and apparatus
US10839585B2 (en) 2018-01-05 2020-11-17 Vangogh Imaging, Inc. 4D hologram: real-time remote avatar creation and animation control
US11080540B2 (en) 2018-03-20 2021-08-03 Vangogh Imaging, Inc. 3D vision processing using an IP block
US10810783B2 (en) 2018-04-03 2020-10-20 Vangogh Imaging, Inc. Dynamic real-time texture alignment for 3D models
US11170224B2 (en) 2018-05-25 2021-11-09 Vangogh Imaging, Inc. Keyframe-based object scanning and tracking
DE102018112910B4 (en) * 2018-05-30 2020-03-26 Mtu Friedrichshafen Gmbh Manufacturing process for a drive device and test device
FR3086383B1 (en) * 2018-09-21 2020-08-28 Diotasoft PROCESS, MODULE AND SYSTEM FOR PROJECTING ON A PART OF AN IMAGE CALCULATED FROM A DIGITAL MODEL
CN109840938B (en) * 2018-12-30 2022-12-23 芜湖哈特机器人产业技术研究院有限公司 Point cloud model reconstruction method for complex automobile
JP7296218B2 (en) * 2019-03-05 2023-06-22 倉敷紡績株式会社 Insulation thickness measurement method
EP3952296A4 (en) * 2019-03-29 2022-04-27 Panasonic Intellectual Property Management Co., Ltd. Projection system, projection device and projection method
US11232633B2 (en) 2019-05-06 2022-01-25 Vangogh Imaging, Inc. 3D object capture and object reconstruction using edge cloud computing resources
US11170552B2 (en) 2019-05-06 2021-11-09 Vangogh Imaging, Inc. Remote visualization of three-dimensional (3D) animation with synchronized voice in real-time
US11335063B2 (en) 2020-01-03 2022-05-17 Vangogh Imaging, Inc. Multiple maps for 3D object scanning and reconstruction
JP7441707B2 (en) * 2020-03-31 2024-03-01 株式会社ユーシン精機 Attachment three-dimensional shape measurement method
US20220408067A1 (en) * 2021-06-22 2022-12-22 Industrial Technology Research Institute Visual recognition based method and system for projecting patterned light, method and system applied to oral inspection, and machining system
JP7296669B1 (en) 2022-02-28 2023-06-23 株式会社イクシス Surveying method, target marker, and surveying system
CN116182803B (en) * 2023-04-25 2023-07-14 昆明人为峰科技有限公司 Remote sensing mapping device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5870136A (en) * 1997-12-05 1999-02-09 The University Of North Carolina At Chapel Hill Dynamic generation of imperceptible structured light for tracking and acquisition of three dimensional scene geometry and surface characteristics in interactive three dimensional computer graphics applications
EP1107052A1 (en) * 1999-06-10 2001-06-13 Sony Corporation Method and apparatus for image projection, and apparatus for controlling image projection
US20040201823A1 (en) * 2003-04-11 2004-10-14 Ramesh Raskar Context aware projector
US20060235849A1 (en) * 2005-02-24 2006-10-19 Robert Schmidt Portable laser projection device for medical image display

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4753569A (en) * 1982-12-28 1988-06-28 Diffracto, Ltd. Robot calibration
US5341183A (en) * 1992-09-28 1994-08-23 The Boeing Company Method for controlling projection of optical layup template
US5388318A (en) * 1992-10-09 1995-02-14 Laharco, Inc. Method for defining a template for assembling a structure
DE69831181T2 (en) * 1997-05-30 2006-05-18 British Broadcasting Corp. location
US6066845A (en) * 1997-11-14 2000-05-23 Virtek Vision Corporation Laser scanning method and system
DE10012273B4 (en) * 2000-03-14 2006-09-28 Daimlerchrysler Ag Plant for the metrological spatial 3D position detection of surface points
CA2463570C (en) * 2001-10-11 2012-06-19 Laser Projection Technologies, Inc. Method and system for visualizing surface errors
DE10333039A1 (en) * 2003-07-21 2004-09-09 Daimlerchrysler Ag Measurement mark e.g. for industrial measurements, includes control/test feature for testing identification of coding marks
EP1719580B1 (en) * 2003-09-10 2012-06-27 Nikon Metrology NV Laser projection system
DE102004021892B4 (en) * 2004-05-04 2010-02-04 Amatec Robotics Gmbh Robot-guided optical measuring arrangement and method and auxiliary device for measuring this measuring arrangement
US7268893B2 (en) * 2004-11-12 2007-09-11 The Boeing Company Optical projection system
US7306339B2 (en) * 2005-02-01 2007-12-11 Laser Projection Technologies, Inc. Laser projection with object feature detection
DE102006048869B4 (en) * 2006-10-17 2019-07-04 Volkswagen Ag Projection arrangement and method for displaying a design on a surface of a motor vehicle

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5870136A (en) * 1997-12-05 1999-02-09 The University Of North Carolina At Chapel Hill Dynamic generation of imperceptible structured light for tracking and acquisition of three dimensional scene geometry and surface characteristics in interactive three dimensional computer graphics applications
EP1107052A1 (en) * 1999-06-10 2001-06-13 Sony Corporation Method and apparatus for image projection, and apparatus for controlling image projection
US20040201823A1 (en) * 2003-04-11 2004-10-14 Ramesh Raskar Context aware projector
US20060235849A1 (en) * 2005-02-24 2006-10-19 Robert Schmidt Portable laser projection device for medical image display

Also Published As

Publication number Publication date
EP2695383A2 (en) 2014-02-12
US20140160115A1 (en) 2014-06-12
WO2012136345A2 (en) 2012-10-11
DE102011015987A1 (en) 2012-10-04

Similar Documents

Publication Publication Date Title
WO2012136345A3 (en) System and method for visually displaying information on real objects
WO2014052802A3 (en) Systems and methods for three-dimensional interaction monitoring in an ems environment
WO2013144599A3 (en) Touch sensing systems
WO2012050305A3 (en) Apparatus and method for providing obstacle information in autonomous mobile vehicle
EP3093194A3 (en) Information provision device, information provision method, and carrier means
IN2015DN01984A (en)
WO2012020696A8 (en) Device for processing point cloud position data, system for processing point cloud position data, method for processing point cloud position data and program for processing point cloud position data
EP2894491A3 (en) Distance measuring device and method thereof
EP3594086A3 (en) Guideway mounted vehicle localization system
WO2014018949A3 (en) Wide dynamic range using monochromatic sensor
WO2014125380A3 (en) Systems and methods of eye tracking calibration
WO2011129617A3 (en) Determination of a location of an apparatus
WO2014113551A3 (en) Navigation systems and methods for indicating line-of-sight errors
WO2012135191A3 (en) System and method for leadwire location
EP2873444A3 (en) Virtual reality based rehabilitation apparatuses and methods
EP2787591A3 (en) System and Method for Determining Proximity
WO2012166545A3 (en) Aircraft part control system
NZ622924A (en) System and method for supporting an exercise movement
WO2013158560A3 (en) System and method for estimating receiver position using timing data associated with reference locations
WO2014070312A3 (en) Reference coordinate system determination
WO2011041262A3 (en) Real-time feedback of task performance
MX2014013769A (en) Vehicle control device, and vehicle control method.
IN2014CN04458A (en)
WO2014099680A3 (en) System and method of coordinating distribution of an item
WO2012106068A3 (en) Mobile camera localization using depth maps

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12722290

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2012722290

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2012722290

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 14009531

Country of ref document: US