WO2005015490A3 - Methods and systems for compensating an image projected onto a surface having spatially varying photometric properties - Google Patents

Methods and systems for compensating an image projected onto a surface having spatially varying photometric properties Download PDF

Info

Publication number
WO2005015490A3
WO2005015490A3 PCT/US2004/021400 US2004021400W WO2005015490A3 WO 2005015490 A3 WO2005015490 A3 WO 2005015490A3 US 2004021400 W US2004021400 W US 2004021400W WO 2005015490 A3 WO2005015490 A3 WO 2005015490A3
Authority
WO
WIPO (PCT)
Prior art keywords
systems
methods
images
projector
compensating
Prior art date
Application number
PCT/US2004/021400
Other languages
French (fr)
Other versions
WO2005015490A2 (en
WO2005015490A8 (en
Inventor
Shree Nayar
Michael Grossberg
Harish Peri
Peter Belhumeur
Original Assignee
York Trustees Of Columbia Univ
Shree Nayar
Michael Grossberg
Harish Peri
Peter Belhumeur
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by York Trustees Of Columbia Univ, Shree Nayar, Michael Grossberg, Harish Peri, Peter Belhumeur filed Critical York Trustees Of Columbia Univ
Publication of WO2005015490A2 publication Critical patent/WO2005015490A2/en
Publication of WO2005015490A3 publication Critical patent/WO2005015490A3/en
Publication of WO2005015490A8 publication Critical patent/WO2005015490A8/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image

Abstract

Methods and systems are provided for displaying images onto an arbitrary surface, using a projector, such that the quality of the images is preserved despite surface imperfections or color variations. Methods and systems are also provided for controlling the appearance of a projection surface. Various embodiments use a detailed radiometric model and a calibration method to determine the pixel values required to be projected by a projector in order for a camera to observe a desired image. Other embodiments use a compensation algorithm that uses a feedback approach to provide the desired image compensation. Geometric mapping may be used to establish a correspondence between points in the images to be displayed by the projector and the corresponding points in the images that are captured by the camera.
PCT/US2004/021400 2003-07-02 2004-07-02 Methods and systems for compensating an image projected onto a surface having spatially varying photometric properties WO2005015490A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US48425203P 2003-07-02 2003-07-02
US60/484,252 2003-07-02

Publications (3)

Publication Number Publication Date
WO2005015490A2 WO2005015490A2 (en) 2005-02-17
WO2005015490A3 true WO2005015490A3 (en) 2006-08-24
WO2005015490A8 WO2005015490A8 (en) 2007-02-22

Family

ID=34135061

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2004/021400 WO2005015490A2 (en) 2003-07-02 2004-07-02 Methods and systems for compensating an image projected onto a surface having spatially varying photometric properties

Country Status (2)

Country Link
US (1) US7663640B2 (en)
WO (1) WO2005015490A2 (en)

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7212688B2 (en) * 2003-12-30 2007-05-01 A. Zahner Co. Computer program and method for converting an image to machine control data
KR100571834B1 (en) * 2004-02-27 2006-04-17 삼성전자주식회사 Method and apparatus of detecting dust on the floor in a robot for cleaning
US7450754B2 (en) * 2004-03-23 2008-11-11 Microsoft Corporation Radiometric calibration from a single image
WO2006023647A1 (en) * 2004-08-18 2006-03-02 Sarnoff Corporation Systeme and method for monitoring training environment
KR101225063B1 (en) 2006-04-04 2013-01-24 삼성전자주식회사 Unobtrusive calibration method for projected image compensation and apparatus for the same
JP4270264B2 (en) * 2006-11-01 2009-05-27 セイコーエプソン株式会社 Image correction apparatus, projection system, image correction method, image correction program, and recording medium
US8042954B2 (en) * 2007-01-24 2011-10-25 Seiko Epson Corporation Mosaicing of view projections
US8330768B2 (en) * 2007-07-27 2012-12-11 Sharp Laboratories Of America, Inc. Apparatus and method for rendering high dynamic range images for standard dynamic range display
US8218003B2 (en) * 2007-10-05 2012-07-10 Seiko Epson Corporation Optimization strategies for GPU view projection matrix implementation
US9241143B2 (en) 2008-01-29 2016-01-19 At&T Intellectual Property I, L.P. Output correction for visual projection devices
US8149300B2 (en) 2008-04-28 2012-04-03 Microsoft Corporation Radiometric calibration from noise distributions
US8111290B2 (en) 2008-06-06 2012-02-07 Microsoft Corporation Radiometric calibration using temporal irradiance mixtures
US20100233660A1 (en) * 2008-06-26 2010-09-16 The United States Of America As Represented By Pulsed Laser-Based Firearm Training System, and Method for Facilitating Firearm Training Using Detection of Laser Pulse Impingement of Projected Target Images
US8013904B2 (en) * 2008-12-09 2011-09-06 Seiko Epson Corporation View projection matrix based high performance low latency display pipeline
US9195121B2 (en) * 2009-04-28 2015-11-24 The Regents Of The University Of California Markerless geometric registration of multiple projectors on extruded surfaces using an uncalibrated camera
CN102450001B (en) * 2009-05-29 2015-08-12 惠普开发有限公司 Reduce the method for the viewpoint associated artifact in multi-projector system, equipment and optical projection system
US8355601B2 (en) * 2010-01-15 2013-01-15 Seiko Epson Corporation Real-time geometry aware projection and fast re-calibration
US8449119B2 (en) 2010-09-01 2013-05-28 International Business Machines Corporation Modifying application windows based on projection surface characteristics
US8724893B2 (en) * 2011-09-27 2014-05-13 Thomson Licensing Method and system for color look up table generation
IL216515A (en) 2011-11-22 2015-02-26 Israel Aerospace Ind Ltd System and method for processing multi-camera array images
US8928781B2 (en) 2011-11-30 2015-01-06 Microsoft Corporation Response function determination by rank minimization
US9330587B2 (en) 2012-07-31 2016-05-03 Hewlett-Packard Development Company, L.P. Color adjustment based on object positioned near display surface
US9317895B1 (en) * 2012-08-09 2016-04-19 Xilinx, Inc. Non-linear image mapping
US9093007B2 (en) * 2012-09-21 2015-07-28 Blackberry Limited Method and device for generating a presentation
EP3175615A4 (en) * 2014-08-01 2018-03-28 Hewlett-Packard Development Company, L.P. Projection of image onto object
US9495004B2 (en) * 2014-09-08 2016-11-15 Qualcomm Incorporated Display device adjustment by control device
US10152944B2 (en) 2014-12-24 2018-12-11 Stmicroelectronics S.R.L. Method for radiometric compensated display, corresponding system, apparatus and computer program product
JP6617432B2 (en) * 2015-04-13 2019-12-11 富士ゼロックス株式会社 Image processing apparatus and program
US20170094251A1 (en) * 2015-09-30 2017-03-30 Faro Technologies, Inc. Three-dimensional imager that includes a dichroic camera
KR102402051B1 (en) * 2015-10-12 2022-05-26 삼성전자주식회사 Electronic apparatus, display panel apparatus calibration method thereof and calibration system
US9881405B2 (en) 2015-12-23 2018-01-30 Intel Corporation Image processor for producing an image on an irregular surface in a wearable device
CN108074517B (en) * 2016-11-17 2019-11-29 西安诺瓦星云科技股份有限公司 Pointwise correction method
US10630948B2 (en) * 2018-09-26 2020-04-21 Christie Digital Systems Usa, Inc. Device, system and method for photometric compensation of images provided by a display device
EP3709638B1 (en) * 2019-03-13 2023-08-30 L'oreal System and method for projecting digital content onto user's facial surface
ES2937132T3 (en) * 2019-03-13 2023-03-24 Oreal System and method for projecting digital content including hair color changes on a user's head
CN113375803B (en) * 2021-06-08 2022-09-27 河北工业大学 Method and device for measuring radial chromatic aberration of projector, storage medium and equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6310650B1 (en) * 1998-09-23 2001-10-30 Honeywell International Inc. Method and apparatus for calibrating a tiled display
US20020122044A1 (en) * 2000-10-23 2002-09-05 Sun Microsystems, Inc. Multi-spectral color correction

Family Cites Families (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE1112543B (en) * 1959-02-14 1961-08-10 Philips Nv Circuit arrangement for automatic, room-light-dependent control of brightness and contrast in a television receiver
GB958588A (en) * 1960-12-08 1964-05-21 Gen Electric Co Ltd Improvements in or relating to colour television receivers
DE1249325B (en) * 1960-12-30 1967-09-07 Radio Corporation Of America, New York, N. Y. (V. St. A.) Circuit arrangement: for room light-dependent control of the contrast and brightness in a television receiver
US3147341A (en) * 1961-04-24 1964-09-01 Gen Electric Automatic brightness-contrast control using photoresistive element to control brightness and agc voltages in response to ambinent light
US3165582A (en) * 1961-12-29 1965-01-12 Magnavox Co Automatic contrast and brilliance control system for television receivers
US3404226A (en) * 1965-03-25 1968-10-01 Gen Electric Automatic contrast and brightness control for television receiver utilizing a light dependent resistor
US3649755A (en) * 1970-06-01 1972-03-14 Bendix Corp Method and means for providing a lighted display having a constant contrast ratio
US4090216A (en) * 1976-05-26 1978-05-16 Gte Sylvania Incorporated Ambient light contrast and color control circuit
US4355334A (en) * 1981-05-29 1982-10-19 Zenith Radio Corporation Dimmer and dimmer override control for a display device
US4514727A (en) * 1982-06-28 1985-04-30 Trw Inc. Automatic brightness control apparatus
US4589022A (en) * 1983-11-28 1986-05-13 General Electric Company Brightness control system for CRT video display
JPS63177193A (en) * 1987-01-19 1988-07-21 株式会社日立製作所 Display device
FR2613572B1 (en) * 1987-04-03 1993-01-22 Thomson Csf LIGHT DATA VISUALIZATION SYSTEM WITH IMPROVED READABILITY
US4974073A (en) * 1988-01-14 1990-11-27 Metavision Inc. Seamless video display
GB8814157D0 (en) * 1988-06-15 1988-07-20 Crosfield Electronics Ltd Display control system
US5222203A (en) * 1989-01-20 1993-06-22 Daikin Industries, Ltd. Method and apparatus for displaying translucent surface
JP3409330B2 (en) * 1991-02-08 2003-05-26 ソニー株式会社 Adjustment device and adjustment method for projection display device
US5442484A (en) * 1992-01-06 1995-08-15 Mitsubishi Denki Kabushiki Kaisha Retro-focus type lens and projection-type display apparatus
US5270818A (en) * 1992-09-17 1993-12-14 Alliedsignal Inc. Arrangement for automatically controlling brightness of cockpit displays
DE19508623A1 (en) * 1995-03-10 1996-09-12 Sel Alcatel Ag Circuit arrangement for displaying and controlling ambient lighting conditions
US5818553A (en) * 1995-04-10 1998-10-06 Norand Corporation Contrast control for a backlit LCD
JPH1141615A (en) 1997-07-18 1999-02-12 Fujitsu Ltd Liquid crystal projection type display
DE19843902A1 (en) * 1997-09-26 1999-04-01 Denso Corp Picture information display system e.g. for use in car show rooms
US5854661A (en) * 1997-09-30 1998-12-29 Lucent Technologies Inc. System and method for subtracting reflection images from a display screen
US6040835A (en) * 1997-11-06 2000-03-21 Mitsubishi Electric Information Technology Center America, Inl. (Ita) System for depicting surfaces using volumetric distance maps
US6441820B2 (en) * 1998-01-23 2002-08-27 Pixar Animation Studios Pseudo area lights
GB2336057B (en) * 1998-04-02 2002-05-08 Discreet Logic Inc Producing image data in a virtual set
US6611249B1 (en) * 1998-07-22 2003-08-26 Silicon Graphics, Inc. System and method for providing a wide aspect ratio flat panel display monitor independent white-balance adjustment and gamma correction capabilities
US6559826B1 (en) * 1998-11-06 2003-05-06 Silicon Graphics, Inc. Method for modeling and updating a colorimetric reference profile for a flat panel display
US6867751B1 (en) * 1998-12-30 2005-03-15 Honeywell Inc. Methods and apparatus for adjusting the display characteristics of a display unit
US6452593B1 (en) * 1999-02-19 2002-09-17 International Business Machines Corporation Method and system for rendering a virtual three-dimensional graphical display
US6459818B1 (en) * 1999-03-01 2002-10-01 University Of Rochester System for recovery of degraded images
US6842175B1 (en) * 1999-04-22 2005-01-11 Fraunhofer Usa, Inc. Tools for interacting with virtual environments
KR100414083B1 (en) * 1999-12-18 2004-01-07 엘지전자 주식회사 Method for compensating image distortion and image displaying apparatus using the same
AU2001275308A1 (en) * 2000-06-06 2001-12-17 Frauenhofer Institut Fuer Graphische Datenverarbeitung The extended virtual table: an optical extension for table-like projection systems
GB0017008D0 (en) * 2000-07-12 2000-08-30 Street Graham S B Structured light source
US6639595B1 (en) * 2000-08-23 2003-10-28 Nintendo Co., Ltd. Achromatic lighting in a graphics system and method
US6850872B1 (en) * 2000-08-30 2005-02-01 Microsoft Corporation Facial image processing methods and systems
US6804406B1 (en) * 2000-08-30 2004-10-12 Honeywell International Inc. Electronic calibration for seamless tiled display using optical function generator
US6765573B2 (en) * 2000-10-26 2004-07-20 Square Enix Co., Ltd. Surface shading using stored texture map based on bidirectional reflectance distribution function
US20040135744A1 (en) * 2001-08-10 2004-07-15 Oliver Bimber Virtual showcases
US7133083B2 (en) * 2001-12-07 2006-11-07 University Of Kentucky Research Foundation Dynamic shadow removal from front projection displays
US7019713B2 (en) * 2002-10-30 2006-03-28 The University Of Chicago Methods and measurement engine for aligning multi-projector display systems
US7038727B2 (en) * 2002-10-30 2006-05-02 The University Of Chicago Method to smooth photometric variations across multi-projector displays

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6310650B1 (en) * 1998-09-23 2001-10-30 Honeywell International Inc. Method and apparatus for calibrating a tiled display
US20020122044A1 (en) * 2000-10-23 2002-09-05 Sun Microsystems, Inc. Multi-spectral color correction

Also Published As

Publication number Publication date
WO2005015490A2 (en) 2005-02-17
WO2005015490A8 (en) 2007-02-22
US20050134599A1 (en) 2005-06-23
US7663640B2 (en) 2010-02-16

Similar Documents

Publication Publication Date Title
WO2005015490A8 (en) Methods and systems for compensating an image projected onto a surface having spatially varying photometric properties
US11037522B2 (en) Method for radiometric display, corresponding system, apparatus and computer program product
Itoh et al. Semi-parametric color reproduction method for optical see-through head-mounted displays
TWI231715B (en) Image display device, image processing method, program, and storage medium
Langlotz et al. Real-time radiometric compensation for optical see-through head-mounted displays
US20090115915A1 (en) Camera Based Feedback Loop Calibration of a Projection Device
EP1942680A2 (en) Apparatus and method for ambient light adaptive color correction
WO2002019704A3 (en) Electronic calibration for seamless tiled display using optical function generator
US20130113975A1 (en) Projector Image Correction Method and System
TW200740200A (en) Image display apparatus and image distortion correction method of the same
KR101213205B1 (en) Apparatus and method for color reproduction
JP2006113541A5 (en)
WO2003003336A3 (en) Method and device for compensating burn-in effects on display panels
JP2002209229A (en) Image display system adaptive to environment, image processing method, program and information storage medium
AU2003232561A1 (en) System and method for electronic correction of optical anomalies
EP1349388A3 (en) Projection type image display system, information storage medium and image processing method
WO2019010917A1 (en) Method and system for color calibration of projection image
JP2002074349A5 (en)
US11593971B2 (en) Apparatus and methods for dynamic white point compensation to improve perceived color of synthetic content
US20150085162A1 (en) Perceptual radiometric compensation system adaptable to a projector-camera system
TW200617765A (en) Apparatus and method for image adjustment
KR101766119B1 (en) Controlling method for display on ice
JP2007322671A (en) Projection image correction system and correction information generation program
JP2009005097A (en) Device and method for adjusting color gamut
TWI520570B (en) Image processing method for stereoscopic images

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase