WO2004047426A3 - Reality-based light environment for digital imaging in motion pictures - Google Patents

Reality-based light environment for digital imaging in motion pictures Download PDF

Info

Publication number
WO2004047426A3
WO2004047426A3 PCT/US2003/036839 US0336839W WO2004047426A3 WO 2004047426 A3 WO2004047426 A3 WO 2004047426A3 US 0336839 W US0336839 W US 0336839W WO 2004047426 A3 WO2004047426 A3 WO 2004047426A3
Authority
WO
WIPO (PCT)
Prior art keywords
image data
location
image
lighting
panoramic
Prior art date
Application number
PCT/US2003/036839
Other languages
French (fr)
Other versions
WO2004047426A2 (en
Inventor
Haarm-Pieter John Gerri Duiker
Original Assignee
Esc Entertainment A California
Haarm-Pieter John Gerri Duiker
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Esc Entertainment A California, Haarm-Pieter John Gerri Duiker filed Critical Esc Entertainment A California
Priority to JP2004553886A priority Critical patent/JP4220470B2/en
Priority to AU2003298666A priority patent/AU2003298666A1/en
Priority to EP03796421A priority patent/EP1566052A4/en
Publication of WO2004047426A2 publication Critical patent/WO2004047426A2/en
Publication of WO2004047426A3 publication Critical patent/WO2004047426A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/80—2D [Two Dimensional] animation, e.g. using sprites
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/08—Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/61—Scene description

Abstract

Image-based lighting for use in rendering of digital objects is derived from image data collected from a real motion-picture set. The image data includes sets of correlated images at different exposure levels (302), each corresponding to a selected location. The image data is processed to define an extended dynamic range panoramic image (304) for each selected set location. The image data is color and intensity corrected based on a scaled reference object. At least key lights are modeled (306) for the set by processing a plurality of such panoramic images. Other lighting may be defined by interpolating from the panoramic images to mathematically define a location-specific set of fill lights. In the alternative, other set lighting may be modeled by projecting panoramic image data onto a dynamically sub-dividable light primitive derived from the set geometry. Any desired object may then rendered using the defined lights, and inserted into a corrected real image of the set at the desired location.
PCT/US2003/036839 2002-11-15 2003-11-17 Reality-based light environment for digital imaging in motion pictures WO2004047426A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2004553886A JP4220470B2 (en) 2002-11-15 2003-11-17 A reality-based lighting environment for digital imaging in cinema
AU2003298666A AU2003298666A1 (en) 2002-11-15 2003-11-17 Reality-based light environment for digital imaging in motion pictures
EP03796421A EP1566052A4 (en) 2002-11-15 2003-11-17 Reality-based light environment for digital imaging in motion pictures

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US42656002P 2002-11-15 2002-11-15
US60/426,560 2002-11-15

Publications (2)

Publication Number Publication Date
WO2004047426A2 WO2004047426A2 (en) 2004-06-03
WO2004047426A3 true WO2004047426A3 (en) 2004-07-15

Family

ID=32326376

Family Applications (3)

Application Number Title Priority Date Filing Date
PCT/US2003/036839 WO2004047426A2 (en) 2002-11-15 2003-11-17 Reality-based light environment for digital imaging in motion pictures
PCT/US2003/036720 WO2004047009A2 (en) 2002-11-15 2003-11-17 Method for digitally rendering skin or like materials
PCT/US2003/036710 WO2004047008A1 (en) 2002-11-15 2003-11-17 Reverse-rendering method for digital modeling

Family Applications After (2)

Application Number Title Priority Date Filing Date
PCT/US2003/036720 WO2004047009A2 (en) 2002-11-15 2003-11-17 Method for digitally rendering skin or like materials
PCT/US2003/036710 WO2004047008A1 (en) 2002-11-15 2003-11-17 Reverse-rendering method for digital modeling

Country Status (5)

Country Link
US (6) US6983082B2 (en)
EP (3) EP1566052A4 (en)
JP (3) JP4220470B2 (en)
AU (3) AU2003295582A1 (en)
WO (3) WO2004047426A2 (en)

Families Citing this family (152)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1074943A3 (en) * 1999-08-06 2004-03-24 Canon Kabushiki Kaisha Image processing method and apparatus
US7342489B1 (en) 2001-09-06 2008-03-11 Siemens Schweiz Ag Surveillance system control unit
US7239345B1 (en) * 2001-10-12 2007-07-03 Worldscape, Inc. Camera arrangements with backlighting detection and methods of using same
GB2393887B (en) * 2002-10-04 2005-10-26 Criterion Software Ltd Three-dimensional computer graphics
JP3962676B2 (en) * 2002-11-29 2007-08-22 キヤノン株式会社 Image processing method and apparatus
US7050078B2 (en) * 2002-12-19 2006-05-23 Accenture Global Services Gmbh Arbitrary object tracking augmented reality applications
US7714858B2 (en) * 2003-04-18 2010-05-11 Hewlett-Packard Development Company, L.P. Distributed rendering of interactive soft shadows
US7787692B2 (en) * 2003-09-25 2010-08-31 Fujifilm Corporation Image processing apparatus, image processing method, shape diagnostic apparatus, shape diagnostic method and program
FR2861857B1 (en) * 2003-10-29 2006-01-20 Snecma Moteurs DISPLACEMENT OF A VIRTUAL ARTICULATED OBJECT IN A VIRTUAL ENVIRONMENT BY AVOIDING INTERNAL COLLISIONS BETWEEN THE ARTICULATED ELEMENTS OF THE ARTICULATED OBJECT
FR2861858B1 (en) * 2003-10-29 2014-09-05 Snecma Moteurs MOVING A VIRTUAL ARTICULATED OBJECT INTO A VIRTUAL ENVIRONMENT BY AVOIDING COLLISIONS BETWEEN ARTICULATED OBJECT AND THE ENVIRONMENT
GB2410639A (en) * 2004-01-30 2005-08-03 Hewlett Packard Development Co Viewfinder alteration for panoramic imaging
JP4692956B2 (en) * 2004-11-22 2011-06-01 株式会社ソニー・コンピュータエンタテインメント Drawing processing apparatus and drawing processing method
KR100609145B1 (en) * 2004-12-20 2006-08-08 한국전자통신연구원 Rendering Apparatus and Method for real-time global illumination in real light environment
EP1686531B1 (en) * 2005-01-27 2018-04-25 QUALCOMM Incorporated A method, a software product and an electronic device for generating an image composition
US8902320B2 (en) 2005-01-31 2014-12-02 The Invention Science Fund I, Llc Shared image device synchronization or designation
US20060221197A1 (en) * 2005-03-30 2006-10-05 Jung Edward K Image transformation estimator of an imaging device
US20060170956A1 (en) 2005-01-31 2006-08-03 Jung Edward K Shared image devices
US9082456B2 (en) 2005-01-31 2015-07-14 The Invention Science Fund I Llc Shared image device designation
US8606383B2 (en) * 2005-01-31 2013-12-10 The Invention Science Fund I, Llc Audio sharing
US9124729B2 (en) 2005-01-31 2015-09-01 The Invention Science Fund I, Llc Shared image device synchronization or designation
US9910341B2 (en) 2005-01-31 2018-03-06 The Invention Science Fund I, Llc Shared image device designation
US9489717B2 (en) 2005-01-31 2016-11-08 Invention Science Fund I, Llc Shared image device
US8223845B1 (en) 2005-03-16 2012-07-17 Apple Inc. Multithread processing of video frames
US7710423B2 (en) * 2005-03-21 2010-05-04 Microsoft Corproation Automatic layout of items along an embedded one-manifold path
US7505883B2 (en) 2005-03-23 2009-03-17 Electronic Arts Inc. Computer simulation of body dynamics including a solver that solves in linear time for a set of constraints
KR101199498B1 (en) 2005-03-31 2012-11-09 삼성전자주식회사 Apparatus for encoding or generation of multi-view video by using a camera parameter, and a method thereof, and a recording medium having a program to implement thereof
US20060274070A1 (en) * 2005-04-19 2006-12-07 Herman Daniel L Techniques and workflows for computer graphics animation system
US8345252B2 (en) * 2005-04-25 2013-01-01 X-Rite, Inc. Method and system for enhanced formulation and visualization rendering
US9451200B2 (en) 2005-06-02 2016-09-20 Invention Science Fund I, Llc Storage access technique for captured data
US9001215B2 (en) 2005-06-02 2015-04-07 The Invention Science Fund I, Llc Estimating shared image device operational capabilities or resources
US9621749B2 (en) 2005-06-02 2017-04-11 Invention Science Fund I, Llc Capturing selected image objects
US9191611B2 (en) 2005-06-02 2015-11-17 Invention Science Fund I, Llc Conditional alteration of a saved image
US9093121B2 (en) 2006-02-28 2015-07-28 The Invention Science Fund I, Llc Data management of an audio data stream
US10003762B2 (en) 2005-04-26 2018-06-19 Invention Science Fund I, Llc Shared image devices
US9819490B2 (en) 2005-05-04 2017-11-14 Invention Science Fund I, Llc Regional proximity for shared image device(s)
US9076208B2 (en) * 2006-02-28 2015-07-07 The Invention Science Fund I, Llc Imagery processing
US8681225B2 (en) 2005-06-02 2014-03-25 Royce A. Levien Storage access technique for captured data
US9967424B2 (en) 2005-06-02 2018-05-08 Invention Science Fund I, Llc Data storage usage protocol
US9942511B2 (en) 2005-10-31 2018-04-10 Invention Science Fund I, Llc Preservation/degradation of video/audio aspects of a data stream
US8964054B2 (en) 2006-08-18 2015-02-24 The Invention Science Fund I, Llc Capturing selected image objects
US9167195B2 (en) 2005-10-31 2015-10-20 Invention Science Fund I, Llc Preservation/degradation of video/audio aspects of a data stream
EP1900216A2 (en) * 2005-05-12 2008-03-19 Tenebraex Corporation Improved methods of creating a virtual window
WO2006133228A2 (en) * 2005-06-06 2006-12-14 Electronic Arts Inc. Adaptive contact based skeleton for animation of characters in video games
US7573477B2 (en) * 2005-06-17 2009-08-11 Honda Motor Co., Ltd. System and method for activation-driven muscle deformations for existing character motion
US7403202B1 (en) * 2005-07-12 2008-07-22 Electronic Arts, Inc. Computer animation of simulated characters using combinations of motion-capture data and external force modelling or other physics models
US20070120980A1 (en) 2005-10-31 2007-05-31 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Preservation/degradation of video/audio aspects of a data stream
US20070273711A1 (en) * 2005-11-17 2007-11-29 Maffei Kenneth C 3D graphics system and method
CA2631893A1 (en) 2005-12-16 2007-06-21 Thomson Licensing Method, apparatus and system for providing reproducible digital imagery products from digitally captured images
US7589724B1 (en) 2006-02-15 2009-09-15 Adobe Systems, Incorporated Successive-convolution-compositing technique for rendering soft shadows
US7623137B1 (en) * 2006-02-15 2009-11-24 Adobe Systems, Incorporated Successive-convolution-compositing technique for rendering translucent surfaces
US7411688B1 (en) 2006-03-17 2008-08-12 Arius3D Inc. Method and system for laser intensity calibration in a three-dimensional multi-color laser scanning system
US20070242141A1 (en) * 2006-04-14 2007-10-18 Sony Corporation And Sony Electronics Inc. Adjustable neutral density filter system for dynamic range compression from scene to imaging sensor
US8633927B2 (en) 2006-07-25 2014-01-21 Nvidia Corporation Re-render acceleration of frame with lighting change
US8115774B2 (en) 2006-07-28 2012-02-14 Sony Computer Entertainment America Llc Application of selective regions of a normal map based on joint position in a three-dimensional model
US8446509B2 (en) * 2006-08-09 2013-05-21 Tenebraex Corporation Methods of creating a virtual window
GB0616685D0 (en) * 2006-08-23 2006-10-04 Warwick Warp Ltd Retrospective shading approximation from 2D and 3D imagery
US8739137B2 (en) 2006-10-19 2014-05-27 Purdue Research Foundation Automatic derivative method for a computer programming language
US8281299B2 (en) * 2006-11-10 2012-10-02 Purdue Research Foundation Map-closure: a general purpose mechanism for nonstandard interpretation
US8094182B2 (en) * 2006-11-16 2012-01-10 Imove, Inc. Distributed video sensor panoramic imaging system
CA2669001C (en) * 2006-11-20 2015-10-20 Thomson Licensing Method and system for modeling light
JP4808600B2 (en) * 2006-11-22 2011-11-02 デジタルファッション株式会社 Rendering program, rendering apparatus, and rendering method
JP4842242B2 (en) * 2006-12-02 2011-12-21 韓國電子通信研究院 Method and apparatus for real-time expression of skin wrinkles during character animation
US9767599B2 (en) * 2006-12-29 2017-09-19 X-Rite Inc. Surface appearance simulation
US20080178087A1 (en) * 2007-01-19 2008-07-24 Microsoft Corporation In-Scene Editing of Image Sequences
WO2008091198A1 (en) * 2007-01-24 2008-07-31 Swiftfoot Graphics Ab Method, display adapter and computer program product for improved graphics performance by using a replaceable culling program
KR100967701B1 (en) * 2007-02-26 2010-07-07 한국외국어대학교 연구산학협력단 Reconstructing three dimensional oil paintings
US20080320126A1 (en) * 2007-06-25 2008-12-25 Microsoft Corporation Environment sensing for interactive entertainment
US7929142B2 (en) * 2007-09-25 2011-04-19 Microsoft Corporation Photodiode-based bi-directional reflectance distribution function (BRDF) measurement
US20090079758A1 (en) * 2007-09-25 2009-03-26 Max-Planck-Gesellschaft Zur Forderung Per Wissenschaften E.V. Method and device for generating shadow maps
US8310481B2 (en) * 2007-10-12 2012-11-13 Edward Ernest Bailey Computer aided design method for enhancement of local refinement through T-splines
US8159490B2 (en) 2007-10-16 2012-04-17 Dreamworks Animation Llc Shading of translucent objects
US8791984B2 (en) * 2007-11-16 2014-07-29 Scallop Imaging, Llc Digital security camera
JP5551075B2 (en) * 2007-11-16 2014-07-16 テネブラックス コーポレイション System and method for generating a virtual window
US20090290033A1 (en) * 2007-11-16 2009-11-26 Tenebraex Corporation Systems and methods of creating a virtual window
KR100901270B1 (en) * 2007-12-15 2009-06-09 한국전자통신연구원 System and method for rendering surface materials
US20090172756A1 (en) * 2007-12-31 2009-07-02 Motorola, Inc. Lighting analysis and recommender system for video telephony
US8509569B2 (en) * 2008-02-11 2013-08-13 Apple Inc. Optimization of image processing using multiple processing units
US8243071B2 (en) * 2008-02-29 2012-08-14 Microsoft Corporation Modeling and rendering of heterogeneous translucent materials using the diffusion equation
US9098647B2 (en) 2008-03-10 2015-08-04 Apple Inc. Dynamic viewing of a three dimensional space
US8350850B2 (en) * 2008-03-31 2013-01-08 Microsoft Corporation Using photo collections for three dimensional modeling
IL190539A (en) * 2008-03-31 2015-01-29 Rafael Advanced Defense Sys Methods for transferring points of interest between images with non-parallel viewing directions
US7937245B2 (en) * 2008-04-02 2011-05-03 Dreamworks Animation Llc Rendering of subsurface scattering effects in translucent objects
AU2009201433B2 (en) * 2008-04-15 2013-11-21 Electronics And Telecommunications Research Institute Improved physics-based simulation
US8239822B2 (en) * 2008-04-18 2012-08-07 Microsoft Corp. Symbolic forward and reverse differentiation
US8238651B2 (en) * 2008-06-05 2012-08-07 Microsoft Corporation Image-guided abstraction of building facades
US9619917B2 (en) * 2008-10-03 2017-04-11 Apple Inc. Depth of field for a camera in a media-editing application
US8791951B2 (en) * 2008-12-01 2014-07-29 Electronics And Telecommunications Research Institute Image synthesis apparatus and method supporting measured materials properties
US9098926B2 (en) 2009-02-06 2015-08-04 The Hong Kong University Of Science And Technology Generating three-dimensional façade models from images
WO2010088840A1 (en) 2009-02-06 2010-08-12 The Hong Kong University Of Science And Technology Generating three-dimensional models from images
US9098945B2 (en) * 2009-05-01 2015-08-04 Microsoft Technology Licensing, Llc Modeling anisotropic surface reflectance with microfacet synthesis
US8369564B2 (en) * 2009-06-30 2013-02-05 Apple Inc. Automatic generation and use of region of interest and domain of definition functions
WO2011037964A1 (en) * 2009-09-22 2011-03-31 Tenebraex Corporation Systems and methods for correcting images in a multi-sensor system
US8860731B1 (en) * 2009-12-21 2014-10-14 Lucasfilm Entertainment Company Ltd. Refining animation
CN101872491B (en) * 2010-05-21 2011-12-28 清华大学 Free view angle relighting method and system based on photometric stereo
KR101633377B1 (en) * 2010-06-18 2016-07-08 삼성전자주식회사 Method and Apparatus for Processing Frames Obtained by Multi-Exposure
US8928659B2 (en) * 2010-06-23 2015-01-06 Microsoft Corporation Telepresence systems with viewer perspective adjustment
CN103155004B (en) * 2010-09-01 2016-05-18 玛斯柯有限公司 Demonstrate equipment, the system and method for illumination scheme by image rendering
KR101194364B1 (en) * 2011-07-14 2012-10-25 광주과학기술원 Appearance material design and manufacturing method and system
DE102011079380A1 (en) * 2011-07-19 2013-01-24 Siemens Aktiengesellschaft Method, computer program and system for computer-aided evaluation of image data sets
US8913065B2 (en) * 2011-08-05 2014-12-16 Jeffrey McCartney Computer system for animating 3D models using offset transforms
JP6049327B2 (en) 2011-08-11 2016-12-21 キヤノン株式会社 Image processing apparatus and control method thereof
US9250966B2 (en) * 2011-08-11 2016-02-02 Otoy, Inc. Crowd-sourced video rendering system
JP2013127774A (en) * 2011-11-16 2013-06-27 Canon Inc Image processing device, image processing method, and program
US9183654B2 (en) * 2012-03-02 2015-11-10 Sean Geggie Live editing and integrated control of image-based lighting of 3D models
CN103327221B (en) * 2012-03-20 2016-12-14 华晶科技股份有限公司 Camera head and image prebrowsing system thereof and image method for previewing
TWI520604B (en) * 2012-03-20 2016-02-01 華晶科技股份有限公司 Image pickup device and image preview system and image preview method thereof
GB2500405B (en) 2012-03-20 2014-04-16 Lightmap Ltd Point and click lighting for image based lighting surfaces
US8416240B1 (en) * 2012-04-02 2013-04-09 Google Inc. Determining 3D model information from stored images
CN104106098B (en) * 2012-08-03 2019-05-03 梦工厂动画公司 Constraint assessment in directed acyclic graph
US9589000B2 (en) 2012-08-30 2017-03-07 Atheer, Inc. Method and apparatus for content association and history tracking in virtual and augmented reality
US20140078144A1 (en) * 2012-09-14 2014-03-20 Squee, Inc. Systems and methods for avatar creation
US9947132B2 (en) * 2013-03-15 2018-04-17 Nvidia Corporation Material representation data structure and method of representing a material for digital image synthesis
EP2984521A4 (en) 2013-04-11 2016-10-19 De Roer Carlo Van System and method for producing virtual light source movement in motion pictures and other media
JPWO2015045501A1 (en) * 2013-09-27 2017-03-09 日立オートモティブシステムズ株式会社 External recognition device
AU2014353374A1 (en) 2013-11-22 2016-06-16 Sonify Biosciences, Llc Skin cancer treatment using low intensity ultrasound
US9509905B2 (en) * 2013-12-17 2016-11-29 Google Inc. Extraction and representation of three-dimensional (3D) and bidirectional reflectance distribution function (BRDF) parameters from lighted image sequences
US9600904B2 (en) 2013-12-30 2017-03-21 Samsung Electronics Co., Ltd. Illuminating a virtual environment with camera light data
WO2015134378A2 (en) * 2014-03-03 2015-09-11 LiveLocation, Inc. Automatic control of location-registered lighting according to a live reference lighting environment
JP6410451B2 (en) * 2014-03-31 2018-10-24 キヤノン株式会社 Information processing apparatus, measurement system, information processing method, and program.
US10169909B2 (en) * 2014-08-07 2019-01-01 Pixar Generating a volumetric projection for an object
US9767620B2 (en) 2014-11-26 2017-09-19 Restoration Robotics, Inc. Gesture-based editing of 3D models for hair transplantation applications
US10133830B2 (en) * 2015-01-30 2018-11-20 Hover Inc. Scaling in a multi-dimensional building model
FR3034233B1 (en) * 2015-03-25 2018-08-10 Morpho METHOD OF CORRECTING AN IMAGE OF AT LEAST ONE REMOTELY PRESENTED OBJECT IN FRONT OF AN IMAGER AND LIGHTING BY A LIGHTING SYSTEM AND SHOOTING SYSTEM FOR IMPLEMENTING SAID METHOD
US11432046B1 (en) 2015-06-12 2022-08-30 Veepio Holdings, Llc Interactive, personalized objects in content creator's media with e-commerce link associated therewith
WO2017075452A1 (en) 2015-10-29 2017-05-04 True Image Interactive, Inc Systems and methods for machine-generated avatars
JP6792335B2 (en) 2016-01-19 2020-11-25 キヤノン株式会社 Image processing equipment and its method
WO2017217296A1 (en) * 2016-06-16 2017-12-21 株式会社ソニー・インタラクティブエンタテインメント Image processing device
US10489968B1 (en) 2016-09-14 2019-11-26 Musco Corporation Apparatus, method, and system for three-dimensional (3D) visualization of light for evaluation of playability, glare, and gaps
US10594995B2 (en) * 2016-12-13 2020-03-17 Buf Canada Inc. Image capture and display on a dome for chroma keying
EP3336801A1 (en) * 2016-12-19 2018-06-20 Thomson Licensing Method and apparatus for constructing lighting environment representations of 3d scenes
EP3351899B1 (en) * 2017-01-24 2020-06-17 Leica Geosystems AG Method and device for inpainting of colourised three-dimensional point clouds
JP6859763B2 (en) * 2017-03-10 2021-04-14 株式会社リコー Program, information processing device
US11057643B2 (en) * 2017-03-13 2021-07-06 Mediatek Inc. Method and apparatus for generating and encoding projection-based frame that includes at least one padding region and at least one projection face packed in 360-degree virtual reality projection layout
US11004173B2 (en) 2017-03-13 2021-05-11 Mediatek Inc. Method for processing projection-based frame that includes at least one projection face packed in 360-degree virtual reality projection layout
DE112018000660T5 (en) 2017-04-05 2019-10-24 Mediatek Inc. A method and apparatus for processing a projection-based frame having at least one projection surface generated using a non-uniform mapping
US10181199B2 (en) 2017-05-08 2019-01-15 Adobe Systems Incorporated Material capture using imaging
KR102149180B1 (en) * 2017-07-07 2020-08-28 한국전자통신연구원 Method for synthesizing virtual content for augmented reality and apparatus using the same
DE112018002432T5 (en) 2017-08-18 2020-01-23 Mediatek Inc. Method and device for reducing artifacts in a projection-based frame
KR102107706B1 (en) * 2017-10-31 2020-05-07 에스케이텔레콤 주식회사 Method and apparatus for processing image
CN109147023A (en) * 2018-07-27 2019-01-04 北京微播视界科技有限公司 Three-dimensional special efficacy generation method, device and electronic equipment based on face
JP7328651B2 (en) * 2018-08-01 2023-08-17 東芝ライテック株式会社 Generation device, generation method and generation program
CN109587557B (en) * 2019-01-11 2022-03-08 京东方科技集团股份有限公司 Data transmission method and device and display device
US10986308B2 (en) 2019-03-20 2021-04-20 Adobe Inc. Intelligent video reframing
US10949646B2 (en) 2019-04-30 2021-03-16 Samsung Electronics Co., Ltd. Performing an iterative bundle adjustment for an imaging device
EP3764249A1 (en) * 2019-07-08 2021-01-13 Dmitri Goloubentsev A streaming compiler for automatic adjoint differentiation
GB2586060B (en) * 2019-08-01 2022-09-21 Sony Interactive Entertainment Inc Surface characterisation apparatus and system
CN110930483B (en) * 2019-11-20 2020-11-24 腾讯科技（深圳）有限公司 Role control method, model training method and related device
US11461968B2 (en) * 2020-01-30 2022-10-04 Unity Technologies Sf Method of inferring microdetail on skin animation
US11620765B2 (en) * 2020-07-02 2023-04-04 Unity Technologies Sf Automatic detection of a calibration object for modifying image parameters
CN111815768B (en) * 2020-09-14 2020-12-18 腾讯科技（深圳）有限公司 Three-dimensional face reconstruction method and device
CN113034662B (en) * 2021-03-29 2023-03-31 网易（杭州）网络有限公司 Virtual scene rendering method and device, storage medium and electronic equipment
KR102555166B1 (en) * 2022-10-04 2023-07-12 인하대학교 산학협력단 Method and System for Facial Texture Synthesis with Skin Microelement Structure

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6044180A (en) * 1990-04-20 2000-03-28 Nec Corporation Method and apparatus for rapid scanning of color images
US6124864A (en) * 1997-04-07 2000-09-26 Synapix, Inc. Adaptive modeling and segmentation of visual image streams
US6148113A (en) * 1998-02-03 2000-11-14 Micrografx, Inc. System for stimulating the depth of field of an image in two dimensional space and method of operation
US6160907A (en) * 1997-04-07 2000-12-12 Synapix, Inc. Iterative three-dimensional process for creating finished media content
US6166744A (en) * 1997-11-26 2000-12-26 Pathfinder Systems, Inc. System for combining virtual images with real-world scenes
US20020186314A1 (en) * 2001-06-08 2002-12-12 University Of Southern California Realistic scene illumination reproduction
US20030012448A1 (en) * 2001-04-30 2003-01-16 Ronny Kimmel System and method for image enhancement, dynamic range compensation and illumination correction
US6519360B1 (en) * 1997-09-17 2003-02-11 Minolta Co., Ltd. Image processing apparatus for comparing images based on color feature information and computer program product in a memory
US6538396B1 (en) * 2001-09-24 2003-03-25 Ultimatte Corporation Automatic foreground lighting effects in a composited scene
US6552731B1 (en) * 1999-04-16 2003-04-22 Avid Technology, Inc. Multi-tone representation of a digital image on a digital nonlinear editing system
US6564108B1 (en) * 2000-06-07 2003-05-13 The Delfin Project, Inc. Method and system of auxiliary illumination for enhancing a scene during a multimedia presentation
US20030103057A1 (en) * 2001-12-03 2003-06-05 Eric Graves Method and apparatus for color correction
US6628298B1 (en) * 1998-07-17 2003-09-30 The Regents Of The University Of California Apparatus and method for rendering synthetic objects into real scenes using measurements of scene illumination
US6628830B1 (en) * 1998-06-24 2003-09-30 Canon Kabushiki Kaisha Image processing method and apparatus and storage medium
US20030202120A1 (en) * 2002-04-05 2003-10-30 Mack Newton Eliot Virtual lighting system
US6657637B1 (en) * 1998-07-30 2003-12-02 Matsushita Electric Industrial Co., Ltd. Moving image combining apparatus combining computer graphic image and at least one video sequence composed of a plurality of video frames

Family Cites Families (78)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4645459A (en) * 1982-07-30 1987-02-24 Honeywell Inc. Computer generated synthesized imagery
CA1316591C (en) 1987-10-20 1993-04-20 Kazuhiro Hishinuma Method and apparatus for radiation image processing and x-ray image processing
JPH0743765B2 (en) 1987-10-20 1995-05-15 富士写真フイルム株式会社 Radiation image processing method and apparatus
US5586224A (en) * 1990-12-25 1996-12-17 Shukyohojin, Kongo Zen Sohonzan Shorinji Robot or numerical control programming method
US5625577A (en) * 1990-12-25 1997-04-29 Shukyohojin, Kongo Zen Sohonzan Shorinji Computer-implemented motion analysis method using dynamics
US5623428A (en) * 1990-12-25 1997-04-22 Shukyohoji, Kongo Zen Sohozan Shoriji Method for developing computer animation
WO1993025355A1 (en) * 1992-06-05 1993-12-23 Fujitsu Limited Simulation method for manipulator and apparatus therefor, simulation and control method for manipulator and apparatus therefor, and control method for manipulator and apparatus therefor
US5739820A (en) * 1992-11-19 1998-04-14 Apple Computer Inc. Method and apparatus for specular reflection shading of computer graphic images
US5499306A (en) * 1993-03-08 1996-03-12 Nippondenso Co., Ltd. Position-and-attitude recognition method and apparatus by use of image pickup means
US5490240A (en) 1993-07-09 1996-02-06 Silicon Graphics, Inc. System and method of generating interactive computer graphic images incorporating three dimensional textures
US5403238A (en) * 1993-08-19 1995-04-04 The Walt Disney Company Amusement park attraction
JPH0773339A (en) * 1993-09-03 1995-03-17 Sharp Corp Light source luminance calculator
US5546475A (en) * 1994-04-29 1996-08-13 International Business Machines Corporation Produce recognition system
US5600763A (en) * 1994-07-21 1997-02-04 Apple Computer, Inc. Error-bounded antialiased rendering of complex scenes
CA2118201C (en) * 1994-10-14 2003-02-04 Patrick M. Hayden Photon windowing kernel
JP3554616B2 (en) * 1994-12-13 2004-08-18 富士通株式会社 Drawing method and apparatus using radiosity method
GB9501832D0 (en) 1995-01-31 1995-03-22 Videologic Ltd Texturing and shading of 3-d images
IL113496A (en) * 1995-04-25 1999-09-22 Cognitens Ltd Apparatus and method for recreating and manipulating a 3d object based on a 2d projection thereof
US5982389A (en) * 1996-06-17 1999-11-09 Microsoft Corporation Generating optimized motion transitions for computer animated objects
US5966134A (en) * 1996-06-28 1999-10-12 Softimage Simulating cel animation and shading
EP0816986B1 (en) * 1996-07-03 2006-09-06 Hitachi, Ltd. System for recognizing motions
GB9616262D0 (en) 1996-08-02 1996-09-11 Philips Electronics Nv Post-processing generation of focus/defocus effects for computer graphics images
US5748792A (en) * 1996-08-13 1998-05-05 Polaroid Corporation Large kernel filtering using a fixed-size block processor
CA2213884C (en) * 1996-08-21 2001-05-22 Nippon Telegraph And Telephone Corporation Method for generating animations of a multi-articulated structure, recording medium having recorded thereon the same and animation generating apparatus using the same
JP3750830B2 (en) * 1996-08-30 2006-03-01 ソニー株式会社 Color correction apparatus in imaging apparatus
US6246420B1 (en) * 1996-10-11 2001-06-12 Matsushita Electric Industrial Co., Ltd. Movement data connecting method and apparatus therefor
US6078332A (en) 1997-01-28 2000-06-20 Silicon Graphics, Inc. Real-time lighting method using 3D texture mapping
US6052124A (en) * 1997-02-03 2000-04-18 Yissum Research Development Company System and method for directly estimating three-dimensional structure of objects in a scene and camera motion from three two-dimensional views of the scene
US5894309A (en) * 1997-02-27 1999-04-13 Mitsubishi Electric Information Technology Center America, Inc. System for modifying lighting in photographs
US6310644B1 (en) * 1997-03-26 2001-10-30 3Dm Devices Inc. Camera theodolite system
US6184899B1 (en) * 1997-03-31 2001-02-06 Treyarch Invention, L.L.C. Articulated figure animation using virtual actuators to simulate solutions for differential equations to display more realistic movements
US6057859A (en) * 1997-03-31 2000-05-02 Katrix, Inc. Limb coordination system for interactive computer animation of articulated characters with blended motion data
US6088042A (en) * 1997-03-31 2000-07-11 Katrix, Inc. Interactive motion data animation system
US6097394A (en) * 1997-04-28 2000-08-01 Board Of Trustees, Leland Stanford, Jr. University Method and system for light field rendering
JPH11175762A (en) * 1997-12-08 1999-07-02 Katsushi Ikeuchi Light environment measuring instrument and device and method for shading virtual image using same
JP3688879B2 (en) * 1998-01-30 2005-08-31 株式会社東芝 Image recognition apparatus, image recognition method, and recording medium therefor
US6272231B1 (en) * 1998-11-06 2001-08-07 Eyematic Interfaces, Inc. Wavelet-based facial motion capture for avatar animation
US5974168A (en) * 1998-04-16 1999-10-26 International Business Machines Corporation Acquiring bump maps from curved objects
US6333749B1 (en) * 1998-04-17 2001-12-25 Adobe Systems, Inc. Method and apparatus for image assisted modeling of three-dimensional scenes
US6137491A (en) * 1998-06-05 2000-10-24 Microsoft Corporation Method and apparatus for reconstructing geometry using geometrically constrained structure from motion with points on planes
US6271855B1 (en) * 1998-06-18 2001-08-07 Microsoft Corporation Interactive construction of 3D models from panoramic images employing hard and soft constraint characterization and decomposing techniques
US6373496B1 (en) 1998-08-12 2002-04-16 S3 Graphics Co., Ltd. Apparatus and method for texture mapping
US6342887B1 (en) * 1998-11-18 2002-01-29 Earl Robert Munroe Method and apparatus for reproducing lighting effects in computer animated objects
US6278460B1 (en) * 1998-12-15 2001-08-21 Point Cloud, Inc. Creating a three-dimensional model from two-dimensional images
CA2259882A1 (en) * 1999-01-22 2000-07-22 I.S.G. Technologies, Inc. Interactive sculpting for volumetric exploration and feature extraction
US6313842B1 (en) * 1999-03-03 2001-11-06 Discreet Logic Inc. Generating image data
US6496597B1 (en) 1999-03-03 2002-12-17 Autodesk Canada Inc. Generating image data
US6362822B1 (en) * 1999-03-12 2002-03-26 Terminal Reality, Inc. Lighting and shadowing methods and arrangements for use in computer graphic simulations
US6400848B1 (en) * 1999-03-30 2002-06-04 Eastman Kodak Company Method for modifying the perspective of a digital image
US6483514B1 (en) * 1999-04-15 2002-11-19 Pixar Animation Studios Motion blurring implicit surfaces
JP4001435B2 (en) * 1999-04-19 2007-10-31 株式会社バンダイナムコゲームス Game device, image data creation tool, and information storage medium
US6297834B1 (en) 1999-06-10 2001-10-02 Hewlett-Packard Company Direction-dependent texture maps in a graphics system
US6571024B1 (en) * 1999-06-18 2003-05-27 Sarnoff Corporation Method and apparatus for multi-view three dimensional estimation
US6504538B1 (en) 1999-07-01 2003-01-07 Microsoft Corporation Method and system for generating light values for a set of vertices
JP3486575B2 (en) * 1999-08-31 2004-01-13 キヤノン株式会社 Mixed reality presentation apparatus and method, and storage medium
US6373487B1 (en) * 1999-09-17 2002-04-16 Hewlett-Packard Company Methods and apparatus for constructing a 3D model of a scene from calibrated images of the scene
FR2799022B1 (en) * 1999-09-29 2002-02-01 Oreal MAKEUP ASSISTANCE DEVICE AND ASSEMBLY CONSISTING OF SUCH A DEVICE AND A DEVICE FOR DELIVERING A PRODUCT HAVING A PREDETERMINED BRDF, SELECTED BY THE MAKEUP ASSISTANCE DEVICE
US6694064B1 (en) * 1999-11-19 2004-02-17 Positive Systems, Inc. Digital aerial image mosaic method and apparatus
US20020122589A1 (en) * 1999-11-29 2002-09-05 Donald M. Reiman Constructing profiles to compensate for non-linearities in image capture
AU1767700A (en) * 1999-12-23 2001-07-09 Intel Architecture Development Shanghai Co., Ltd. Methods of hierarchical static scene simplification and polygon budgeting for 3dmodels
US6515674B1 (en) 2000-03-17 2003-02-04 Hewlett-Packard Company Apparatus for and of rendering 3d objects with parametric texture maps
US6750866B1 (en) * 2000-04-21 2004-06-15 Realistic Dynamics, Inc. Method and system for dynamically filtering the motion of articulated bodies
US6750873B1 (en) * 2000-06-27 2004-06-15 International Business Machines Corporation High quality texture reconstruction from multiple scans
AU2001292559A1 (en) * 2000-08-24 2002-03-04 Immersive Technologies Llc Computerized image system
JP2002152719A (en) * 2000-08-29 2002-05-24 Usc Corp Monitor method and monitor device utilizing curved surface image
US6765573B2 (en) 2000-10-26 2004-07-20 Square Enix Co., Ltd. Surface shading using stored texture map based on bidirectional reflectance distribution function
US6961640B2 (en) * 2000-11-17 2005-11-01 Sony Corporation Motion control for a legged robot
JP3406965B2 (en) * 2000-11-24 2003-05-19 キヤノン株式会社 Mixed reality presentation device and control method thereof
JP3572025B2 (en) * 2001-03-07 2004-09-29 キヤノン株式会社 Image reproducing apparatus, image processing apparatus and their methods
US6639594B2 (en) * 2001-06-03 2003-10-28 Microsoft Corporation View-dependent image synthesis
US7106325B2 (en) * 2001-08-03 2006-09-12 Hewlett-Packard Development Company, L.P. System and method for rendering digital images having surface reflectance properties
US6961058B2 (en) * 2001-08-10 2005-11-01 Microsoft Corporation Macrostructure modeling with microstructure reflectance slices
JP4443083B2 (en) 2001-10-09 2010-03-31 株式会社バンダイナムコゲームス Image generation system and information storage medium
US7221809B2 (en) * 2001-12-17 2007-05-22 Genex Technologies, Inc. Face recognition system and method
US7009608B2 (en) * 2002-06-06 2006-03-07 Nvidia Corporation System and method of using multiple representations per object in computer graphics
US7075534B2 (en) * 2002-06-21 2006-07-11 Forrester Hardenbergh Cole Method and system for automatically generating factored approximations for arbitrary bidirectional reflectance distribution functions
KR100483806B1 (en) * 2002-07-18 2005-04-20 한국과학기술원 Motion Reconstruction Method from Inter-Frame Feature Correspondences of a Single Video Stream Using a Motion Library
JP3972784B2 (en) * 2002-09-30 2007-09-05 ソニー株式会社 Image processing apparatus and method

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6044180A (en) * 1990-04-20 2000-03-28 Nec Corporation Method and apparatus for rapid scanning of color images
US6124864A (en) * 1997-04-07 2000-09-26 Synapix, Inc. Adaptive modeling and segmentation of visual image streams
US6160907A (en) * 1997-04-07 2000-12-12 Synapix, Inc. Iterative three-dimensional process for creating finished media content
US6519360B1 (en) * 1997-09-17 2003-02-11 Minolta Co., Ltd. Image processing apparatus for comparing images based on color feature information and computer program product in a memory
US6166744A (en) * 1997-11-26 2000-12-26 Pathfinder Systems, Inc. System for combining virtual images with real-world scenes
US6148113A (en) * 1998-02-03 2000-11-14 Micrografx, Inc. System for stimulating the depth of field of an image in two dimensional space and method of operation
US6628830B1 (en) * 1998-06-24 2003-09-30 Canon Kabushiki Kaisha Image processing method and apparatus and storage medium
US6628298B1 (en) * 1998-07-17 2003-09-30 The Regents Of The University Of California Apparatus and method for rendering synthetic objects into real scenes using measurements of scene illumination
US6657637B1 (en) * 1998-07-30 2003-12-02 Matsushita Electric Industrial Co., Ltd. Moving image combining apparatus combining computer graphic image and at least one video sequence composed of a plurality of video frames
US6552731B1 (en) * 1999-04-16 2003-04-22 Avid Technology, Inc. Multi-tone representation of a digital image on a digital nonlinear editing system
US6564108B1 (en) * 2000-06-07 2003-05-13 The Delfin Project, Inc. Method and system of auxiliary illumination for enhancing a scene during a multimedia presentation
US20030012448A1 (en) * 2001-04-30 2003-01-16 Ronny Kimmel System and method for image enhancement, dynamic range compensation and illumination correction
US20020186314A1 (en) * 2001-06-08 2002-12-12 University Of Southern California Realistic scene illumination reproduction
US6538396B1 (en) * 2001-09-24 2003-03-25 Ultimatte Corporation Automatic foreground lighting effects in a composited scene
US20030103057A1 (en) * 2001-12-03 2003-06-05 Eric Graves Method and apparatus for color correction
US20030202120A1 (en) * 2002-04-05 2003-10-30 Mack Newton Eliot Virtual lighting system

Also Published As

Publication number Publication date
EP1565872A1 (en) 2005-08-24
US20090174713A1 (en) 2009-07-09
WO2004047009A3 (en) 2004-07-08
EP1566052A4 (en) 2007-02-07
US20040150641A1 (en) 2004-08-05
US6983082B2 (en) 2006-01-03
EP1573653B1 (en) 2013-07-10
AU2003298666A1 (en) 2004-06-15
US7079137B2 (en) 2006-07-18
AU2003295586A1 (en) 2004-06-15
JP2006507585A (en) 2006-03-02
JP4220470B2 (en) 2009-02-04
AU2003295582A1 (en) 2004-06-15
AU2003295586B2 (en) 2009-05-07
WO2004047008A1 (en) 2004-06-03
EP1565872A4 (en) 2007-03-07
JP2006506742A (en) 2006-02-23
US6990230B2 (en) 2006-01-24
US7536047B2 (en) 2009-05-19
US20040150642A1 (en) 2004-08-05
EP1573653A2 (en) 2005-09-14
WO2004047009A2 (en) 2004-06-03
WO2004047426A2 (en) 2004-06-03
US20040150643A1 (en) 2004-08-05
JP2006506745A (en) 2006-02-23
EP1573653A4 (en) 2007-03-14
EP1566052A2 (en) 2005-08-24
US20040146197A1 (en) 2004-07-29
US8515157B2 (en) 2013-08-20
US20040169656A1 (en) 2004-09-02
JP4276178B2 (en) 2009-06-10

Similar Documents

Publication Publication Date Title
WO2004047426A3 (en) Reality-based light environment for digital imaging in motion pictures
US7724952B2 (en) Object matting using flash and no-flash images
EP1422660A3 (en) Method and system for generating images used in extended range panorama composition
US11405539B2 (en) Background replacement system and methods
EP1349382A3 (en) Method and apparatus for processing image information
IES20060558A2 (en) Image blurring
WO2002069619A3 (en) Method and apparatus for processing photographic images
JP2016020891A (en) Shape measurement system and imaging device
EP1528793A3 (en) Image processing apparatus, image-taking system and image processing method
US20180332239A1 (en) Background replacement utilizing infrared light and visible light
JP4190736B2 (en) Improved contrast mapping method for digital images
KR102483680B1 (en) Method and device for processing ambient image
JP6575999B2 (en) Lighting information acquisition device, lighting restoration device, and programs thereof
JP6292968B2 (en) Pseudo HDR image estimation apparatus and method
DE102007041719B4 (en) Method for creating augmented reality in a room
WO2013190645A1 (en) Automatic image compositing device
JP4359662B2 (en) Color image exposure compensation method
EP3143598A1 (en) Method of providing a digitally represented visual instruction from a specialist to a user in need of said visual instruction, and a system therefor
Graham et al. Global nonlinear compression of natural luminances in painted art
CN112866507A (en) Intelligent panoramic video synthesis method and system, electronic device and medium
US20160147132A1 (en) Environmental lighting system and method
JP6770442B2 (en) Image processing device and its program
KR100382366B1 (en) Apparatuses and methods for estimating illumination radiance ratio and performing Augmented Reality using the estimated illumination radiance radio
WO2023026543A1 (en) Information processing device, information processing method, and program
JP2009219140A (en) Exposure evaluation method for color image

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2003298666

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 2004553886

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2003796421

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2003796421

Country of ref document: EP