CA2478671A1 - Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data - Google Patents

Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data Download PDF

Info

Publication number
CA2478671A1
CA2478671A1 CA002478671A CA2478671A CA2478671A1 CA 2478671 A1 CA2478671 A1 CA 2478671A1 CA 002478671 A CA002478671 A CA 002478671A CA 2478671 A CA2478671 A CA 2478671A CA 2478671 A1 CA2478671 A1 CA 2478671A1
Authority
CA
Canada
Prior art keywords
render
image
processing
temporal
image data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002478671A
Other languages
French (fr)
Other versions
CA2478671C (en
Inventor
Samuel Zhou
Ping Ye
Paul Judkins
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Imax Corp
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2478671A1 publication Critical patent/CA2478671A1/en
Application granted granted Critical
Publication of CA2478671C publication Critical patent/CA2478671C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0135Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
    • H04N7/014Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes involving the use of motion vectors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0112Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards corresponding to a cinematograph film standard
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/14Picture signal circuitry for video frequency region
    • H04N5/21Circuitry for suppressing or minimising disturbance, e.g. moiré or halo

Abstract

A process and methods of digital enhancement of motion pictures and other moving image sequences for the purpose of being exhibited in an alternative display format including a large format cinema are disclosed. The invention efficiently enhances image resolution and quality through a temporal filtering process and achieves high performance using automated or interactive statistical quality evaluation methods. A system specially designed for efficient temporal computing with a parallel and distributed computing configuration equipped with a variety of optimization schemes is also disclosed. The performance of the process and the system is optimized through an intelligent controller and is scalable to support any throughput requirements demanded for concurrent motion picture releases in the original format as well as in any alternative format.

Claims (40)

1. A method for digitally re-mastering an image sequence with enhanced image resolution and quality, comprising:
converting the image sequence to a digital format that comprises original image data;
processing the original image data using temporal processing to produce enhanced image data having enhanced resolution and quality.
2. The method of claim 1 further comprising converting the enhanced image data to an alternative format.
3. The method of claim 1 further comprising reviewing the image sequence for appropriate resolution and quality.
4. The method of claim 1 wherein the image sequence is a motion picture originated in a 35mm film format, and wherein converting the image sequence to a digital format comprises digitizing the film using a film scanner.
5. The method of claim 1 wherein the image sequence is a motion picture originated in a digital format, and wherein converting the image sequence to a digital format comprises data conversion from the original digital format.
6. The method of claim 1 wherein the image sequence is in any image sequence format containing images captured using a device with an optical or electronic sensor.
7. The method of claim 2 wherein the alternative format is a film format with enhanced resolution and quality, and wherein converting the enhanced image data to an alternative format comprises film recording using a film recorder.
8. The method of claim 2 wherein the alternative format is a digital display format with enhanced resolution and quality, and wherein converting the enhanced image data to an alternative format comprises data conversion to digital display format.
9. The method of claim 2 wherein the alternative format is a concurrent release of an original motion picture with enhanced resolution and quality.
10. The method of claim 1 wherein processing the original image data using temporal processing comprises a pre-processing process, a render process, a verification process, and a post-processing process.
11. The method of claim 10 wherein the pre-processing process comprises:
generating proxy image data;
receiving pre-processing decisions for the original image data on shot separation, re-framing, color correction, artifact identification and scene classification;
and using image processing tools based on the pre-processing decisions to prepare the original image data for the render process.
12. The method of claim 11 wherein the scene classification is performed by an automated algorithm based on scene analysis.
13. The method of Claim 11 wherein the artifact identification and artifact removal is performed by an automated algorithm in which artifacts are identified by their unique characteristics both from a current frame and from neighboring frames and removed by predicted pixel values calculated based on inter-frame motion estimates or infra-frame interpolation.
14. The method of claim 11 wherein the artifact identification and artifact removal is performed by a semi-automated algorithm for interactively locating artifacts and automated removal using temporal processing.
15. The method of claim 10 wherein render process comprises:
receiving original image data separated into shots having image shot data, wherein each shot is a render job;
predicting a render parameter set for each render job;
distributing render jobs among multiple computing render clients;
processing the render jobs to produce render results;
assembling the distributed render results;

checking the integrity of the assembled render results;
evaluating temporal processing render quality of the assembled render results;
and modifying the render parameters for improving the render results and re-processing if necessary.
16. The method of claim 15 wherein predicting the render parameter set for a shot comprises:
locating key frames;
computing initial motion estimation settings;
computing motion estimates by using the initial motion estimation settings and applying motion estimation algorithms to the key frames; and computing statistical temporal measures based on the computed motion estimates to generate the render parameter set.
17. The method of claim 16 wherein the statistical temporal measures include TSNR, Motion and FMD.
18. The method of claim 17 wherein the render parameter set is produced by generating a set of matching threshold values corresponding to a given FMD and further modified based on TSNR and Motion.
19. The method of claim 15 wherein processing the render jobs comprises:
temporal filtering;
image resizing; and image sharpening.
20. The method of claim 19 wherein processing the render jobs further comprises:
lighting change compensation;
noise equalization;
computing statistical quality indicators; and proxy generation.
21. The method of claim 15 wherein processing the render jobs comprises a temporal filtering method to provide enhanced image resolution and reduce noise, comprising:
computing motion estimates;

regulating motion fields; and recovering details.
22. The method of claim 21 wherein the temporal filtering method further comprises using a multi-pass temporal filtering method; a temporal pyramid filtering method; or a serial temporal filtering method to reduce noise.
23. The method of claim 21 wherein lighting change compensation is used to improve the performance of the temporal filtering method.
24. The method of claim 21 wherein noise equalization is used to improve the performance of the temporal filtering method.
25. The method of claim 20 wherein the statistical quality indicators comprise PMR and ASR.
26. The method of claim 15 wherein the evaluation of temporal processing quality is based on PMR and ASR.
27. The method of claim 15 wherein the render parameters are modified based on PMR and ASR.
28. The method of claim 19 wherein the image sharpening is based on enhancement of multiple levels of image details.
29. The method of claim 15 wherein distributing render jobs among multiple render clients is performed by assigning an entire image shot to a single render client;
dividing an image shot into overlapping segments and distributing them to render clients; or dividing an image frame into overlapping regions and distributing them to render clients.
30. The method of claim 15 wherein the verification process comprises:
visually checking a proxy version of the enhanced image data for completeness;
visually verifying image noise level, sharpness and detail preservation and modify render parameters for re-submission if necessary based on statistical measures;

visually verifying color, artifacts and motion comfort level;
issuing a pass stamp if a render image shot meets quality standard.
31. The method of claim 10 wherein the post-processing process comprises:
final artifact removal;
final color correction;
motion correction;
organizing images; and output image data conversion.
32. The method of claim 31 wherein motion correction is performed by reducing motion strobing by adding motion blur and reducing extreme camera shaking by partial camera stabilization.
33. A system for digitally re-mastering an image sequence with enhanced image resolution and quality, comprising:
a central control computer server;
an image data file server configured as a client device of the central control server;
multiple computing render devices configured as client devices to the central control server for processing original image data using temporal processing to produce enhanced image data having enhanced resolution and quality;
multiple workstations for user-interactive operations relating to the processing of the original image data configured as client devices to the central control server;
a data storage device for storing image data and process data;
image data input and output devices; and a computer network that provides communications between the central control server and all client devices.
34. The system of claim 33 where the computing render devices are standard computers configured in a parallel and distributed configuration designed for supporting temporal processing of multiple image sequences simultaneously.
35. The system of claim 33 wherein the central control computer server is capable of resource management; quality optimization; computing efficiency optimization;
production management; system administration; and user interactivity.
36. A method for digitally re-mastering an image sequence with enhanced image resolution and quality by a temporal filtering method, comprising:
computing motion estimates;
regulating motion fields; and recovering details.
37. The method of claim 36 wherein the temporal filtering method further comprises using a multi-pass temporal filtering method; a temporal pyramid filtering method; or a serial temporal filtering method to reduce noise.
38. The method of claim 36 wherein lighting change compensation is used to improve the performance of the temporal filtering method.
39. The method of claim 36 wherein noise equalization is used to improve the performance of the temporal filtering method.
40. A method for digitally re-mastering an image sequence with enhanced image resolution and quality by using an image sharpening method based on enhancement of multiple levels of image details.
CA2478671A 2002-03-13 2003-03-13 Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data Expired - Lifetime CA2478671C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US36502102P 2002-03-13 2002-03-13
US60/365,021 2002-03-13
PCT/IB2003/000919 WO2003077549A1 (en) 2002-03-13 2003-03-13 Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data

Publications (2)

Publication Number Publication Date
CA2478671A1 true CA2478671A1 (en) 2003-09-18
CA2478671C CA2478671C (en) 2011-09-13

Family

ID=27805310

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2478671A Expired - Lifetime CA2478671C (en) 2002-03-13 2003-03-13 Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data

Country Status (7)

Country Link
US (1) US7856055B2 (en)
EP (1) EP1483909B1 (en)
CN (1) CN1650622B (en)
AU (1) AU2003209553A1 (en)
CA (1) CA2478671C (en)
DE (1) DE60332328D1 (en)
WO (1) WO2003077549A1 (en)

Families Citing this family (84)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9286941B2 (en) 2001-05-04 2016-03-15 Legend3D, Inc. Image sequence enhancement and motion picture project management system
US9031383B2 (en) 2001-05-04 2015-05-12 Legend3D, Inc. Motion picture project management system
US7856055B2 (en) 2002-03-13 2010-12-21 Imax Corporation Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data
AU2003237279A1 (en) * 2002-05-29 2003-12-19 Pixonics, Inc. Classifying image areas of a video signal
WO2004088984A1 (en) * 2003-04-04 2004-10-14 Bbc Technology Holdings Limited Video data storage and retrieval system and method with resolution conversion
US7555165B2 (en) * 2003-11-13 2009-06-30 Eastman Kodak Company Method for semantic scene classification using camera metadata and content-based cues
US7986328B2 (en) * 2004-02-26 2011-07-26 Hewlett-Packard Development Company, L.P. Graphics optimization system and method
CA2578358A1 (en) * 2004-07-30 2006-02-09 Pacific Title & Arts Studio, Inc. Method for conversion and reproduction of film images through a digital process
CA2583156C (en) 2004-10-18 2014-03-18 Thomson Licensing Film grain simulation method
CA2587095C (en) 2004-11-12 2015-01-20 Thomson Licensing Film grain simulation for normal play and trick mode play for video playback systems
KR101229942B1 (en) 2004-11-16 2013-02-06 톰슨 라이센싱 Film grain sei message insertion for bit-accurate simulation in a video system
ATE553455T1 (en) 2004-11-16 2012-04-15 Thomson Licensing METHOD FOR SIMULATING FILM GRAIN BASED ON PRECALCULATED TRANSFORMATION COEFFICIENTS
AU2005306936B2 (en) * 2004-11-17 2011-02-10 Interdigital Vc Holdings, Inc. Bit-accurate film grain simulation method based on pre-computed transformed coefficients
KR101208158B1 (en) 2004-11-22 2012-12-05 톰슨 라이센싱 Methods, apparatus and system for film grain cache splitting for film grain simulation
DE602005015249D1 (en) * 2004-11-23 2009-08-13 Thomson Licensing FILM CAVITY SIMULATION TECHNOLOGY WITH LOW COMPLEXITY
WO2006080950A1 (en) * 2005-01-27 2006-08-03 Thomson Licensing Edge based cmy automatic picture registration
US7924922B2 (en) * 2005-03-07 2011-04-12 Hewlett-Packard Development Company, L.P. Color registration in a digital video
WO2006122009A2 (en) * 2005-05-09 2006-11-16 Lockheed Martin Corporation Continuous extended range image processing
JP4712631B2 (en) * 2005-07-28 2011-06-29 京セラ株式会社 Imaging device
WO2007060584A2 (en) * 2005-11-23 2007-05-31 Koninklijke Philips Electronics N.V. Rendering views for a multi-view display device
CN101375315B (en) * 2006-01-27 2015-03-18 图象公司 Methods and systems for digitally re-mastering of 2D and 3D motion pictures for exhibition with enhanced visual quality
FR2898757A1 (en) * 2006-03-14 2007-09-21 Canon Kk METHOD AND DEVICE FOR ADAPTING A TIME FREQUENCY OF A SEQUENCE OF VIDEO IMAGES
KR100594995B1 (en) * 2006-03-17 2006-07-03 (주)동영아이텍 Video file creating system for digital screen advertisement
JP4709043B2 (en) * 2006-03-27 2011-06-22 富士フイルム株式会社 Data display apparatus and method, and program
JP4417919B2 (en) * 2006-03-31 2010-02-17 株式会社東芝 Image encoding apparatus and image decoding apparatus
US8281281B1 (en) * 2006-06-07 2012-10-02 Pixar Setting level of detail transition points
US8411931B2 (en) 2006-06-23 2013-04-02 Imax Corporation Methods and systems for converting 2D motion pictures for stereoscopic 3D exhibition
EP2111039B1 (en) * 2007-02-07 2017-10-25 Sony Corporation Image processing device, image processing method, and program
US10715834B2 (en) 2007-05-10 2020-07-14 Interdigital Vc Holdings, Inc. Film grain simulation based on pre-computed transform coefficients
US8437551B2 (en) * 2007-10-05 2013-05-07 Tufts University Devices and methods for restoring low-resolution text images
TW200922322A (en) * 2007-11-15 2009-05-16 Avisonic Technology Corp Method and apparatus thereof for enhancing digital image
US8908100B2 (en) * 2007-12-28 2014-12-09 Entropic Communications, Inc. Arrangement and approach for motion-based image data processing
US8081224B2 (en) * 2008-05-07 2011-12-20 Aptina Imaging Corporation Method and apparatus for image stabilization using multiple image captures
US8508662B1 (en) * 2008-06-19 2013-08-13 Marvell International Ltd. Post de-interlacer motion adaptive filter for smoother moving edges
US20100026897A1 (en) 2008-07-30 2010-02-04 Cinnafilm, Inc. Method, Apparatus, and Computer Software for Modifying Moving Images Via Motion Compensation Vectors, Degrain/Denoise, and Superresolution
JP4506886B2 (en) * 2008-08-29 2010-07-21 ソニー株式会社 Video conversion apparatus, video conversion method, and program
CN102217314B (en) * 2008-09-18 2017-07-28 汤姆森特许公司 The method and apparatus deleted for video image
US8140708B2 (en) * 2008-11-17 2012-03-20 Xrfiles, Inc. System and method for the serving of extended bit depth high resolution images
US8406518B2 (en) * 2009-01-20 2013-03-26 Pixar Smoothed local histogram filters for computer graphics
US8249299B1 (en) * 2009-08-17 2012-08-21 Adobe Systems Incorporated Systems and methods of tracking objects in video
KR20110042980A (en) * 2009-10-20 2011-04-27 삼성전자주식회사 Display apparatus to enhance image quality through repeat processing and method for processing image applied to the same
TWI401968B (en) * 2009-10-30 2013-07-11 Awind Inc Encoding method of screen frame and electronic apparatus applied therewith
US9407876B1 (en) * 2010-09-14 2016-08-02 Pixia Corp. Method and system for encoding and decoding multiple wide-area surveillance area-of-interest video codestreams
US9998749B2 (en) * 2010-10-19 2018-06-12 Otoy, Inc. Composite video streaming using stateless compression
US9288476B2 (en) 2011-02-17 2016-03-15 Legend3D, Inc. System and method for real-time depth modification of stereo images of a virtual reality environment
US9282321B2 (en) 2011-02-17 2016-03-08 Legend3D, Inc. 3D model multi-reviewer system
US9113130B2 (en) * 2012-02-06 2015-08-18 Legend3D, Inc. Multi-stage production pipeline system
US8963998B2 (en) * 2011-04-15 2015-02-24 Tektronix, Inc. Full reference system for predicting subjective quality of three-dimensional video
US8988578B2 (en) 2012-02-03 2015-03-24 Honeywell International Inc. Mobile computing device with improved image preview functionality
CA2866672A1 (en) * 2012-02-06 2013-08-15 Legend3D, Inc. Motion picture project management system
US9232175B2 (en) 2012-03-01 2016-01-05 Sony Corporation Generating multiple shots in storyboarding
US20130257851A1 (en) * 2012-04-01 2013-10-03 Chao-Hua Lee Pipeline web-based process for 3d animation
US10157447B2 (en) 2013-06-25 2018-12-18 Numeri Ltd. Multi-level spatial resolution increase of video
GB201314068D0 (en) 2013-08-06 2013-09-18 Microsoft Corp Encoding Video Captured in low light
JP2016018534A (en) * 2014-07-11 2016-02-01 キヤノン株式会社 Server, job management system, job management method, and program
US9599757B2 (en) 2014-10-10 2017-03-21 Microsoft Technology Licensing, Llc Increased accuracy corner cube arrays for high resolution retro-reflective imaging applications
US9697595B2 (en) 2014-11-26 2017-07-04 Adobe Systems Incorporated Content aware fill based on similar images
US11451798B2 (en) * 2015-01-05 2022-09-20 Arris Enterprises Llc Method of encoding video with film grain
KR20180114162A (en) 2016-02-24 2018-10-17 매직 립, 인코포레이티드 Polarizing beam splitter with low light leakage
AU2017227598B2 (en) 2016-03-01 2022-03-17 Magic Leap, Inc. Reflective switching device for inputting different wavelengths of light into waveguides
NZ756561A (en) 2016-03-04 2023-04-28 Magic Leap Inc Current drain reduction in ar/vr display systems
EP3433661A4 (en) 2016-03-25 2019-11-20 Magic Leap, Inc. Virtual and augmented reality systems and methods
US9641818B1 (en) 2016-04-01 2017-05-02 Adobe Systems Incorporated Kinetic object removal from camera preview image
KR102258047B1 (en) 2016-06-03 2021-05-27 매직 립, 인코포레이티드 Augmented Reality Identity Verification
CN116777994A (en) 2016-06-30 2023-09-19 奇跃公司 Estimating pose in 3D space
KR102450441B1 (en) 2016-07-14 2022-09-30 매직 립, 인코포레이티드 Deep Neural Networks for Iris Identification
EP3484343B1 (en) 2016-07-14 2024-01-10 Magic Leap, Inc. Iris boundary estimation using cornea curvature
EP3500911B1 (en) 2016-08-22 2023-09-27 Magic Leap, Inc. Augmented reality display device with deep learning sensors
RU2016138608A (en) 2016-09-29 2018-03-30 Мэджик Лип, Инк. NEURAL NETWORK FOR SEGMENTING THE EYE IMAGE AND ASSESSING THE QUALITY OF THE IMAGE
KR102216019B1 (en) 2016-10-04 2021-02-15 매직 립, 인코포레이티드 Efficient data layouts for convolutional neural networks
US10943188B2 (en) * 2016-11-09 2021-03-09 Universal City Studios Llc Virtual queuing techniques
IL285121B2 (en) 2016-11-15 2023-04-01 Magic Leap Inc Deep learning system for cuboid detection
US11150777B2 (en) 2016-12-05 2021-10-19 Magic Leap, Inc. Virtual user input controls in a mixed reality environment
WO2018136432A1 (en) * 2017-01-18 2018-07-26 Dolby Laboratories Licensing Corporation Segment-based reshaping for coding high dynamic range video
EP3571843A1 (en) 2017-01-18 2019-11-27 Dolby Laboratories Licensing Corporation Segment-based reshaping for coding high dynamic range video
CN110249620B (en) * 2017-02-17 2021-04-23 富士胶片株式会社 Image processing apparatus, image processing method, and camera system
JP6592622B2 (en) * 2017-02-17 2019-10-16 富士フイルム株式会社 Image processing apparatus, image processing method, and camera system
CN110419049B (en) 2017-03-17 2024-01-23 奇跃公司 Room layout estimation method and technique
EP3659017B1 (en) 2017-07-26 2023-04-05 Magic Leap, Inc. Training a neural network with representations of user interface devices
WO2019060283A1 (en) 2017-09-20 2019-03-28 Magic Leap, Inc. Personalized neural network for eye tracking
KR102602117B1 (en) 2017-10-26 2023-11-13 매직 립, 인코포레이티드 Gradient regularization systems and methods for adaptive loss balancing in deep multitask networks
US11270415B2 (en) 2019-08-22 2022-03-08 Adobe Inc. Image inpainting with geometric and photometric transformations
CN112749448B (en) * 2019-10-31 2022-02-08 北京国联视讯信息技术股份有限公司 Space measurement system and method based on parameter big data identification
US11330145B1 (en) 2021-06-10 2022-05-10 Bank Of America Corporation Image processing edge device for document noise removal

Family Cites Families (80)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4925294A (en) * 1986-12-17 1990-05-15 Geshwind David M Method to convert two dimensional motion pictures for three-dimensional systems
US6590573B1 (en) * 1983-05-09 2003-07-08 David Michael Geshwind Interactive computer system for creating three-dimensional image information and for converting two-dimensional image information for three-dimensional display systems
KR100202246B1 (en) * 1989-02-27 1999-06-15 윌리엄 비. 켐플러 Apparatus and method for digital video system
DE69133553T2 (en) * 1990-10-15 2007-09-27 Canon K.K. Image recording device with interchangeable lenses
JPH0568268A (en) * 1991-03-04 1993-03-19 Sharp Corp Device and method for generating stereoscopic visual image
US5600731A (en) * 1991-05-09 1997-02-04 Eastman Kodak Company Method for temporally adaptive filtering of frames of a noisy image sequence using motion estimation
US5259040A (en) 1991-10-04 1993-11-02 David Sarnoff Research Center, Inc. Method for determining sensor motion and scene structure and image processing system therefor
US5325449A (en) * 1992-05-15 1994-06-28 David Sarnoff Research Center, Inc. Method for fusing images and apparatus therefor
JPH06102484A (en) 1992-09-18 1994-04-15 Matsushita Electric Ind Co Ltd Meothod and device for displaying image using spatial optical modulation element
GB9223114D0 (en) 1992-11-04 1992-12-16 Rank Brimar Ltd Display system
EP0986252B1 (en) * 1993-06-04 2006-03-08 Sarnoff Corporation System and method for electronic image stabilization
US6130660A (en) * 1993-10-01 2000-10-10 Maxvision Corporation System and method for synthesizing high resolution video
US5510832A (en) * 1993-12-01 1996-04-23 Medi-Vision Technologies, Inc. Synthesized stereoscopic imaging system and method
KR100358021B1 (en) 1994-02-01 2003-01-24 산요 덴키 가부시키가이샤 Method of converting 2D image into 3D image and stereoscopic image display system
US5739844A (en) * 1994-02-04 1998-04-14 Sanyo Electric Co. Ltd. Method of converting two-dimensional image into three-dimensional image
EP0703716B1 (en) * 1994-09-22 2002-11-27 Sanyo Electric Co. Ltd Method of converting two-dimensional images into three-dimensional images
US5649032A (en) 1994-11-14 1997-07-15 David Sarnoff Research Center, Inc. System for automatically aligning images to form a mosaic image
KR100414629B1 (en) 1995-03-29 2004-05-03 산요덴키가부시키가이샤 3D display image generation method, image processing method using depth information, depth information generation method
US5835627A (en) * 1995-05-15 1998-11-10 Higgins; Eric W. System and method for automatically optimizing image quality and processing time
US5963664A (en) 1995-06-22 1999-10-05 Sarnoff Corporation Method and system for image combination using a parallax-based technique
EP0838068B1 (en) * 1995-07-10 2005-10-26 Sarnoff Corporation Method and system for rendering and combining images
US5790686A (en) * 1995-09-19 1998-08-04 University Of Maryland At College Park DCT-based motion estimation method
US5748199A (en) * 1995-12-20 1998-05-05 Synthonics Incorporated Method and apparatus for converting a two dimensional motion picture into a three dimensional motion picture
AUPN732395A0 (en) * 1995-12-22 1996-01-25 Xenotech Research Pty Ltd Image conversion and encoding techniques
US6957350B1 (en) * 1996-01-30 2005-10-18 Dolby Laboratories Licensing Corporation Encrypted and watermarked temporal and resolution layering in advanced television
JP3688377B2 (en) * 1996-01-31 2005-08-24 富士通株式会社 Image feature tracking apparatus and image feature tracking method
US6075884A (en) * 1996-03-29 2000-06-13 Sarnoff Corporation Method and apparatus for training a neural network to learn and use fidelity metric as a control mechanism
US5974159A (en) * 1996-03-29 1999-10-26 Sarnoff Corporation Method and apparatus for assessing the visibility of differences between two image sequences
US5738430A (en) * 1996-03-29 1998-04-14 David Sarnoff Research Center, Inc. Method and apparatus for predicting retinal illuminance
US5694491A (en) * 1996-03-29 1997-12-02 David Sarnoff Research Center, Inc. Methods and apparatus for assessing the visibility of differences between two image sequences
US5909516A (en) * 1996-03-29 1999-06-01 Sarnoff Corporation Method and apparatus for decomposing an image stream into units of local contrast
US5719966A (en) * 1996-03-29 1998-02-17 David Sarnoff Research Center, Inc. Apparatus for assessing the visiblity of differences between two image sequences
US6061477A (en) * 1996-04-18 2000-05-09 Sarnoff Corporation Quality image warper
US6075905A (en) 1996-07-17 2000-06-13 Sarnoff Corporation Method and apparatus for mosaic image construction
US6108005A (en) * 1996-08-30 2000-08-22 Space Corporation Method for producing a synthesized stereoscopic image
US6173087B1 (en) 1996-11-13 2001-01-09 Sarnoff Corporation Multi-view image registration with application to mosaicing and lens distortion correction
US6137904A (en) * 1997-04-04 2000-10-24 Sarnoff Corporation Method and apparatus for assessing the visibility of differences between two signal sequences
US5999220A (en) * 1997-04-07 1999-12-07 Washino; Kinya Multi-format audio/video production system with frame-rate conversion
US6219462B1 (en) * 1997-05-09 2001-04-17 Sarnoff Corporation Method and apparatus for performing global image alignment using any local match measure
US6067125A (en) * 1997-05-15 2000-05-23 Minerva Systems Structure and method for film grain noise reduction
CA2289757A1 (en) 1997-05-16 1998-11-19 Shih-Fu Chang Methods and architecture for indexing and editing compressed video over the world wide web
GB9711024D0 (en) * 1997-05-28 1997-07-23 Rank Xerox Ltd Image enhancement and thresholding of images
US6031564A (en) * 1997-07-07 2000-02-29 Reveo, Inc. Method and apparatus for monoscopic to stereoscopic image conversion
AUPO894497A0 (en) * 1997-09-02 1997-09-25 Xenotech Research Pty Ltd Image processing method and apparatus
US6141459A (en) * 1997-09-24 2000-10-31 Sarnoff Corporation Method and apparatus for processing image pyramid borders
US5978029A (en) * 1997-10-10 1999-11-02 International Business Machines Corporation Real-time encoding of video sequence employing two encoders and statistical analysis
US6191809B1 (en) * 1998-01-15 2001-02-20 Vista Medical Technologies, Inc. Method and apparatus for aligning stereo images
US6560281B1 (en) * 1998-02-24 2003-05-06 Xerox Corporation Method and apparatus for generating a condensed version of a video sequence including desired affordances
US6266092B1 (en) * 1998-05-12 2001-07-24 Genesis Microchip Inc. Method and apparatus for video line multiplication with enhanced sharpness
US6208348B1 (en) * 1998-05-27 2001-03-27 In-Three, Inc. System and method for dimensionalization processing of images in consideration of a pedetermined image projection format
US6515659B1 (en) * 1998-05-27 2003-02-04 In-Three, Inc. Method and system for creating realistic smooth three-dimensional depth contours from two-dimensional images
US6298090B1 (en) * 1998-06-04 2001-10-02 U.S. Philips Corporation System for detecting redundant images in a video sequence by comparing two predetermined threshold values
US6269175B1 (en) * 1998-08-28 2001-07-31 Sarnoff Corporation Method and apparatus for enhancing regions of aligned images using flow estimation
WO2000013423A1 (en) 1998-08-28 2000-03-09 Sarnoff Corporation Method and apparatus for synthesizing high-resolution imagery using one high-resolution camera and a lower resolution camera
US6992700B1 (en) * 1998-09-08 2006-01-31 Ricoh Company, Ltd. Apparatus for correction based upon detecting a camera shaking
US6487304B1 (en) * 1999-06-16 2002-11-26 Microsoft Corporation Multi-view approach to motion and stereo
CA2279797C (en) 1999-08-06 2010-01-05 Demin Wang A method for temporal interpolation of an image sequence using object-based image analysis
WO2001028238A2 (en) 1999-10-08 2001-04-19 Sarnoff Corporation Method and apparatus for enhancing and indexing video and audio signals
US6351545B1 (en) * 1999-12-14 2002-02-26 Dynapel Systems, Inc. Motion picture enhancing system
US6907073B2 (en) * 1999-12-20 2005-06-14 Sarnoff Corporation Tweening-based codec for scaleable encoders and decoders with varying motion computation capability
US6806898B1 (en) * 2000-03-20 2004-10-19 Microsoft Corp. System and method for automatically adjusting gaze and head orientation for video conferencing
US20020035432A1 (en) * 2000-06-08 2002-03-21 Boguslaw Kubica Method and system for spatially indexing land
JP5174309B2 (en) 2000-07-03 2013-04-03 アイマックス コーポレイション Devices and techniques for increasing the dynamic range of projection devices
AUPQ921000A0 (en) 2000-08-04 2000-08-31 Martin, Vincent Michael Composite wall panel
US6573912B1 (en) * 2000-11-07 2003-06-03 Zaxel Systems, Inc. Internet system for virtual telepresence
US7260274B2 (en) * 2000-12-01 2007-08-21 Imax Corporation Techniques and systems for developing high-resolution imagery
US20020149696A1 (en) * 2001-02-23 2002-10-17 Eastman Kodak Company Method for presenting improved motion image sequences
US7242850B2 (en) * 2001-02-23 2007-07-10 Eastman Kodak Company Frame-interpolated variable-rate motion imaging system
US7079697B2 (en) * 2001-03-19 2006-07-18 Texas Instruments Incorporated Image compression with transform coefficient analysis
US6968006B1 (en) * 2001-06-05 2005-11-22 At&T Corp. Method of content adaptive video decoding
US7227896B2 (en) * 2001-10-04 2007-06-05 Sharp Laboratories Of America, Inc. Method and apparatus for global motion estimation
KR100457517B1 (en) * 2002-02-19 2004-11-17 삼성전자주식회사 An apparatus and method for frame rate conversion
US7856055B2 (en) 2002-03-13 2010-12-21 Imax Corporation Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data
US6856314B2 (en) * 2002-04-18 2005-02-15 Stmicroelectronics, Inc. Method and system for 3D reconstruction of multiple views with altering search path and occlusion modeling
US20040202445A1 (en) * 2003-03-20 2004-10-14 Pixar Component color flat panel digital film recorder and method
US7630576B2 (en) * 2004-02-19 2009-12-08 Sony Corporation Signal processing apparatus and method, and command-sequence data structure
US20050254011A1 (en) * 2004-05-17 2005-11-17 Weisgerber Robert C Method for exhibiting motion picture films at a higher frame rate than that in which they were originally produced
JP4951884B2 (en) * 2005-06-29 2012-06-13 ミツミ電機株式会社 Encoder device
CN101375315B (en) 2006-01-27 2015-03-18 图象公司 Methods and systems for digitally re-mastering of 2D and 3D motion pictures for exhibition with enhanced visual quality
US8411931B2 (en) 2006-06-23 2013-04-02 Imax Corporation Methods and systems for converting 2D motion pictures for stereoscopic 3D exhibition

Also Published As

Publication number Publication date
WO2003077549A1 (en) 2003-09-18
CN1650622A (en) 2005-08-03
DE60332328D1 (en) 2010-06-10
AU2003209553A1 (en) 2003-09-22
CN1650622B (en) 2012-09-05
US7856055B2 (en) 2010-12-21
EP1483909A1 (en) 2004-12-08
CA2478671C (en) 2011-09-13
US20040130680A1 (en) 2004-07-08
EP1483909B1 (en) 2010-04-28

Similar Documents

Publication Publication Date Title
CA2478671A1 (en) Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data
US11234006B2 (en) Training end-to-end video processes
US11528492B2 (en) Machine learning for visual processing
CA2636858C (en) Methods and systems for digitally re-mastering of 2d and 3d motion pictures for exhibition with enhanced visual quality
JP4689667B2 (en) Encoding method, encoding apparatus, filter generation method, and filter generation apparatus
JP5254179B2 (en) Adaptive prediction using dimensionality reduction
Li et al. CNN based post-processing to improve HEVC
GB2548749A (en) Online training of hierarchical algorithms
CN111492657B (en) Light field video compression based on face region detection
JP6966936B2 (en) Image coding device and its control method and program
Coria et al. Using temporal correlation for fast and highdetailed video tone mapping
JP2000278699A (en) Image pickup unit and image pickup method

Legal Events

Date Code Title Description
EEER Examination request
MKEX Expiry

Effective date: 20230313