CA2478671A1 - Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data - Google Patents
Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data Download PDFInfo
- Publication number
- CA2478671A1 CA2478671A1 CA002478671A CA2478671A CA2478671A1 CA 2478671 A1 CA2478671 A1 CA 2478671A1 CA 002478671 A CA002478671 A CA 002478671A CA 2478671 A CA2478671 A CA 2478671A CA 2478671 A1 CA2478671 A1 CA 2478671A1
- Authority
- CA
- Canada
- Prior art keywords
- render
- image
- processing
- temporal
- image data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0135—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
- H04N7/014—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes involving the use of motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0112—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards corresponding to a cinematograph film standard
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/21—Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
Abstract
A process and methods of digital enhancement of motion pictures and other moving image sequences for the purpose of being exhibited in an alternative display format including a large format cinema are disclosed. The invention efficiently enhances image resolution and quality through a temporal filtering process and achieves high performance using automated or interactive statistical quality evaluation methods. A system specially designed for efficient temporal computing with a parallel and distributed computing configuration equipped with a variety of optimization schemes is also disclosed. The performance of the process and the system is optimized through an intelligent controller and is scalable to support any throughput requirements demanded for concurrent motion picture releases in the original format as well as in any alternative format.
Claims (40)
1. A method for digitally re-mastering an image sequence with enhanced image resolution and quality, comprising:
converting the image sequence to a digital format that comprises original image data;
processing the original image data using temporal processing to produce enhanced image data having enhanced resolution and quality.
converting the image sequence to a digital format that comprises original image data;
processing the original image data using temporal processing to produce enhanced image data having enhanced resolution and quality.
2. The method of claim 1 further comprising converting the enhanced image data to an alternative format.
3. The method of claim 1 further comprising reviewing the image sequence for appropriate resolution and quality.
4. The method of claim 1 wherein the image sequence is a motion picture originated in a 35mm film format, and wherein converting the image sequence to a digital format comprises digitizing the film using a film scanner.
5. The method of claim 1 wherein the image sequence is a motion picture originated in a digital format, and wherein converting the image sequence to a digital format comprises data conversion from the original digital format.
6. The method of claim 1 wherein the image sequence is in any image sequence format containing images captured using a device with an optical or electronic sensor.
7. The method of claim 2 wherein the alternative format is a film format with enhanced resolution and quality, and wherein converting the enhanced image data to an alternative format comprises film recording using a film recorder.
8. The method of claim 2 wherein the alternative format is a digital display format with enhanced resolution and quality, and wherein converting the enhanced image data to an alternative format comprises data conversion to digital display format.
9. The method of claim 2 wherein the alternative format is a concurrent release of an original motion picture with enhanced resolution and quality.
10. The method of claim 1 wherein processing the original image data using temporal processing comprises a pre-processing process, a render process, a verification process, and a post-processing process.
11. The method of claim 10 wherein the pre-processing process comprises:
generating proxy image data;
receiving pre-processing decisions for the original image data on shot separation, re-framing, color correction, artifact identification and scene classification;
and using image processing tools based on the pre-processing decisions to prepare the original image data for the render process.
generating proxy image data;
receiving pre-processing decisions for the original image data on shot separation, re-framing, color correction, artifact identification and scene classification;
and using image processing tools based on the pre-processing decisions to prepare the original image data for the render process.
12. The method of claim 11 wherein the scene classification is performed by an automated algorithm based on scene analysis.
13. The method of Claim 11 wherein the artifact identification and artifact removal is performed by an automated algorithm in which artifacts are identified by their unique characteristics both from a current frame and from neighboring frames and removed by predicted pixel values calculated based on inter-frame motion estimates or infra-frame interpolation.
14. The method of claim 11 wherein the artifact identification and artifact removal is performed by a semi-automated algorithm for interactively locating artifacts and automated removal using temporal processing.
15. The method of claim 10 wherein render process comprises:
receiving original image data separated into shots having image shot data, wherein each shot is a render job;
predicting a render parameter set for each render job;
distributing render jobs among multiple computing render clients;
processing the render jobs to produce render results;
assembling the distributed render results;
checking the integrity of the assembled render results;
evaluating temporal processing render quality of the assembled render results;
and modifying the render parameters for improving the render results and re-processing if necessary.
receiving original image data separated into shots having image shot data, wherein each shot is a render job;
predicting a render parameter set for each render job;
distributing render jobs among multiple computing render clients;
processing the render jobs to produce render results;
assembling the distributed render results;
checking the integrity of the assembled render results;
evaluating temporal processing render quality of the assembled render results;
and modifying the render parameters for improving the render results and re-processing if necessary.
16. The method of claim 15 wherein predicting the render parameter set for a shot comprises:
locating key frames;
computing initial motion estimation settings;
computing motion estimates by using the initial motion estimation settings and applying motion estimation algorithms to the key frames; and computing statistical temporal measures based on the computed motion estimates to generate the render parameter set.
locating key frames;
computing initial motion estimation settings;
computing motion estimates by using the initial motion estimation settings and applying motion estimation algorithms to the key frames; and computing statistical temporal measures based on the computed motion estimates to generate the render parameter set.
17. The method of claim 16 wherein the statistical temporal measures include TSNR, Motion and FMD.
18. The method of claim 17 wherein the render parameter set is produced by generating a set of matching threshold values corresponding to a given FMD and further modified based on TSNR and Motion.
19. The method of claim 15 wherein processing the render jobs comprises:
temporal filtering;
image resizing; and image sharpening.
temporal filtering;
image resizing; and image sharpening.
20. The method of claim 19 wherein processing the render jobs further comprises:
lighting change compensation;
noise equalization;
computing statistical quality indicators; and proxy generation.
lighting change compensation;
noise equalization;
computing statistical quality indicators; and proxy generation.
21. The method of claim 15 wherein processing the render jobs comprises a temporal filtering method to provide enhanced image resolution and reduce noise, comprising:
computing motion estimates;
regulating motion fields; and recovering details.
computing motion estimates;
regulating motion fields; and recovering details.
22. The method of claim 21 wherein the temporal filtering method further comprises using a multi-pass temporal filtering method; a temporal pyramid filtering method; or a serial temporal filtering method to reduce noise.
23. The method of claim 21 wherein lighting change compensation is used to improve the performance of the temporal filtering method.
24. The method of claim 21 wherein noise equalization is used to improve the performance of the temporal filtering method.
25. The method of claim 20 wherein the statistical quality indicators comprise PMR and ASR.
26. The method of claim 15 wherein the evaluation of temporal processing quality is based on PMR and ASR.
27. The method of claim 15 wherein the render parameters are modified based on PMR and ASR.
28. The method of claim 19 wherein the image sharpening is based on enhancement of multiple levels of image details.
29. The method of claim 15 wherein distributing render jobs among multiple render clients is performed by assigning an entire image shot to a single render client;
dividing an image shot into overlapping segments and distributing them to render clients; or dividing an image frame into overlapping regions and distributing them to render clients.
dividing an image shot into overlapping segments and distributing them to render clients; or dividing an image frame into overlapping regions and distributing them to render clients.
30. The method of claim 15 wherein the verification process comprises:
visually checking a proxy version of the enhanced image data for completeness;
visually verifying image noise level, sharpness and detail preservation and modify render parameters for re-submission if necessary based on statistical measures;
visually verifying color, artifacts and motion comfort level;
issuing a pass stamp if a render image shot meets quality standard.
visually checking a proxy version of the enhanced image data for completeness;
visually verifying image noise level, sharpness and detail preservation and modify render parameters for re-submission if necessary based on statistical measures;
visually verifying color, artifacts and motion comfort level;
issuing a pass stamp if a render image shot meets quality standard.
31. The method of claim 10 wherein the post-processing process comprises:
final artifact removal;
final color correction;
motion correction;
organizing images; and output image data conversion.
final artifact removal;
final color correction;
motion correction;
organizing images; and output image data conversion.
32. The method of claim 31 wherein motion correction is performed by reducing motion strobing by adding motion blur and reducing extreme camera shaking by partial camera stabilization.
33. A system for digitally re-mastering an image sequence with enhanced image resolution and quality, comprising:
a central control computer server;
an image data file server configured as a client device of the central control server;
multiple computing render devices configured as client devices to the central control server for processing original image data using temporal processing to produce enhanced image data having enhanced resolution and quality;
multiple workstations for user-interactive operations relating to the processing of the original image data configured as client devices to the central control server;
a data storage device for storing image data and process data;
image data input and output devices; and a computer network that provides communications between the central control server and all client devices.
a central control computer server;
an image data file server configured as a client device of the central control server;
multiple computing render devices configured as client devices to the central control server for processing original image data using temporal processing to produce enhanced image data having enhanced resolution and quality;
multiple workstations for user-interactive operations relating to the processing of the original image data configured as client devices to the central control server;
a data storage device for storing image data and process data;
image data input and output devices; and a computer network that provides communications between the central control server and all client devices.
34. The system of claim 33 where the computing render devices are standard computers configured in a parallel and distributed configuration designed for supporting temporal processing of multiple image sequences simultaneously.
35. The system of claim 33 wherein the central control computer server is capable of resource management; quality optimization; computing efficiency optimization;
production management; system administration; and user interactivity.
production management; system administration; and user interactivity.
36. A method for digitally re-mastering an image sequence with enhanced image resolution and quality by a temporal filtering method, comprising:
computing motion estimates;
regulating motion fields; and recovering details.
computing motion estimates;
regulating motion fields; and recovering details.
37. The method of claim 36 wherein the temporal filtering method further comprises using a multi-pass temporal filtering method; a temporal pyramid filtering method; or a serial temporal filtering method to reduce noise.
38. The method of claim 36 wherein lighting change compensation is used to improve the performance of the temporal filtering method.
39. The method of claim 36 wherein noise equalization is used to improve the performance of the temporal filtering method.
40. A method for digitally re-mastering an image sequence with enhanced image resolution and quality by using an image sharpening method based on enhancement of multiple levels of image details.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US36502102P | 2002-03-13 | 2002-03-13 | |
US60/365,021 | 2002-03-13 | ||
PCT/IB2003/000919 WO2003077549A1 (en) | 2002-03-13 | 2003-03-13 | Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data |
Publications (2)
Publication Number | Publication Date |
---|---|
CA2478671A1 true CA2478671A1 (en) | 2003-09-18 |
CA2478671C CA2478671C (en) | 2011-09-13 |
Family
ID=27805310
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA2478671A Expired - Lifetime CA2478671C (en) | 2002-03-13 | 2003-03-13 | Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data |
Country Status (7)
Country | Link |
---|---|
US (1) | US7856055B2 (en) |
EP (1) | EP1483909B1 (en) |
CN (1) | CN1650622B (en) |
AU (1) | AU2003209553A1 (en) |
CA (1) | CA2478671C (en) |
DE (1) | DE60332328D1 (en) |
WO (1) | WO2003077549A1 (en) |
Families Citing this family (84)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9286941B2 (en) | 2001-05-04 | 2016-03-15 | Legend3D, Inc. | Image sequence enhancement and motion picture project management system |
US9031383B2 (en) | 2001-05-04 | 2015-05-12 | Legend3D, Inc. | Motion picture project management system |
US7856055B2 (en) | 2002-03-13 | 2010-12-21 | Imax Corporation | Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data |
AU2003237279A1 (en) * | 2002-05-29 | 2003-12-19 | Pixonics, Inc. | Classifying image areas of a video signal |
WO2004088984A1 (en) * | 2003-04-04 | 2004-10-14 | Bbc Technology Holdings Limited | Video data storage and retrieval system and method with resolution conversion |
US7555165B2 (en) * | 2003-11-13 | 2009-06-30 | Eastman Kodak Company | Method for semantic scene classification using camera metadata and content-based cues |
US7986328B2 (en) * | 2004-02-26 | 2011-07-26 | Hewlett-Packard Development Company, L.P. | Graphics optimization system and method |
CA2578358A1 (en) * | 2004-07-30 | 2006-02-09 | Pacific Title & Arts Studio, Inc. | Method for conversion and reproduction of film images through a digital process |
CA2583156C (en) | 2004-10-18 | 2014-03-18 | Thomson Licensing | Film grain simulation method |
CA2587095C (en) | 2004-11-12 | 2015-01-20 | Thomson Licensing | Film grain simulation for normal play and trick mode play for video playback systems |
KR101229942B1 (en) | 2004-11-16 | 2013-02-06 | 톰슨 라이센싱 | Film grain sei message insertion for bit-accurate simulation in a video system |
ATE553455T1 (en) | 2004-11-16 | 2012-04-15 | Thomson Licensing | METHOD FOR SIMULATING FILM GRAIN BASED ON PRECALCULATED TRANSFORMATION COEFFICIENTS |
AU2005306936B2 (en) * | 2004-11-17 | 2011-02-10 | Interdigital Vc Holdings, Inc. | Bit-accurate film grain simulation method based on pre-computed transformed coefficients |
KR101208158B1 (en) | 2004-11-22 | 2012-12-05 | 톰슨 라이센싱 | Methods, apparatus and system for film grain cache splitting for film grain simulation |
DE602005015249D1 (en) * | 2004-11-23 | 2009-08-13 | Thomson Licensing | FILM CAVITY SIMULATION TECHNOLOGY WITH LOW COMPLEXITY |
WO2006080950A1 (en) * | 2005-01-27 | 2006-08-03 | Thomson Licensing | Edge based cmy automatic picture registration |
US7924922B2 (en) * | 2005-03-07 | 2011-04-12 | Hewlett-Packard Development Company, L.P. | Color registration in a digital video |
WO2006122009A2 (en) * | 2005-05-09 | 2006-11-16 | Lockheed Martin Corporation | Continuous extended range image processing |
JP4712631B2 (en) * | 2005-07-28 | 2011-06-29 | 京セラ株式会社 | Imaging device |
WO2007060584A2 (en) * | 2005-11-23 | 2007-05-31 | Koninklijke Philips Electronics N.V. | Rendering views for a multi-view display device |
CN101375315B (en) * | 2006-01-27 | 2015-03-18 | 图象公司 | Methods and systems for digitally re-mastering of 2D and 3D motion pictures for exhibition with enhanced visual quality |
FR2898757A1 (en) * | 2006-03-14 | 2007-09-21 | Canon Kk | METHOD AND DEVICE FOR ADAPTING A TIME FREQUENCY OF A SEQUENCE OF VIDEO IMAGES |
KR100594995B1 (en) * | 2006-03-17 | 2006-07-03 | (주)동영아이텍 | Video file creating system for digital screen advertisement |
JP4709043B2 (en) * | 2006-03-27 | 2011-06-22 | 富士フイルム株式会社 | Data display apparatus and method, and program |
JP4417919B2 (en) * | 2006-03-31 | 2010-02-17 | 株式会社東芝 | Image encoding apparatus and image decoding apparatus |
US8281281B1 (en) * | 2006-06-07 | 2012-10-02 | Pixar | Setting level of detail transition points |
US8411931B2 (en) | 2006-06-23 | 2013-04-02 | Imax Corporation | Methods and systems for converting 2D motion pictures for stereoscopic 3D exhibition |
EP2111039B1 (en) * | 2007-02-07 | 2017-10-25 | Sony Corporation | Image processing device, image processing method, and program |
US10715834B2 (en) | 2007-05-10 | 2020-07-14 | Interdigital Vc Holdings, Inc. | Film grain simulation based on pre-computed transform coefficients |
US8437551B2 (en) * | 2007-10-05 | 2013-05-07 | Tufts University | Devices and methods for restoring low-resolution text images |
TW200922322A (en) * | 2007-11-15 | 2009-05-16 | Avisonic Technology Corp | Method and apparatus thereof for enhancing digital image |
US8908100B2 (en) * | 2007-12-28 | 2014-12-09 | Entropic Communications, Inc. | Arrangement and approach for motion-based image data processing |
US8081224B2 (en) * | 2008-05-07 | 2011-12-20 | Aptina Imaging Corporation | Method and apparatus for image stabilization using multiple image captures |
US8508662B1 (en) * | 2008-06-19 | 2013-08-13 | Marvell International Ltd. | Post de-interlacer motion adaptive filter for smoother moving edges |
US20100026897A1 (en) | 2008-07-30 | 2010-02-04 | Cinnafilm, Inc. | Method, Apparatus, and Computer Software for Modifying Moving Images Via Motion Compensation Vectors, Degrain/Denoise, and Superresolution |
JP4506886B2 (en) * | 2008-08-29 | 2010-07-21 | ソニー株式会社 | Video conversion apparatus, video conversion method, and program |
CN102217314B (en) * | 2008-09-18 | 2017-07-28 | 汤姆森特许公司 | The method and apparatus deleted for video image |
US8140708B2 (en) * | 2008-11-17 | 2012-03-20 | Xrfiles, Inc. | System and method for the serving of extended bit depth high resolution images |
US8406518B2 (en) * | 2009-01-20 | 2013-03-26 | Pixar | Smoothed local histogram filters for computer graphics |
US8249299B1 (en) * | 2009-08-17 | 2012-08-21 | Adobe Systems Incorporated | Systems and methods of tracking objects in video |
KR20110042980A (en) * | 2009-10-20 | 2011-04-27 | 삼성전자주식회사 | Display apparatus to enhance image quality through repeat processing and method for processing image applied to the same |
TWI401968B (en) * | 2009-10-30 | 2013-07-11 | Awind Inc | Encoding method of screen frame and electronic apparatus applied therewith |
US9407876B1 (en) * | 2010-09-14 | 2016-08-02 | Pixia Corp. | Method and system for encoding and decoding multiple wide-area surveillance area-of-interest video codestreams |
US9998749B2 (en) * | 2010-10-19 | 2018-06-12 | Otoy, Inc. | Composite video streaming using stateless compression |
US9288476B2 (en) | 2011-02-17 | 2016-03-15 | Legend3D, Inc. | System and method for real-time depth modification of stereo images of a virtual reality environment |
US9282321B2 (en) | 2011-02-17 | 2016-03-08 | Legend3D, Inc. | 3D model multi-reviewer system |
US9113130B2 (en) * | 2012-02-06 | 2015-08-18 | Legend3D, Inc. | Multi-stage production pipeline system |
US8963998B2 (en) * | 2011-04-15 | 2015-02-24 | Tektronix, Inc. | Full reference system for predicting subjective quality of three-dimensional video |
US8988578B2 (en) | 2012-02-03 | 2015-03-24 | Honeywell International Inc. | Mobile computing device with improved image preview functionality |
CA2866672A1 (en) * | 2012-02-06 | 2013-08-15 | Legend3D, Inc. | Motion picture project management system |
US9232175B2 (en) | 2012-03-01 | 2016-01-05 | Sony Corporation | Generating multiple shots in storyboarding |
US20130257851A1 (en) * | 2012-04-01 | 2013-10-03 | Chao-Hua Lee | Pipeline web-based process for 3d animation |
US10157447B2 (en) | 2013-06-25 | 2018-12-18 | Numeri Ltd. | Multi-level spatial resolution increase of video |
GB201314068D0 (en) | 2013-08-06 | 2013-09-18 | Microsoft Corp | Encoding Video Captured in low light |
JP2016018534A (en) * | 2014-07-11 | 2016-02-01 | キヤノン株式会社 | Server, job management system, job management method, and program |
US9599757B2 (en) | 2014-10-10 | 2017-03-21 | Microsoft Technology Licensing, Llc | Increased accuracy corner cube arrays for high resolution retro-reflective imaging applications |
US9697595B2 (en) | 2014-11-26 | 2017-07-04 | Adobe Systems Incorporated | Content aware fill based on similar images |
US11451798B2 (en) * | 2015-01-05 | 2022-09-20 | Arris Enterprises Llc | Method of encoding video with film grain |
KR20180114162A (en) | 2016-02-24 | 2018-10-17 | 매직 립, 인코포레이티드 | Polarizing beam splitter with low light leakage |
AU2017227598B2 (en) | 2016-03-01 | 2022-03-17 | Magic Leap, Inc. | Reflective switching device for inputting different wavelengths of light into waveguides |
NZ756561A (en) | 2016-03-04 | 2023-04-28 | Magic Leap Inc | Current drain reduction in ar/vr display systems |
EP3433661A4 (en) | 2016-03-25 | 2019-11-20 | Magic Leap, Inc. | Virtual and augmented reality systems and methods |
US9641818B1 (en) | 2016-04-01 | 2017-05-02 | Adobe Systems Incorporated | Kinetic object removal from camera preview image |
KR102258047B1 (en) | 2016-06-03 | 2021-05-27 | 매직 립, 인코포레이티드 | Augmented Reality Identity Verification |
CN116777994A (en) | 2016-06-30 | 2023-09-19 | 奇跃公司 | Estimating pose in 3D space |
KR102450441B1 (en) | 2016-07-14 | 2022-09-30 | 매직 립, 인코포레이티드 | Deep Neural Networks for Iris Identification |
EP3484343B1 (en) | 2016-07-14 | 2024-01-10 | Magic Leap, Inc. | Iris boundary estimation using cornea curvature |
EP3500911B1 (en) | 2016-08-22 | 2023-09-27 | Magic Leap, Inc. | Augmented reality display device with deep learning sensors |
RU2016138608A (en) | 2016-09-29 | 2018-03-30 | Мэджик Лип, Инк. | NEURAL NETWORK FOR SEGMENTING THE EYE IMAGE AND ASSESSING THE QUALITY OF THE IMAGE |
KR102216019B1 (en) | 2016-10-04 | 2021-02-15 | 매직 립, 인코포레이티드 | Efficient data layouts for convolutional neural networks |
US10943188B2 (en) * | 2016-11-09 | 2021-03-09 | Universal City Studios Llc | Virtual queuing techniques |
IL285121B2 (en) | 2016-11-15 | 2023-04-01 | Magic Leap Inc | Deep learning system for cuboid detection |
US11150777B2 (en) | 2016-12-05 | 2021-10-19 | Magic Leap, Inc. | Virtual user input controls in a mixed reality environment |
WO2018136432A1 (en) * | 2017-01-18 | 2018-07-26 | Dolby Laboratories Licensing Corporation | Segment-based reshaping for coding high dynamic range video |
EP3571843A1 (en) | 2017-01-18 | 2019-11-27 | Dolby Laboratories Licensing Corporation | Segment-based reshaping for coding high dynamic range video |
CN110249620B (en) * | 2017-02-17 | 2021-04-23 | 富士胶片株式会社 | Image processing apparatus, image processing method, and camera system |
JP6592622B2 (en) * | 2017-02-17 | 2019-10-16 | 富士フイルム株式会社 | Image processing apparatus, image processing method, and camera system |
CN110419049B (en) | 2017-03-17 | 2024-01-23 | 奇跃公司 | Room layout estimation method and technique |
EP3659017B1 (en) | 2017-07-26 | 2023-04-05 | Magic Leap, Inc. | Training a neural network with representations of user interface devices |
WO2019060283A1 (en) | 2017-09-20 | 2019-03-28 | Magic Leap, Inc. | Personalized neural network for eye tracking |
KR102602117B1 (en) | 2017-10-26 | 2023-11-13 | 매직 립, 인코포레이티드 | Gradient regularization systems and methods for adaptive loss balancing in deep multitask networks |
US11270415B2 (en) | 2019-08-22 | 2022-03-08 | Adobe Inc. | Image inpainting with geometric and photometric transformations |
CN112749448B (en) * | 2019-10-31 | 2022-02-08 | 北京国联视讯信息技术股份有限公司 | Space measurement system and method based on parameter big data identification |
US11330145B1 (en) | 2021-06-10 | 2022-05-10 | Bank Of America Corporation | Image processing edge device for document noise removal |
Family Cites Families (80)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4925294A (en) * | 1986-12-17 | 1990-05-15 | Geshwind David M | Method to convert two dimensional motion pictures for three-dimensional systems |
US6590573B1 (en) * | 1983-05-09 | 2003-07-08 | David Michael Geshwind | Interactive computer system for creating three-dimensional image information and for converting two-dimensional image information for three-dimensional display systems |
KR100202246B1 (en) * | 1989-02-27 | 1999-06-15 | 윌리엄 비. 켐플러 | Apparatus and method for digital video system |
DE69133553T2 (en) * | 1990-10-15 | 2007-09-27 | Canon K.K. | Image recording device with interchangeable lenses |
JPH0568268A (en) * | 1991-03-04 | 1993-03-19 | Sharp Corp | Device and method for generating stereoscopic visual image |
US5600731A (en) * | 1991-05-09 | 1997-02-04 | Eastman Kodak Company | Method for temporally adaptive filtering of frames of a noisy image sequence using motion estimation |
US5259040A (en) | 1991-10-04 | 1993-11-02 | David Sarnoff Research Center, Inc. | Method for determining sensor motion and scene structure and image processing system therefor |
US5325449A (en) * | 1992-05-15 | 1994-06-28 | David Sarnoff Research Center, Inc. | Method for fusing images and apparatus therefor |
JPH06102484A (en) | 1992-09-18 | 1994-04-15 | Matsushita Electric Ind Co Ltd | Meothod and device for displaying image using spatial optical modulation element |
GB9223114D0 (en) | 1992-11-04 | 1992-12-16 | Rank Brimar Ltd | Display system |
EP0986252B1 (en) * | 1993-06-04 | 2006-03-08 | Sarnoff Corporation | System and method for electronic image stabilization |
US6130660A (en) * | 1993-10-01 | 2000-10-10 | Maxvision Corporation | System and method for synthesizing high resolution video |
US5510832A (en) * | 1993-12-01 | 1996-04-23 | Medi-Vision Technologies, Inc. | Synthesized stereoscopic imaging system and method |
KR100358021B1 (en) | 1994-02-01 | 2003-01-24 | 산요 덴키 가부시키가이샤 | Method of converting 2D image into 3D image and stereoscopic image display system |
US5739844A (en) * | 1994-02-04 | 1998-04-14 | Sanyo Electric Co. Ltd. | Method of converting two-dimensional image into three-dimensional image |
EP0703716B1 (en) * | 1994-09-22 | 2002-11-27 | Sanyo Electric Co. Ltd | Method of converting two-dimensional images into three-dimensional images |
US5649032A (en) | 1994-11-14 | 1997-07-15 | David Sarnoff Research Center, Inc. | System for automatically aligning images to form a mosaic image |
KR100414629B1 (en) | 1995-03-29 | 2004-05-03 | 산요덴키가부시키가이샤 | 3D display image generation method, image processing method using depth information, depth information generation method |
US5835627A (en) * | 1995-05-15 | 1998-11-10 | Higgins; Eric W. | System and method for automatically optimizing image quality and processing time |
US5963664A (en) | 1995-06-22 | 1999-10-05 | Sarnoff Corporation | Method and system for image combination using a parallax-based technique |
EP0838068B1 (en) * | 1995-07-10 | 2005-10-26 | Sarnoff Corporation | Method and system for rendering and combining images |
US5790686A (en) * | 1995-09-19 | 1998-08-04 | University Of Maryland At College Park | DCT-based motion estimation method |
US5748199A (en) * | 1995-12-20 | 1998-05-05 | Synthonics Incorporated | Method and apparatus for converting a two dimensional motion picture into a three dimensional motion picture |
AUPN732395A0 (en) * | 1995-12-22 | 1996-01-25 | Xenotech Research Pty Ltd | Image conversion and encoding techniques |
US6957350B1 (en) * | 1996-01-30 | 2005-10-18 | Dolby Laboratories Licensing Corporation | Encrypted and watermarked temporal and resolution layering in advanced television |
JP3688377B2 (en) * | 1996-01-31 | 2005-08-24 | 富士通株式会社 | Image feature tracking apparatus and image feature tracking method |
US6075884A (en) * | 1996-03-29 | 2000-06-13 | Sarnoff Corporation | Method and apparatus for training a neural network to learn and use fidelity metric as a control mechanism |
US5974159A (en) * | 1996-03-29 | 1999-10-26 | Sarnoff Corporation | Method and apparatus for assessing the visibility of differences between two image sequences |
US5738430A (en) * | 1996-03-29 | 1998-04-14 | David Sarnoff Research Center, Inc. | Method and apparatus for predicting retinal illuminance |
US5694491A (en) * | 1996-03-29 | 1997-12-02 | David Sarnoff Research Center, Inc. | Methods and apparatus for assessing the visibility of differences between two image sequences |
US5909516A (en) * | 1996-03-29 | 1999-06-01 | Sarnoff Corporation | Method and apparatus for decomposing an image stream into units of local contrast |
US5719966A (en) * | 1996-03-29 | 1998-02-17 | David Sarnoff Research Center, Inc. | Apparatus for assessing the visiblity of differences between two image sequences |
US6061477A (en) * | 1996-04-18 | 2000-05-09 | Sarnoff Corporation | Quality image warper |
US6075905A (en) | 1996-07-17 | 2000-06-13 | Sarnoff Corporation | Method and apparatus for mosaic image construction |
US6108005A (en) * | 1996-08-30 | 2000-08-22 | Space Corporation | Method for producing a synthesized stereoscopic image |
US6173087B1 (en) | 1996-11-13 | 2001-01-09 | Sarnoff Corporation | Multi-view image registration with application to mosaicing and lens distortion correction |
US6137904A (en) * | 1997-04-04 | 2000-10-24 | Sarnoff Corporation | Method and apparatus for assessing the visibility of differences between two signal sequences |
US5999220A (en) * | 1997-04-07 | 1999-12-07 | Washino; Kinya | Multi-format audio/video production system with frame-rate conversion |
US6219462B1 (en) * | 1997-05-09 | 2001-04-17 | Sarnoff Corporation | Method and apparatus for performing global image alignment using any local match measure |
US6067125A (en) * | 1997-05-15 | 2000-05-23 | Minerva Systems | Structure and method for film grain noise reduction |
CA2289757A1 (en) | 1997-05-16 | 1998-11-19 | Shih-Fu Chang | Methods and architecture for indexing and editing compressed video over the world wide web |
GB9711024D0 (en) * | 1997-05-28 | 1997-07-23 | Rank Xerox Ltd | Image enhancement and thresholding of images |
US6031564A (en) * | 1997-07-07 | 2000-02-29 | Reveo, Inc. | Method and apparatus for monoscopic to stereoscopic image conversion |
AUPO894497A0 (en) * | 1997-09-02 | 1997-09-25 | Xenotech Research Pty Ltd | Image processing method and apparatus |
US6141459A (en) * | 1997-09-24 | 2000-10-31 | Sarnoff Corporation | Method and apparatus for processing image pyramid borders |
US5978029A (en) * | 1997-10-10 | 1999-11-02 | International Business Machines Corporation | Real-time encoding of video sequence employing two encoders and statistical analysis |
US6191809B1 (en) * | 1998-01-15 | 2001-02-20 | Vista Medical Technologies, Inc. | Method and apparatus for aligning stereo images |
US6560281B1 (en) * | 1998-02-24 | 2003-05-06 | Xerox Corporation | Method and apparatus for generating a condensed version of a video sequence including desired affordances |
US6266092B1 (en) * | 1998-05-12 | 2001-07-24 | Genesis Microchip Inc. | Method and apparatus for video line multiplication with enhanced sharpness |
US6208348B1 (en) * | 1998-05-27 | 2001-03-27 | In-Three, Inc. | System and method for dimensionalization processing of images in consideration of a pedetermined image projection format |
US6515659B1 (en) * | 1998-05-27 | 2003-02-04 | In-Three, Inc. | Method and system for creating realistic smooth three-dimensional depth contours from two-dimensional images |
US6298090B1 (en) * | 1998-06-04 | 2001-10-02 | U.S. Philips Corporation | System for detecting redundant images in a video sequence by comparing two predetermined threshold values |
US6269175B1 (en) * | 1998-08-28 | 2001-07-31 | Sarnoff Corporation | Method and apparatus for enhancing regions of aligned images using flow estimation |
WO2000013423A1 (en) | 1998-08-28 | 2000-03-09 | Sarnoff Corporation | Method and apparatus for synthesizing high-resolution imagery using one high-resolution camera and a lower resolution camera |
US6992700B1 (en) * | 1998-09-08 | 2006-01-31 | Ricoh Company, Ltd. | Apparatus for correction based upon detecting a camera shaking |
US6487304B1 (en) * | 1999-06-16 | 2002-11-26 | Microsoft Corporation | Multi-view approach to motion and stereo |
CA2279797C (en) | 1999-08-06 | 2010-01-05 | Demin Wang | A method for temporal interpolation of an image sequence using object-based image analysis |
WO2001028238A2 (en) | 1999-10-08 | 2001-04-19 | Sarnoff Corporation | Method and apparatus for enhancing and indexing video and audio signals |
US6351545B1 (en) * | 1999-12-14 | 2002-02-26 | Dynapel Systems, Inc. | Motion picture enhancing system |
US6907073B2 (en) * | 1999-12-20 | 2005-06-14 | Sarnoff Corporation | Tweening-based codec for scaleable encoders and decoders with varying motion computation capability |
US6806898B1 (en) * | 2000-03-20 | 2004-10-19 | Microsoft Corp. | System and method for automatically adjusting gaze and head orientation for video conferencing |
US20020035432A1 (en) * | 2000-06-08 | 2002-03-21 | Boguslaw Kubica | Method and system for spatially indexing land |
JP5174309B2 (en) | 2000-07-03 | 2013-04-03 | アイマックス コーポレイション | Devices and techniques for increasing the dynamic range of projection devices |
AUPQ921000A0 (en) | 2000-08-04 | 2000-08-31 | Martin, Vincent Michael | Composite wall panel |
US6573912B1 (en) * | 2000-11-07 | 2003-06-03 | Zaxel Systems, Inc. | Internet system for virtual telepresence |
US7260274B2 (en) * | 2000-12-01 | 2007-08-21 | Imax Corporation | Techniques and systems for developing high-resolution imagery |
US20020149696A1 (en) * | 2001-02-23 | 2002-10-17 | Eastman Kodak Company | Method for presenting improved motion image sequences |
US7242850B2 (en) * | 2001-02-23 | 2007-07-10 | Eastman Kodak Company | Frame-interpolated variable-rate motion imaging system |
US7079697B2 (en) * | 2001-03-19 | 2006-07-18 | Texas Instruments Incorporated | Image compression with transform coefficient analysis |
US6968006B1 (en) * | 2001-06-05 | 2005-11-22 | At&T Corp. | Method of content adaptive video decoding |
US7227896B2 (en) * | 2001-10-04 | 2007-06-05 | Sharp Laboratories Of America, Inc. | Method and apparatus for global motion estimation |
KR100457517B1 (en) * | 2002-02-19 | 2004-11-17 | 삼성전자주식회사 | An apparatus and method for frame rate conversion |
US7856055B2 (en) | 2002-03-13 | 2010-12-21 | Imax Corporation | Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data |
US6856314B2 (en) * | 2002-04-18 | 2005-02-15 | Stmicroelectronics, Inc. | Method and system for 3D reconstruction of multiple views with altering search path and occlusion modeling |
US20040202445A1 (en) * | 2003-03-20 | 2004-10-14 | Pixar | Component color flat panel digital film recorder and method |
US7630576B2 (en) * | 2004-02-19 | 2009-12-08 | Sony Corporation | Signal processing apparatus and method, and command-sequence data structure |
US20050254011A1 (en) * | 2004-05-17 | 2005-11-17 | Weisgerber Robert C | Method for exhibiting motion picture films at a higher frame rate than that in which they were originally produced |
JP4951884B2 (en) * | 2005-06-29 | 2012-06-13 | ミツミ電機株式会社 | Encoder device |
CN101375315B (en) | 2006-01-27 | 2015-03-18 | 图象公司 | Methods and systems for digitally re-mastering of 2D and 3D motion pictures for exhibition with enhanced visual quality |
US8411931B2 (en) | 2006-06-23 | 2013-04-02 | Imax Corporation | Methods and systems for converting 2D motion pictures for stereoscopic 3D exhibition |
-
2003
- 2003-03-13 US US10/474,780 patent/US7856055B2/en active Active
- 2003-03-13 CN CN03810057.6A patent/CN1650622B/en not_active Expired - Lifetime
- 2003-03-13 AU AU2003209553A patent/AU2003209553A1/en not_active Abandoned
- 2003-03-13 DE DE60332328T patent/DE60332328D1/en not_active Expired - Lifetime
- 2003-03-13 WO PCT/IB2003/000919 patent/WO2003077549A1/en not_active Application Discontinuation
- 2003-03-13 EP EP03743959A patent/EP1483909B1/en not_active Expired - Lifetime
- 2003-03-13 CA CA2478671A patent/CA2478671C/en not_active Expired - Lifetime
Also Published As
Publication number | Publication date |
---|---|
WO2003077549A1 (en) | 2003-09-18 |
CN1650622A (en) | 2005-08-03 |
DE60332328D1 (en) | 2010-06-10 |
AU2003209553A1 (en) | 2003-09-22 |
CN1650622B (en) | 2012-09-05 |
US7856055B2 (en) | 2010-12-21 |
EP1483909A1 (en) | 2004-12-08 |
CA2478671C (en) | 2011-09-13 |
US20040130680A1 (en) | 2004-07-08 |
EP1483909B1 (en) | 2010-04-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2478671A1 (en) | Systems and methods for digitally re-mastering or otherwise modifying motion pictures or other image sequences data | |
US11234006B2 (en) | Training end-to-end video processes | |
US11528492B2 (en) | Machine learning for visual processing | |
CA2636858C (en) | Methods and systems for digitally re-mastering of 2d and 3d motion pictures for exhibition with enhanced visual quality | |
JP4689667B2 (en) | Encoding method, encoding apparatus, filter generation method, and filter generation apparatus | |
JP5254179B2 (en) | Adaptive prediction using dimensionality reduction | |
Li et al. | CNN based post-processing to improve HEVC | |
GB2548749A (en) | Online training of hierarchical algorithms | |
CN111492657B (en) | Light field video compression based on face region detection | |
JP6966936B2 (en) | Image coding device and its control method and program | |
Coria et al. | Using temporal correlation for fast and highdetailed video tone mapping | |
JP2000278699A (en) | Image pickup unit and image pickup method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request | ||
MKEX | Expiry |
Effective date: 20230313 |