WO2006061751A1 - Electronic image processing method and device with linked random generators - Google Patents

Electronic image processing method and device with linked random generators Download PDF

Info

Publication number
WO2006061751A1
WO2006061751A1 PCT/IB2005/054011 IB2005054011W WO2006061751A1 WO 2006061751 A1 WO2006061751 A1 WO 2006061751A1 IB 2005054011 W IB2005054011 W IB 2005054011W WO 2006061751 A1 WO2006061751 A1 WO 2006061751A1
Authority
WO
WIPO (PCT)
Prior art keywords
random
horizontal
pixel position
value
horizontal line
Prior art date
Application number
PCT/IB2005/054011
Other languages
French (fr)
Inventor
Wilhelmus H. A. Bruls
Stijn De Waele
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Priority to BRPI0518462-2A priority Critical patent/BRPI0518462A2/en
Priority to US11/720,839 priority patent/US20090231345A1/en
Priority to JP2007545031A priority patent/JP2008523680A/en
Priority to EP05822478A priority patent/EP1825683A1/en
Publication of WO2006061751A1 publication Critical patent/WO2006061751A1/en

Links

Classifications

    • G06T5/70
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20204Removing film grain; Adding simulated film grain

Definitions

  • the invention relates to a method of electronic image processing using randomly generated values, in particular a synthetic grain generation method.
  • the invention also relates to an apparatus for electronic image processing using randomly generated values, and an electronic image processing device for synthetic grain addition, a picture decompression device, a television signal receiving apparatus and a television signal capturing system comprising such an electronic image processing device.
  • the invention also relates to a computer program product comprising code describing the method enabling a processor to perform its functionality.
  • Synthetic grain may e.g. be added to a picture captured by a CCD camera to make it look like a picture captured on celluloid film.
  • modern picture and video compression e.g. the advanced video coding standard AVC
  • the efficiency of compression of film material is reduced by the presence of grain. Since film grain is not (temporarily) correlated, it requires many bits to accurately compress it. Therefore, it has been proposed remove the grain prior to encoding and to synthesize artificial grain at the decoder side. This has been standardized in the fidelity range extension of H.264 as Film Grain Management (FGM).
  • FGM Film Grain Management
  • the grain is generated in a deterministic way. This means that although it looks random, this grain is a random pattern which is generated by at least one seed which looks the same on each receiving/rendering device.
  • EP 04101141.2 describes such a grain synthesis system, embodiment details of which (such as possible random generators which can be used) will be referred to and not repeated in this application, as it should be clear to the skilled person which combinations can be made.
  • the method comprises: determining a first random value (Rl) corresponding to a first horizontal pixel position (hi) in a vertically positioned first horizontal line (Ll) of an inputted picture (PIC); and deriving a resultant value (R) for a second horizontal pixel position (h2) in a vertically positioned second horizontal line (L2), the resultant value depending on the first random value and a second random value (R2) corresponding to the second horizontal pixel position in the second horizontal line, random values for horizontally neighboring pixel positions being determined by successive outputs of a single random generator initialized with a seed, wherein the first random value is determined with a first random generator (nl) initialized with a first seed (Sl) for a firstmost horizontal pixel position in the first horizontal line (fl), and the second random value is determined with a second random generator (n2) running in parallel with the first random generator, and initialized with a second seed (S2) for a firstmost horizontal pixel position in the second horizontal line
  • a straightforward way to implement a deterministic grain synthesis is to send a single seed for the first image line LF and then to generate all the random values for consecutive pixels in a left-to-right, top-to-bottom zigzag scan.
  • the grain at horizontal position h2 in line L2 may e.g. depend on two vertically above generated random values for the same horizontal position h2. This means that at a certain moment in time, when the final grain value for (h2,L2) is being determined, those previously required random values are required, i.e. one needs to store in line memories two additional lines of samples. To have the right correlation length of the grain, one needs e.g. 8 vertical neighbors or more.
  • An embodiment of the method comprises: determining a first random value (Rl) corresponding to a first horizontal pixel position (hi) in a vertically positioned first horizontal line (Ll) of an inputted picture (PIC); and deriving a resultant value (R) for a second horizontal pixel position (h2) in a vertically positioned second horizontal line (L2), the resultant value depending on the first random value and a second random value (R2) corresponding to the second horizontal pixel position in the second horizontal line, random values for horizontally neighboring pixel positions being determined by successive outputs of a single random generator initialized with a seed, wherein the first random value is determined with a first random generator
  • nl initialized with a first seed (Sl) for a firstmost horizontal pixel position in the first horizontal line (fl)
  • the second random value is determined with a second random generator (n2) running in parallel with the first random generator, and initialized with a second seed (S2) for a firstmost horizontal pixel position in the second horizontal line (f2), which second seed (S2) is substantially equal to a random value obtained by applying the first random generator (nl) for the firstmost horizontal pixel position in the second horizontal line (f2) after having consecutively been applied to all horizontal positions on a left-right-top- bottom zig-zag scan path (ZZ) being initialized with the first seed (Sl) and starting from the firstmost horizontal pixel position in the first horizontal line (fl).
  • the content provider need not bother by such implementation issues as whether the receiver will use the single master seed approach with a zig-zag scanning and the required line memories, or whether the receiver will work according to the present invention: he will e.g. just send his single master seed SM, irrespective of what grain rendering method is used.
  • the required N seeds can be evaluated at the receiving side prior to applying the N random generators in parallel. Because the single seed random generation goes through each line consecutively, the random value at the beginning of a line (firstmost point), being used for generating the next random values (i.e. which can be interpreted as a seed for that line) can hence be simply obtained by running the random generator so many times from its firstmost/starting point (the first pixel on the first line LF) until the present line firstmost point is reached. This can be done quickly to determine all H seeds for all lines, and then the actual image processing can begin.
  • the random generators than run substantially in parallel, e.g. if one needs to calculate the resultant value (R) for position h2, and the grain is determined based on two previous and the current line (and for simplicity of argument no horizontal neighbors) then the preferred construction has three random generators outputting a value for this h2 position, namely the first for (h2,L0), the second for (h2,Ll) and the third for (h2, L2).
  • a simple FIR filter may then be employed for weighted adding of these three random values.
  • a typical image processing method is synthetic grain generation, and the grain may depend on the underlying pixel values of an inputted picture at the positions for which a random value is being generated, e.g. a DC term in a block-transform compressed picture.
  • An input picture may be uncompressed (e.g. just a zigzag scanned set of pixel values between 0 and 255) or obtainable after decompressing a compressed representation (e.g. MPEG-2, AVC, JPEG, ...) ⁇
  • the method may then be performed in a picture compression device, which is e.g. a part of a dedicated IC, or a software module running on a processor.
  • a FIR filter-only generation requires almost no memory, but many calculations because a long FIR filter may be required.
  • a combination realization may be made wherein a part of the filter is realized as a FIR (generating a local/high frequency correlation of the grain) and a part is realized as an HR (realizing the long-distance/low frequency correlation due to its integration properties).
  • HR realizing the long-distance/low frequency correlation due to its integration properties.
  • the image processing device and the picture processing device is advantageously incorporated in a television signal receiving apparatus, which is arranged to receive a television signal from a network (e.g. wireless terrestrial television, or a telephone network), and process it, in particular add grain.
  • the television signal receiving apparatus may e.g.
  • a display to also display the signal, or may be a separate unit such a settopbox. It may be a portable apparatus such as a wireless phone. It may also comprise storage functionality, e.g. a personal video recorder, which adds the grain to a received television signal before storing it in a memory.
  • storage functionality e.g. a personal video recorder, which adds the grain to a received television signal before storing it in a memory.
  • the television signal receiving apparatus may also be e.g. a disk reader, in which case the television signal is received from its storage on a disk, which only contains the non-grainy, smooth picture and a seed.
  • Fig. 1 schematically shows a picture for explaining the method
  • Fig. 2 schematically shows a prior art FIR grain synthesis device
  • Fig. 3 schematically shows an embodiment of a FIR grain synthesis device according to the invention
  • Fig. 4 schematically shows an embodiment of a grain synthesis device with an
  • Fig. 5 schematically shows a picture decompression apparatus comprising an electronic image processing device according to the invention.
  • Fig. 6 schematically shows a television signal capturing system according to the invention.
  • Fig. 1 shows the geometrical setup of the random resultant value R generation as a function of the geometrical pixel positions of an inputted picture PIC.
  • the random values may be needed for any image operation, e.g. a recoloring for implementing an artistic effect depending on the underlying picture content and the random value, a genetic algorithm based image operation, etc.
  • image operation e.g. a recoloring for implementing an artistic effect depending on the underlying picture content and the random value, a genetic algorithm based image operation, etc.
  • the basic random value generation part into other image processing functions.
  • a resultant value is needed for a pixel position (h2, L2) (second cross). If the random process is not local to a pixel, the generated random values for neighboring pixels are required, typically for horizontal as well as vertical neighbors.
  • An alternative to the frequency space method is to generate the grain in the time domain using Finite Impulse Response (FIR) filters and/or recursive (HR) filters. Grain that has been generated in this way has approximately the same statistical properties as the grain generated with the DCT. In this way both the large memory and the DCT are not needed. To get visually similar results, a FIR filter of quite high order q is needed
  • the input of the FIR/IIR filter is white noise (with a particular amplitude, e.g. Fv(I), Fv(2), ... generated on the basis of pixel values of underlying and possibly neighboring pixels or blocks) that is generated using a pseudo-random generator. If this white noise is generated sequentially using a single random generator, the result has to be stored in line memories. In the method of the present invention instead q (the FIR filter order) random generators are used in parallel to generate the input for the as they are needed by the filter. By initializing all random generators by the right seed, the output of this filter can be made identical to the random numbers generated by a single pseudo-random generator.
  • q the FIR filter order
  • a random generator known from literature is based on m registers with an exor feedback from the lsb side to the msb.
  • the length m determines the length of repetition of the random value and should therefore be large.
  • the last n lsb bits form the n bits random value.
  • the random generator can be made deterministic by resetting the register at a certain moment, e.g. beginning of the sequence, to a so-called seed number.
  • Fig. 2 shows a prior art filter 200 to filter the pseudo random noise, coming from e.g. the exor pseudo random noise generator 203, in both vertical and horizontal direction by means of a (horizontally/vertically) separable filter.
  • the number of FIR filter order q is here 2k+l.
  • 2k line memories are required of n bits.
  • the vertical filtered results are the m bits results of the summation by adder 202 of the 2k+l FIR multipliers (261, 262, ...) in vertical FIR filter 210.
  • This intermediate result RV is then fed to the horizontal filter stage 280, which is formed by 2*k registers (i.e. the blocks like 201 are delays) and the FIR multipliers and a summation.
  • the costs are dominated by the cost of the 2*k line memories (251, 252, 253, ...) ⁇ As said before, these memory costs can be avoid by using the method/device of the present invention.
  • Fig. 3 the signals as produced by the line memories of fig 2 are now produced by separate pseudo random generators 301, 303 etc..
  • 2k+l seeds are calculated in such a way that the successive seeds have a 'shift' of the length w of the line memories. This means e.g. that seed s(l) has the value of the output of a random generator initialized with seed(O) 1920 sample moments later.
  • the vertical part of the decomposable FIR filtering is realized with vertical FIR filter 311.
  • Vertically adjacent determined random values are multiplied with coefficients Fv(-k+l) etc., which coefficients e.g. follow a Gaussian or exponential decreasing pattern.
  • the so weighted random values are added in an adder. This procedure is done consecutively for horizontally neighboring pixels.
  • a so obtained value for a horizontal position h-1 is delayed by delay 201 and the vertical FIR filtered random value for horizontal position h is then determined, etc.
  • this neighboring vertical resulting values are weighed and added in a horizontal FIR filter 313, yielding the final resultant value (R).
  • the parallel execution of the random generators 301, 303, ... is under the control of a control means 380 (e.g. a processor running a software encoded control algorithm or a similar purely hardware realized means, etc.).
  • a control means 380 e.g. a processor running a software encoded control algorithm or a similar purely hardware realized means, etc.
  • the skilled person can find different prior art ways to construct such a control, e.g. with a means which outputs a clock signal CLK which triggers the random generation.
  • FIG. 4 gives an alternative embodiment of the claimed invention which makes use of a combination of FIR (finite impulse response) & IIR (infinite impulse response) filter technique.
  • the vertical FIR filter part is similar as in the embodiment of Fig. 3, but fewer filter taps may be used.
  • the filter works as follows. At a certain horizontal position h2, a resultant vertically FIR filtered value RV2 is obtained. This value RV2 is added by adder 499 to previously determined values RVl and RVO. The values are properly weighed (by multipliers 480, 481 ) by filter coefficients Fvr(- 1 ), Fvr(-2) and (by multiplier 482) 1 / ⁇ Fvr , so that the result doesn't overflow outside the [0,255] interval, and although there is correlation, there is only a limited memory, so that the noise generated adapts to new circumstances, such as e.g. different underlying grey values (obviously the method can be expanded to color pictures).
  • This addition (now having a contribution of at least three vertical positions) is saved in an upper line memory 451. All memories shift synchronously with the vertical FIR filter 311 to the next horizontal picture position. In this way after W positions have been processed, the horizontal position h2 is up for processing again, i.e. in the long run this device implements a vertical IIR filter (having decreasing contributions of pixels in the vertical past). Similarly unit 413 realizes a horizontal IIR filter, which is of course optional, as one can also use a pure FIR filter horizontally.
  • Fig 5 shows an example of a picture decompression device 500, which may be comprised in a television signal receiving apparatus 560 in the exemplary embodiment e.g. a settopbox connected to a display 561 (wired or wirelessly).
  • a picture decompression unit 502 is arranged to decompress a compressed picture inputted from a network 550 into an uncompressed image signal PIC.
  • the picture decompression unit 502 may be further arranged to provide the DC values of the compressed picture to e.g. a memory unit 570, which may e.g. comprise a look-up table evaluation unit for converting these DC values to appropriate weighing factors Fv, Fh, Fvr, ... .
  • the seed and grain generation parameters i.e. the constants of the filtering, which determine the grain look
  • SEI Supplemental enhancement information
  • This SEI information is passed by the picture decompression unit 502 to a seed dispenser 580, which may e.g. be embodied as a seed calculator which is arranged pre- calculate the initial seed values based on e.g. a single master seed SM for the firstmost pixel of the first line LF, and pass them to the electronic image processing device 312 when required by the random generators.
  • a seed dispenser 580 which may e.g. be embodied as a seed calculator which is arranged pre- calculate the initial seed values based on e.g. a single master seed SM for the firstmost pixel of the first line LF, and pass them to the electronic image processing device 312 when required by the random generators.
  • the SEI interpreter also sends the grain look determining parameters to the memory unit 570 to determine the correct lookup table filter parameters.
  • the lookup table contains the relation of the luma intensity and grain parameters to the filter coefficients Fv, Fh, Fvr & Fhr and noise strength value S FGM.
  • the noise strength value S FGM controls the amplitude of the filtered noise output which is added by adder 510 to the video content of the PIC.
  • a coarser scale grain picture may be generated (which can be done in either or both of the horizontal and vertical directions) and subsequently interpolated, preferably by a zero order hold (i.e. copying of the previous value).
  • a zero order hold i.e. copying of the previous value.
  • an extra line memory is used for containing the picture grey values for at least a fraction of the width of the picture, and the resulting grain value is added to the grey values e.g. 4 times in a 2x2 block (i.e. both to the current pixel and the one stored in the extra grain value) the same is possible in memory access which is not typical zigzag line based, e.g. block or random access a currently preferred option (because at present only little memory is available in e.g. decompressors or other image processing ICs, i.e.
  • Fig. 6 shows a television signal capturing system 600.
  • the components of the present invention are in the exemplary embodiment incorporated in a camera 601, but could of course reside elsewhere in the system 600.
  • a picture is captured and processed (e.g. white point calibration) by a picture derivation unit 611. It is assumed in this simplistic example that no compression occurs yet, although the skilled person should be able to incorporate this in the system.
  • Grain is added corresponding to a preference (a master seed SM for the f ⁇ rstmost position of the first line LF) with an electronic image processing device for synthetic grain addition (501) according to the present invention.
  • a video signal may be constructed on the basis of the captured picture(s) and the master seed(s) SM (there may be different seeds for e.g. different shots). This signal may be sent to a network 620 or stored in a memory 621, such as e.g. a blu-ray disk.
  • the algorithmic components disclosed in this text may in practice be (entirely or in part) realized as hardware (e.g. parts of an application specific IC) or as software running on a special digital signal processor, or a generic processor, etc.
  • the computer program product should be understood any physical realization of a collection of commands enabling a processor -generic or special purpose-, after a series of loading steps (which may include intermediate conversion steps, like translation to an intermediate language, and a final processor language) to get the commands into the processor, to execute any of the characteristic functions of an invention.
  • the computer program product may be realized as data on a carrier such as e.g. a disk or tape, data present in a memory, data traveling over a network connection -wired or wireless- , or program code on paper.
  • characteristic data required for the program may also be embodied as a computer program product.

Abstract

A method for deterministic film grain addition, e.g. to video signals compressed in a way that the grain is lacking. The method of electronic image processing comprises: determining a first random value (Rl) corresponding to a first horizontal pixel position (hi) in a vertically positioned first horizontal line (Ll) of an inputted picture (PIC) ; and - deriving a resultant value (R) for a second horizontal pixel position (h2) in a vertically positioned second horizontal line (L2) , the resultant value depending on the first random value and a second random value (R2) corresponding to the second horizontal pixel position in the second horizontal line, random values for horizontally neighboring pixel positions being determined by successive outputs of a single random generator initialized with a seed, wherein the first random value is determined with a first random generator (nl) initialized with a first seed (Sl) for a firstmost horizontal pixel position in the first horizontal line (fl) , and the second random value is determined with a second random generator (n2) running in parallel with the first random generator, and initialized with a second seed (S2) for a firstmost horizontal pixel position in the second horizontal line (f2) , which second seed (S2) is substantially equal to a random value obtained by applying the first random generator (nl) for the firstmost horizontal pixel position in the second horizontal line (f2) after having consecutively been applied to all horizontal positions on a left-right-top- bottom zig-zag scan path (ZZ) being initialized with the first seed (Sl) and starting from the firstmost horizontal pixel position in the first horizontal line (fl) . The advantage is lower memory requirements for deterministic film grain addition.

Description

ELECTRONIC IMAGE PROCESSING METHOD AND DEVICE WITH LINKED RANDOM GENERATORS
The invention relates to a method of electronic image processing using randomly generated values, in particular a synthetic grain generation method.
The invention also relates to an apparatus for electronic image processing using randomly generated values, and an electronic image processing device for synthetic grain addition, a picture decompression device, a television signal receiving apparatus and a television signal capturing system comprising such an electronic image processing device.
The invention also relates to a computer program product comprising code describing the method enabling a processor to perform its functionality.
There are a number of image processing methods which need random values for their functioning. In particular synthetic grain generation is such an image processing method. Synthetic grain may e.g. be added to a picture captured by a CCD camera to make it look like a picture captured on celluloid film. Also, in modern picture and video compression (e.g. the advanced video coding standard AVC), the efficiency of compression of film material is reduced by the presence of grain. Since film grain is not (temporarily) correlated, it requires many bits to accurately compress it. Therefore, it has been proposed remove the grain prior to encoding and to synthesize artificial grain at the decoder side. This has been standardized in the fidelity range extension of H.264 as Film Grain Management (FGM).
In particular, they propose a frequency filtering model, which outperforms an autoregressive model for larger grains.
In particular it is desirable that the grain is generated in a deterministic way. This means that although it looks random, this grain is a random pattern which is generated by at least one seed which looks the same on each receiving/rendering device. This is what the content providers like the Hollywood film studios desire: they can observe at their production site whether the grain looks acceptable according to their criteria (e.g. not too coarse, not interfering with particular fine-textured image content, such as people in the background or text, etc.), and can then force everybody to use their approved seeds, which gives a guaranteed rendering quality.
E.g. non-prepublished application EP 04101141.2 describes such a grain synthesis system, embodiment details of which (such as possible random generators which can be used) will be referred to and not repeated in this application, as it should be clear to the skilled person which combinations can be made.
It is a disadvantage that a direct hardware implementation of FGM with the frequency filtering model is quite complex. This means that a hardware realization needs a large area on a chip, resulting in high costs. To avoid the usage of the Discrete Cosine Transform (DCT), one can use an implementation in which pre-generated blocks of grain are used. However, storage of these blocks in e.g. 40 kByte SRAM also requires a large surface on chip (~1 mm2 = ~ 1/5 of a complete H.264 decoder).
It is an object of the invention to provide a method of electronic image processing using randomly generated values which needs relatively little memory resources.
This object is realized in that the method comprises: determining a first random value (Rl) corresponding to a first horizontal pixel position (hi) in a vertically positioned first horizontal line (Ll) of an inputted picture (PIC); and deriving a resultant value (R) for a second horizontal pixel position (h2) in a vertically positioned second horizontal line (L2), the resultant value depending on the first random value and a second random value (R2) corresponding to the second horizontal pixel position in the second horizontal line, random values for horizontally neighboring pixel positions being determined by successive outputs of a single random generator initialized with a seed, wherein the first random value is determined with a first random generator (nl) initialized with a first seed (Sl) for a firstmost horizontal pixel position in the first horizontal line (fl), and the second random value is determined with a second random generator (n2) running in parallel with the first random generator, and initialized with a second seed (S2) for a firstmost horizontal pixel position in the second horizontal line (f2).
A straightforward way to implement a deterministic grain synthesis is to send a single seed for the first image line LF and then to generate all the random values for consecutive pixels in a left-to-right, top-to-bottom zigzag scan. However the grain at horizontal position h2 in line L2 may e.g. depend on two vertically above generated random values for the same horizontal position h2. This means that at a certain moment in time, when the final grain value for (h2,L2) is being determined, those previously required random values are required, i.e. one needs to store in line memories two additional lines of samples. To have the right correlation length of the grain, one needs e.g. 8 vertical neighbors or more.
It is not possible to just use a number of random generators in parallel (with arbitrary seeds), since than the grain is not deterministic/content provider-accepted, but random (for each different receiver/rendering apparatus). With the invention the random generators can be run in parallel at the time the particular vertically neighboring random values are needed for a pixel at position (h2, L2), this avoiding the line memories. Of course to have a content provider-acceptable grain look, the seeds cannot be just anything, but need to be verified.
E.g. if the picture has height H, H seeds can be sent with the picture signal. An embodiment of the method comprises: determining a first random value (Rl) corresponding to a first horizontal pixel position (hi) in a vertically positioned first horizontal line (Ll) of an inputted picture (PIC); and deriving a resultant value (R) for a second horizontal pixel position (h2) in a vertically positioned second horizontal line (L2), the resultant value depending on the first random value and a second random value (R2) corresponding to the second horizontal pixel position in the second horizontal line, random values for horizontally neighboring pixel positions being determined by successive outputs of a single random generator initialized with a seed, wherein the first random value is determined with a first random generator
(nl) initialized with a first seed (Sl) for a firstmost horizontal pixel position in the first horizontal line (fl), and the second random value is determined with a second random generator (n2) running in parallel with the first random generator, and initialized with a second seed (S2) for a firstmost horizontal pixel position in the second horizontal line (f2), which second seed (S2) is substantially equal to a random value obtained by applying the first random generator (nl) for the firstmost horizontal pixel position in the second horizontal line (f2) after having consecutively been applied to all horizontal positions on a left-right-top- bottom zig-zag scan path (ZZ) being initialized with the first seed (Sl) and starting from the firstmost horizontal pixel position in the first horizontal line (fl). It is preferable if the content provider need not bother by such implementation issues as whether the receiver will use the single master seed approach with a zig-zag scanning and the required line memories, or whether the receiver will work according to the present invention: he will e.g. just send his single master seed SM, irrespective of what grain rendering method is used.
According to the present invention, the required N seeds can be evaluated at the receiving side prior to applying the N random generators in parallel. Because the single seed random generation goes through each line consecutively, the random value at the beginning of a line (firstmost point), being used for generating the next random values (i.e. which can be interpreted as a seed for that line) can hence be simply obtained by running the random generator so many times from its firstmost/starting point (the first pixel on the first line LF) until the present line firstmost point is reached. This can be done quickly to determine all H seeds for all lines, and then the actual image processing can begin.
The random generators than run substantially in parallel, e.g. if one needs to calculate the resultant value (R) for position h2, and the grain is determined based on two previous and the current line (and for simplicity of argument no horizontal neighbors) then the preferred construction has three random generators outputting a value for this h2 position, namely the first for (h2,L0), the second for (h2,Ll) and the third for (h2, L2). A simple FIR filter may then be employed for weighted adding of these three random values. A typical image processing method is synthetic grain generation, and the grain may depend on the underlying pixel values of an inputted picture at the positions for which a random value is being generated, e.g. a DC term in a block-transform compressed picture.
An input picture may be uncompressed (e.g. just a zigzag scanned set of pixel values between 0 and 255) or obtainable after decompressing a compressed representation (e.g. MPEG-2, AVC, JPEG, ...)■ The method may then be performed in a picture compression device, which is e.g. a part of a dedicated IC, or a software module running on a processor.
A FIR filter-only generation requires almost no memory, but many calculations because a long FIR filter may be required. Alternatively a combination realization may be made wherein a part of the filter is realized as a FIR (generating a local/high frequency correlation of the grain) and a part is realized as an HR (realizing the long-distance/low frequency correlation due to its integration properties). In such a combination no more than two line memories need to be used, which is still considerably less than e.g. 8. The image processing device and the picture processing device is advantageously incorporated in a television signal receiving apparatus, which is arranged to receive a television signal from a network (e.g. wireless terrestrial television, or a telephone network), and process it, in particular add grain. The television signal receiving apparatus may e.g. comprise a display to also display the signal, or may be a separate unit such a settopbox. It may be a portable apparatus such as a wireless phone. It may also comprise storage functionality, e.g. a personal video recorder, which adds the grain to a received television signal before storing it in a memory.
The television signal receiving apparatus may also be e.g. a disk reader, in which case the television signal is received from its storage on a disk, which only contains the non-grainy, smooth picture and a seed.
These and other aspects of the method and apparatus according to the invention will be apparent from and elucidated with reference to the implementations and embodiments described hereinafter, and with reference to the accompanying drawings, which serve merely as non-limiting specific illustrations exemplifying the more general concept, and in which dashes are used to indicate that a component is optional, non-dashed components not necessarily being essential. In the drawings:
Fig. 1 schematically shows a picture for explaining the method; Fig. 2 schematically shows a prior art FIR grain synthesis device; Fig. 3 schematically shows an embodiment of a FIR grain synthesis device according to the invention; Fig. 4 schematically shows an embodiment of a grain synthesis device with an
HR filter part according to the invention;
Fig. 5 schematically shows a picture decompression apparatus comprising an electronic image processing device according to the invention; and
Fig. 6 schematically shows a television signal capturing system according to the invention.
Fig. 1 shows the geometrical setup of the random resultant value R generation as a function of the geometrical pixel positions of an inputted picture PIC. The random values may be needed for any image operation, e.g. a recoloring for implementing an artistic effect depending on the underlying picture content and the random value, a genetic algorithm based image operation, etc. In the remainder we limit the description of the system to the particular application of grain synthesis, as the skilled person can easily incorporate the basic random value generation part into other image processing functions.
A resultant value is needed for a pixel position (h2, L2) (second cross). If the random process is not local to a pixel, the generated random values for neighboring pixels are required, typically for horizontal as well as vertical neighbors. An alternative to the frequency space method is to generate the grain in the time domain using Finite Impulse Response (FIR) filters and/or recursive (HR) filters. Grain that has been generated in this way has approximately the same statistical properties as the grain generated with the DCT. In this way both the large memory and the DCT are not needed. To get visually similar results, a FIR filter of quite high order q is needed
(-8-16).
Application of this filter in the vertical direction with the prior art single seed method requires line memories equal to the order of the filter, i.e. e.g. for lines Ll, LO, .... For High Definition material, this requires = 8(order)* 1920(horizontal res)*2(bytes per pixel) = 32 kByte.
The input of the FIR/IIR filter is white noise (with a particular amplitude, e.g. Fv(I), Fv(2), ... generated on the basis of pixel values of underlying and possibly neighboring pixels or blocks) that is generated using a pseudo-random generator. If this white noise is generated sequentially using a single random generator, the result has to be stored in line memories. In the method of the present invention instead q (the FIR filter order) random generators are used in parallel to generate the input for the as they are needed by the filter. By initializing all random generators by the right seed, the output of this filter can be made identical to the random numbers generated by a single pseudo-random generator.
An example of a random generator known from literature is based on m registers with an exor feedback from the lsb side to the msb. The length m determines the length of repetition of the random value and should therefore be large. The last n lsb bits form the n bits random value. The random generator can be made deterministic by resetting the register at a certain moment, e.g. beginning of the sequence, to a so-called seed number. Fig. 2 shows a prior art filter 200 to filter the pseudo random noise, coming from e.g. the exor pseudo random noise generator 203, in both vertical and horizontal direction by means of a (horizontally/vertically) separable filter. The number of FIR filter order q is here 2k+l. In order to filter in the vertical direction 2k line memories are required of n bits. The vertical filtered results are the m bits results of the summation by adder 202 of the 2k+l FIR multipliers (261, 262, ...) in vertical FIR filter 210. This intermediate result RV is then fed to the horizontal filter stage 280, which is formed by 2*k registers (i.e. the blocks like 201 are delays) and the FIR multipliers and a summation. The costs are dominated by the cost of the 2*k line memories (251, 252, 253, ...)■ As said before, these memory costs can be avoid by using the method/device of the present invention.
In Fig. 3, the signals as produced by the line memories of fig 2 are now produced by separate pseudo random generators 301, 303 etc.. In order to produce the exact same values as in fig 2, during a pre-calculation, 2k+l seeds are calculated in such a way that the successive seeds have a 'shift' of the length w of the line memories. This means e.g. that seed s(l) has the value of the output of a random generator initialized with seed(O) 1920 sample moments later.
The vertical part of the decomposable FIR filtering is realized with vertical FIR filter 311. Vertically adjacent determined random values are multiplied with coefficients Fv(-k+l) etc., which coefficients e.g. follow a Gaussian or exponential decreasing pattern. The so weighted random values are added in an adder. This procedure is done consecutively for horizontally neighboring pixels. A so obtained value for a horizontal position h-1 is delayed by delay 201 and the vertical FIR filtered random value for horizontal position h is then determined, etc. Finally, this neighboring vertical resulting values are weighed and added in a horizontal FIR filter 313, yielding the final resultant value (R).
The parallel execution of the random generators 301, 303, ... is under the control of a control means 380 (e.g. a processor running a software encoded control algorithm or a similar purely hardware realized means, etc.). The skilled person can find different prior art ways to construct such a control, e.g. with a means which outputs a clock signal CLK which triggers the random generation.
A slight disadvantage in FGM using the FIR filtering technique to generate low frequency noise is that relative large values for k are needed (e.g. >=8). Fig. 4 gives an alternative embodiment of the claimed invention which makes use of a combination of FIR (finite impulse response) & IIR (infinite impulse response) filter technique.
Although two line memories (an order 2 vertical IIR) is preferred, 1 line memory would be enough (one can also use higher order line memories, but this increases again the required memory, hence the trade-off should be a small order for the IIR part, so that the quality of the grain is enough).
Here k of the FIR part can be significantly smaller (=<4), while only a few line memories are needed. The vertical FIR filter part is similar as in the embodiment of Fig. 3, but fewer filter taps may be used.
The filter works as follows. At a certain horizontal position h2, a resultant vertically FIR filtered value RV2 is obtained. This value RV2 is added by adder 499 to previously determined values RVl and RVO. The values are properly weighed (by multipliers 480, 481 ) by filter coefficients Fvr(- 1 ), Fvr(-2) and (by multiplier 482) 1 / ΣFvr , so that the result doesn't overflow outside the [0,255] interval, and although there is correlation, there is only a limited memory, so that the noise generated adapts to new circumstances, such as e.g. different underlying grey values (obviously the method can be expanded to color pictures).
This addition (now having a contribution of at least three vertical positions) is saved in an upper line memory 451. All memories shift synchronously with the vertical FIR filter 311 to the next horizontal picture position. In this way after W positions have been processed, the horizontal position h2 is up for processing again, i.e. in the long run this device implements a vertical IIR filter (having decreasing contributions of pixels in the vertical past). Similarly unit 413 realizes a horizontal IIR filter, which is of course optional, as one can also use a pure FIR filter horizontally.
In this embodiment the clock signal CLK of the control means 380 also controls the shifting of the samples in the line memories (and the writing into it of a newly determined vertically filtered random value) in synchrony with the random generation. Fig 5 shows an example of a picture decompression device 500, which may be comprised in a television signal receiving apparatus 560 in the exemplary embodiment e.g. a settopbox connected to a display 561 (wired or wirelessly).
A picture decompression unit 502 is arranged to decompress a compressed picture inputted from a network 550 into an uncompressed image signal PIC. The picture decompression unit 502 may be further arranged to provide the DC values of the compressed picture to e.g. a memory unit 570, which may e.g. comprise a look-up table evaluation unit for converting these DC values to appropriate weighing factors Fv, Fh, Fvr, ... .
The seed and grain generation parameters (i.e. the constants of the filtering, which determine the grain look) is typically encoded in a so-called Supplemental enhancement information (SEI) message.
This SEI information is passed by the picture decompression unit 502 to a seed dispenser 580, which may e.g. be embodied as a seed calculator which is arranged pre- calculate the initial seed values based on e.g. a single master seed SM for the firstmost pixel of the first line LF, and pass them to the electronic image processing device 312 when required by the random generators.
The SEI interpreter also sends the grain look determining parameters to the memory unit 570 to determine the correct lookup table filter parameters.
The lookup table contains the relation of the luma intensity and grain parameters to the filter coefficients Fv, Fh, Fvr & Fhr and noise strength value S FGM.
Via a multiplier 599 the noise strength value S FGM controls the amplitude of the filtered noise output which is added by adder 510 to the video content of the PIC.
Instead of generating a grain value for each pixel position, a coarser scale grain picture may be generated (which can be done in either or both of the horizontal and vertical directions) and subsequently interpolated, preferably by a zero order hold (i.e. copying of the previous value). Such a zero order hold is a good approximation for slowly varying functions (i.e. low frequency grain).
This has as the advantage that with only an 8 taps filter an effective correlation length of 16 taps can be made. I.e., e.g. for each second or third pixel a value is calculated, and it is then copied to e.g. its horizontal neighbor(s).
For the vertical direction the following options are possible: either an extra line memory is used for containing the picture grey values for at least a fraction of the width of the picture, and the resulting grain value is added to the grey values e.g. 4 times in a 2x2 block (i.e. both to the current pixel and the one stored in the extra grain value) the same is possible in memory access which is not typical zigzag line based, e.g. block or random access a currently preferred option (because at present only little memory is available in e.g. decompressors or other image processing ICs, i.e. one wants to process the pixel and get it into processor external memory as quickly as possible) is that the same (zero order holded) grain value is calculated twice (and added only to the local pixels in processor memory). This can be done by resetting the seed for the second of a pair of lines.
Note that this subsampled grain synthesis is not the same as performing a [1 0 1 0 1 ...] filtering for each consecutive pixel, as this would lead to uncorrelated neighboring pixels.
Fig. 6 shows a television signal capturing system 600. The components of the present invention are in the exemplary embodiment incorporated in a camera 601, but could of course reside elsewhere in the system 600. A picture is captured and processed (e.g. white point calibration) by a picture derivation unit 611. It is assumed in this simplistic example that no compression occurs yet, although the skilled person should be able to incorporate this in the system. Grain is added corresponding to a preference (a master seed SM for the fϊrstmost position of the first line LF) with an electronic image processing device for synthetic grain addition (501) according to the present invention. The camera operation, director of photography, artistic post-producer etc. can look at the result on a display 603, which may form part of the camera, or be connected somewhere else in the system 600, and possibly display the grain added result at a time instant later than the camera capturing. If the responsible person agrees with the result, a video signal may be constructed on the basis of the captured picture(s) and the master seed(s) SM (there may be different seeds for e.g. different shots). This signal may be sent to a network 620 or stored in a memory 621, such as e.g. a blu-ray disk.
The algorithmic components disclosed in this text may in practice be (entirely or in part) realized as hardware (e.g. parts of an application specific IC) or as software running on a special digital signal processor, or a generic processor, etc.
Under computer program product should be understood any physical realization of a collection of commands enabling a processor -generic or special purpose-, after a series of loading steps (which may include intermediate conversion steps, like translation to an intermediate language, and a final processor language) to get the commands into the processor, to execute any of the characteristic functions of an invention. In particular, the computer program product may be realized as data on a carrier such as e.g. a disk or tape, data present in a memory, data traveling over a network connection -wired or wireless- , or program code on paper. Apart from program code, characteristic data required for the program may also be embodied as a computer program product.
Some of the steps required for the working of the method may be already present in the functionality of the processor instead of described in the computer program product, such as data input and output steps.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention. Apart from combinations of elements of the invention as combined in the claims, other combinations of the elements are possible. Any combination of elements can be realized in a single dedicated element. Any reference sign between parentheses in the claim is not intended for limiting the claim. The word "comprising" does not exclude the presence of elements or aspects not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements.

Claims

CLAIMS:
1. Method of electronic image processing comprising: determining a first random value (Rl) corresponding to a first horizontal pixel position (hi) in a vertically positioned first horizontal line (Ll) of an inputted picture (PIC); and - deriving a resultant value (R) for a second horizontal pixel position (h2) in a vertically positioned second horizontal line (L2), the resultant value depending on the first random value and a second random value (R2) corresponding to the second horizontal pixel position in the second horizontal line, random values for horizontally neighboring pixel positions being determined by successive outputs of a single random generator initialized with a seed, wherein the first random value is determined with a first random generator (nl) initialized with a first seed (Sl) for a firstmost horizontal pixel position in the first horizontal line (fl), and the second random value is determined with a second random generator (n2) running in parallel with the first random generator, and initialized with a second seed (S2) for a firstmost horizontal pixel position in the second horizontal line (f2).
2. Method of electronic image processing as claimed in claim 1, in which the second random generator (n2) is initialized with the second seed (S2) being substantially equal to a random value obtained by applying the first random generator (nl) for the firstmost horizontal pixel position in the second horizontal line (f2) after having consecutively been applied to all horizontal positions on a left-right-top-bottom zig-zag scan path (ZZ) and being initialized with the first seed (Sl) and starting from the firstmost horizontal pixel position in the first horizontal line (fl).
3. Method of electronic image processing as claimed in claim 1 or 2, wherein the deriving a resultant value (R) is part of generating a random synthetic grain value for the second horizontal pixel position in the second horizontal line, and which generating a random synthetic grain value further comprises adding the synthetic grain value to a pixel value of an inputted image in the second horizontal pixel position in the second horizontal line, to yield a grainy output picture (GRN).
4. Method of electronic image processing as claimed in claim 3, in which the synthetic grain value is dependent on a value of the inputted image in the first horizontal pixel position in the first horizontal line and the second horizontal pixel position in the second horizontal line.
5. Method of electronic image processing as claimed in claim 3 or 4, in which the synthetic grain value is generated on a reduced resolution compared to a resolution of the inputted image, and second synthetic grain values are generated on the resolution of the inputted image by interpolation prior to the adding the synthetic grain value to a pixel value of the inputted image.
6. An electronic image processing device (312) comprising: a) A first random generator (301) arranged to determine a first random value (Rl) corresponding to a first horizontal pixel position (hi) in a vertically positioned first horizontal line (Ll) of an inputted picture (PIC); b) A second random generator (303) arranged to determine a second random value (R2) corresponding to a second horizontal pixel position (h2) in a vertically positioned second horizontal line (L2); the first random generator (301) and second random generator (303) being arranged to determine random values for horizontally neighboring pixel positions by successive outputs of the respective single random generator and the electronic image processing device (312) being arranged to initialize the first random generator (301) with a first seed (Sl) for a firstmost horizontal pixel position in the first horizontal line (fl) and to initialize the second random generator (303) with a second seed (S2) for a firstmost horizontal pixel position in the second horizontal line (f2). c) A derivation means (310) arranged to derive a resultant value (R) for the second horizontal pixel position (h2) in the vertically positioned second horizontal line (L2), the resultant value depending on the first random value and the second random value; and d) control means (380) arrangeable to control the first and second random generator to determine the first and second random value substantially in parallel.
7. An electronic image processing device (312) as claimed in claim 6, comprising a seed calculator (580) arrangeable to determine the second seed (S2) substantially equal to a random value obtained by applying the first random generator for the firstmost horizontal pixel position in the second horizontal line (f2) after having consecutively been applied to all horizontal positions on a left-right-top-bottom zig-zag scan path (ZZ) and being initialized with the first seed (Sl) and starting from the firstmost horizontal pixel position in the first horizontal line (fl).
8. An electronic image processing device for synthetic grain addition (501) comprising an electronic image processing device (312) as claimed in claim 6 or 7 usable for generating a synthetic grain, and further comprising an adder (510) arranged to add the synthetic grain value to a pixel value of the inputted picture (PIC) in the second horizontal pixel position in the second horizontal line, and arranged to yield a grainy output picture (GRN).
9. A picture decompression device (500) comprising a picture decompression unit (502) arranged to decompress an image compressed according to a picture compression standard (COM) into an uncompressed picture representation (PIC), the picture decompression unit (502) being coupled to an electronic image processing device (312) as claimed in claim 6 or 7 or an electronic image processing device for synthetic grain addition (501) as claimed in claim 8.
10. An electronic image processing device (312) as claimed in claim 6 or 7, wherein the derivation means (310) comprises a FIR filter (311, 313) for deriving the resultant value (R) as a weighted sum of random values determined corresponding to neighboring pixels.
11. An electronic image processing device (312) as claimed in claim 6 or 7, wherein the derivation means (310) comprises a HR filter (411, 413) for deriving the resultant value (R) as a function of random values determined corresponding to neighboring pixels.
12. An electronic image processing device (312) as claimed in claim 6 or 7, wherein the derivation means (310) comprises a non- linear function evaluation means for deriving the resultant value (R) as a non- linear function of random values determined corresponding to neighboring pixels.
13. A television signal receiving apparatus (560) comprising an electronic image processing device (312) as claimed in claim 6 or 7 or a picture decompression apparatus
(500) as claimed in claim 9.
14. A television signal capturing system (600) comprising a camera (601) arranged to capture a picture, and an electronic image processing device for synthetic grain addition (501) as claimed in claim 8 arranged to process the picture.
15. A computer program product comprising a processor readable code to enable a processor to execute the method according to claim 1, the processor readable code comprising: a) code for determining a first random value (Rl) corresponding to a first horizontal pixel position (hi) in a vertically positioned first horizontal line (Ll), with a first random generator unit initialized with a first seed (Sl) for a firstmost horizontal pixel position in the first horizontal line (fl); b) code for determining a second random value (R2) corresponding to a second horizontal pixel position (h2) in a vertically positioned second horizontal line (L2), with a second random generator unit initialized with a second seed (S2) for a firstmost horizontal pixel position in the second horizontal line (f2); the first random generator unit and second random generator unit being coded to determine random values for horizontally neighboring pixel positions by successive outputs of the respective single random generator; c) code for deriving a resultant value (R) for a second horizontal pixel position in a vertically positioned second horizontal line, the resultant value depending on the first random value and a second random value (R2) corresponding to the second horizontal pixel position in the second horizontal line; and d) control code to determine the second random value in parallel with the first random value.
16. A computer program product comprising a processor readable code to enable a processor to execute the method according to claim 2, the processor readable code comprising: a) code for determining a first random value (Rl) corresponding to a first horizontal pixel position (hi) in a vertically positioned first horizontal line (Ll), with first random generator unit initialized with a first seed (Sl) for a firstmost horizontal pixel position in the first horizontal line (fl); b) code for determining a second random value (R2) corresponding to a second horizontal pixel position (h2) in a vertically positioned second horizontal line (L2), with a second random generator unit initialized with a second seed (S2) for a firstmost horizontal pixel position in the second horizontal line (f2); the first random generator unit and second random generator unit being coded to determine random values for horizontally neighboring pixel positions by successive outputs of the respective single random generator; c) code for deriving a resultant value (R) for a second horizontal pixel position in a vertically positioned second horizontal line, the resultant value depending on the first random value and the second random value; d) control code to determine the second random value in parallel with the first random value; and e) seed determining code to determine the second seed (S2) as substantially equal to a random value obtained by applying the first random generator (nl) for the firstmost horizontal pixel position in the second horizontal line (f2) after having consecutively been applied to all horizontal positions on a left-right-top-bottom zig-zag scan path (ZZ) being initialized with the first seed (Sl) and starting from the firstmost horizontal pixel position in the first horizontal line (fl).
PCT/IB2005/054011 2004-12-08 2005-12-02 Electronic image processing method and device with linked random generators WO2006061751A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
BRPI0518462-2A BRPI0518462A2 (en) 2004-12-08 2005-12-02 Electronic image processing method and device, figure decompression device, television signal reception apparatus, television signal capture system, and, computer program product
US11/720,839 US20090231345A1 (en) 2004-12-08 2005-12-02 Electronic image processing method and device with linked random generators
JP2007545031A JP2008523680A (en) 2004-12-08 2005-12-02 Electronic image processing method and apparatus using connected random generators
EP05822478A EP1825683A1 (en) 2004-12-08 2005-12-02 Electronic image processing method and device with linked random generators

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP04106397.5 2004-12-08
EP04106397A EP1670255A1 (en) 2004-12-08 2004-12-08 Electronic image processing method and device with linked random generators

Publications (1)

Publication Number Publication Date
WO2006061751A1 true WO2006061751A1 (en) 2006-06-15

Family

ID=34930020

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2005/054011 WO2006061751A1 (en) 2004-12-08 2005-12-02 Electronic image processing method and device with linked random generators

Country Status (7)

Country Link
US (1) US20090231345A1 (en)
EP (2) EP1670255A1 (en)
JP (1) JP2008523680A (en)
KR (1) KR20070100279A (en)
CN (1) CN101073270A (en)
BR (1) BRPI0518462A2 (en)
WO (1) WO2006061751A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100926911B1 (en) 2007-10-05 2009-11-17 주식회사 알티캐스트 Method and system for providing advertisement in digital broadcasting
DE102009045850A1 (en) 2009-10-20 2011-04-21 Voith Patent Gmbh Cutting device for use in machine for producing and/or processing e.g. paper web, has cutting unit pivotably supported around pivoting axis in machine transverse direction parallel to material web to be separated
US9036937B2 (en) 2010-11-15 2015-05-19 Qualcomm Incorporated Fast repeated integral images

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997022204A1 (en) * 1995-12-11 1997-06-19 Przyborski Glenn B Video system for simulation of motion picture film
US5641596A (en) * 1995-12-05 1997-06-24 Eastman Kodak Company Adjusting film grain properties in digital images

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4115806A (en) * 1975-05-23 1978-09-19 Bausch & Lomb Incorporated Image analysis data transfer
JP4931587B2 (en) * 2003-09-23 2012-05-16 トムソン ライセンシング A method of simulating film grain using frequency filtering
US7680356B2 (en) * 2003-10-14 2010-03-16 Thomson Licensing Technique for bit-accurate comfort noise addition
US20070117291A1 (en) * 2003-12-05 2007-05-24 Thomson Licensing Technique for film grain simulation using a database of film grain patterns
BRPI0516614B1 (en) * 2004-10-18 2020-08-18 Interdigital Vc Holdings, Inc FILM GRANULATION SIMULATION METHOD

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5641596A (en) * 1995-12-05 1997-06-24 Eastman Kodak Company Adjusting film grain properties in digital images
WO1997022204A1 (en) * 1995-12-11 1997-06-19 Przyborski Glenn B Video system for simulation of motion picture film

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
CHRISTINA GOMILA, ALEXANDER KOBILANSKY: "SEI message for film grain encoding", JVT OF ISO IEC MPEG AND ITU-T VCEG JVT-H022, 23 May 2003 (2003-05-23), GENEVA, SWITZERLAND, pages 1 - 14, XP002308742 *
CHRISTINA GOMILA: "SEI message for film grain encoding: syntax and results", JVT OF ISO IEC MPEG AND ITU-T VCEG JVT-I013 REVISION 2, 2 September 2003 (2003-09-02), SAN DIEGO, CA, USA, pages 1 - 11, XP002308743 *
FREDERICKSON P ET AL: "PSEUDO-RANDOM TREES IN MONTE CARLO", PARALLEL COMPUTING, ELSEVIER PUBLISHERS, AMSTERDAM, NL, vol. 1, no. 2, 1984, pages 175 - 180, XP001029469, ISSN: 0167-8191 *
GISLE BRONTEGAARD: "Addition of comfort noise as post processing", ITU STUDY GROUP 16 - VIDEO CODING EXPERTS GROUP, 8 September 1997 (1997-09-08), pages 1 - 2, XP002319278 *
MIURA K ED - BALCI O ET AL: "Vectorization and parallelization of transport Monte Carlo simulation codes", SIMULATION CONFERENCE, 1990. PROCEEDINGS, WINTER NEW ORLEANS, LA, USA 9-12 DEC. 1990, NEW YORK, NY, USA,IEEE, US, 9 December 1990 (1990-12-09), pages 722 - 730, XP010011211, ISBN: 0-911801-72-3 *

Also Published As

Publication number Publication date
EP1670255A1 (en) 2006-06-14
EP1825683A1 (en) 2007-08-29
JP2008523680A (en) 2008-07-03
BRPI0518462A2 (en) 2008-11-18
US20090231345A1 (en) 2009-09-17
KR20070100279A (en) 2007-10-10
CN101073270A (en) 2007-11-14

Similar Documents

Publication Publication Date Title
CN100574433C (en) Be used for reducing the method and apparatus of the pseudomorphism of video flowing
EP0629330B1 (en) Video companding method and system
WO1992017036A1 (en) Improved method and apparatus for coding motion pictures
JPH04284087A (en) Electronic still camera
JP2007521573A (en) A method for simulating film grain by mosaicking pre-calculated samples
JP2005204195A (en) Image processing apparatus and method, recording medium, and program
WO2005112467A1 (en) Method and device for encoding blocks of values
WO2004077357A1 (en) Apparatus and method for producing thumbnail images and for improving image quality of re-sized images
US20090231345A1 (en) Electronic image processing method and device with linked random generators
JP2012085214A (en) Data compression method and data compression device
EP3837843A1 (en) Image processing noise reduction
EP0462261A1 (en) Video telephone systems
JPH0795591A (en) Digital picture signal processing unit
US8180169B2 (en) System and method for multi-scale sigma filtering using quadrature mirror filters
JPH0888849A (en) Picture signal processing method and picture signal transmitter
JPH0951532A (en) Distortion removing device
CA1192997A (en) Bilevel coding of colour video signals
JP2001016591A (en) Compression encoder and compression encoding method
KR100195124B1 (en) Picture quality enhancement method and circuit thereof based on the quantized mean-separate histogram equalization of a low pass filtered signal
JP2900620B2 (en) Image transmission processing system
JP3869893B2 (en) Encoding device, decoding device and method thereof
JP3826495B2 (en) Image signal processing apparatus and method
JP4402657B2 (en) Imaging device
JP3004335B2 (en) Noise reduction device
KR100587164B1 (en) Method and apparatus for coverting equal interval vertical image as CIF image convert into NTSC image

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KN KP KR KZ LC LK LR LS LT LU LV LY MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2007545031

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2005822478

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 11720839

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 200580042329.3

Country of ref document: CN

Ref document number: 2452/CHENP/2007

Country of ref document: IN

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 1020077015517

Country of ref document: KR

WWW Wipo information: withdrawn in national office

Ref document number: 2005822478

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2005822478

Country of ref document: EP

ENP Entry into the national phase

Ref document number: PI0518462

Country of ref document: BR