WO1998011510A1 - Processing image data - Google Patents
Processing image data Download PDFInfo
- Publication number
- WO1998011510A1 WO1998011510A1 PCT/IB1997/001104 IB9701104W WO9811510A1 WO 1998011510 A1 WO1998011510 A1 WO 1998011510A1 IB 9701104 W IB9701104 W IB 9701104W WO 9811510 A1 WO9811510 A1 WO 9811510A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- color
- space
- pixel
- distance
- base
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/74—Circuits for processing colour signals for obtaining special effects
- H04N9/75—Chroma key
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/001—Texturing; Colouring; Generation of texture or colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
Definitions
- the present invention relates to a method and apparatus for digitally compositing video image data, wherein first image frames are derived from a required foreground image recorded against an unrequired background image such that a compositing or blending process results in said unrequired background being replaced by a new background image.
- Similar techniques have been employed with television and video signals, originally using analog circuitry arranged to process analog television signals, either represented as red green and blue components or as luminance plus chrominance components.
- part of the signal may be removed or keyed out at particular times defined by a synchronised key signal or, alternatively, parts of the video signal may be suppressed to black in response to a suppression signal.
- keying signals and suppression signals traditionally have been derived from part of the video signal itself, possibly the luminance signal or possibly the chrominance signals.
- techniques for generating these signals have become known as luminance keying (luma-keying) and chrominance keying (chroma-keying) respectively.
- video signals have been manipulated as digital representations where image frames are sampled to produce an array of picture elements (pixels) with each pixel representing a color defined by three color components stored as three numerical values.
- pixels picture elements
- eight bits may be allocated for red green and blue color components at each pixel position or, in accordance with alternative processing schemes, similar allocations of bits may be made for luminance plus color difference signals.
- scanned cinematographic film has been processed in an RGB environment with digitized television signals being processed in a luminance plus color difference signal environment, usually identified as YUV.
- General purpose processing environments have also tended towards a preference for RGB signal processing. Since cinematographic film is of higher color definition, typically 12 bits per color component are used, giving rise to 4096 possible colors per color component. Chroma-keying techniques are exploited both in film post-production and television post- production.
- Image frames for a foreground image may be derived by recording talent against a background of a particular color, with a highly saturated blue or a highly saturated green being particularly preferred. Required portions of the foreground image should not include colors used in the background image during the production process.
- a subsequent post production compositing process may then be configured to automatically replace the unrequired background image with a new background image.
- a key signal is generated at regions identified as belonging to the foreground object which is then used to remove the foreground object from its background.
- the post production compositing is highly accurate, it is possible to produce highly realistic illusions which, from a safety point of view, would not be possible to record directly as a real production sequence. Often, video or film material will have been recorded, for keying purposes, under less than favourable conditions.
- blending edges are required which represent the interface between the foreground object and the new background, where a degree of blending must occur so as to enhance the realism of the effect. If blending of this type does not occur and hard transitions exist on pixel boundaries, visible artefacts will be present within the image and it will be clear to anyone viewing the resulting clip that the two image parts originated from separate sources.
- a problem with known systems is that it may be difficult to adjust color volumes so as to ensure that all key colors are within an internal volume and all non-key colors are outside an external volume, with the required blending regions being outside the internal volume, but inside the external volume.
- video will be used to identify any image signal consisting of a sequence of image frames arranged to create the effect of moving action.
- high resolution cinematographic film may be digitised to produce image data which is then be considered herein as "video data", although not conforming to establish video protocols, when used in the narrower sense.
- a method of processing image data in which each image has a plurality of pixels and each pixel is represented by three color components defining a position within a color-space, comprising steps of identifying a base color; calculating a distance in color-space between an input color and said base color; and producing a control value in relation to said calculated distance.
- the color-space co-ordinates represent positions on an orthogonal set of axes and said distance is calculated from the sum of each component squared. Preferably, said value is calculated from the square root of said sum.
- color-space co-ordinates are transformed onto an alternative set of orthogonal axes. Preferably, the transformation is performed with reference to said base color.
- the base color is determined from a set of manually selected colors and said base color may be derived from said set by forming a convex hull around said selected colors in color-space.
- control value is used to suppress in areas of color spill.
- control value is used to generate a keying signal and said keying signal may include a tolerance region and a softness region.
- image data processing apparatus including means for defining image pixels representing color components of a color-space, comprising means for identifying a base color; calculating means for calculating distance in color-space between an input color and said base color; and means for producing a control value in relation to said calculated distance.
- Figure 1 shows a compositing station arranged to key foreground images against new required background images
- Figure 2 shows an example of a foreground image to be composited against a new required background, using the equipment identified in Figure
- Figure 3 illustrates the position of a base color within a three dimensional color-space said base color being identified on the unrequired background of the foreground image
- Figure 4 illustrates a compositing process in which a foreground image is composited with a background image, including processes for key generation and color suppression;
- Figure 5 details a portion of the image illustrated in Figure 2;
- Figure 6A details displayed colors representing individual pixels o
- Figure 6B identifies the distance in KAB color-space between a scanned pixel of the foreground image and the KAB co-ordinate system origin;
- Figure 7 details the steps involved in key generation process 405, including a step for identifying the base color of the unrequired background and a step for applying a condition required in generation of the matte;
- Figure 8 details the step identified in Figure 7 relating to identification of the unrequired background or base color
- Figure 9 details the step identified in Figure 7 relating to application of a condition used in generation of the matte
- Figure 10 details a relationship between calculated color distance values and output values stored as matte data, the Figure showing color distances in a softness zone which provide a grey level output;
- FIGS 11A and 11B detail the operation of the color suppression process shown in Figure 4.
- Figures 12A and 12B illustrate the relocation of co-ordinate axes in color space as performed in the color suppression process identified in Figure 11 ;
- FIGS. 13A, 13B and 13C illustrate transformation calculations performed in the color suppression process
- Figure 14 details a typical color suppression curve for a scanned portion of unrequired background on a foreground image
- Figure 15 details color-space transformation matrices
- Figure 16 illustrates determination of the maximum color suppression value utilized in the color suppression process shown in Figure 4.
- Figure 17 details procedures for adjustment of hue and saturation as performed in the color suppression process shown in Figure 11 ;
- Figure 18 illustrates procedures followed in luminance restoration as performed in the color suppression process shown in Figure 11 ;
- Figure 19 shows procedures involved in the adjustment of R, G and B color components following luminance restoration shown in Figure 16.
- FIG. 1 A compositing station is shown in Figure 1 , in which digital representations of image frames are processed within an image data processing system 101.
- the processing system 101 responds to manual operation of a stylus 102 against a touch table 103 and supplies image data to a monitor 104, in the form of control menus and image clips.
- An operator may also supply data to the processing system 101 via a manually operable keyboard 105 and images are supplied to processing device 101 from video player 106.
- FIG. 2 An example of an image frame displayed on monitor 104 is shown in Figure 2.
- the foreground image scene has been recorded onto cinematographic film in a studio, in which the required foreground talent has been recorded against a saturated blue background.
- the film has been digitized and a compositing process, effected by system 101 , is arranged to remove the unrequired background and to replace it with a new background image.
- the digitized samples consist of an array of picture elements (pixels) representing red, green and blue color components which are then displayable to the operator, on monitor 104, as a video sequence.
- this video sequence is stored on substantially randomly accessible magnetic disks, to facilitate non-linear editing and compositing.
- red, green and blue components may be visualized as orthogonal coordinates in a three dimensional color-space.
- color space may be specified by alternative sets of co-ordinates and relationships between co-ordinate sets may be mathematically defined by means of functional transformations, which in turn may be represented by transformation matrices.
- a color space may be qualified by a particular co-ordinate set such that each coordinate within the space has a particular value defining a particular color.
- This same color may be defined by an alternative co-ordinate set by applying a matrix transformation upon the numerical values representing the color.
- the co-ordinate set may undergo a transformation in color space.
- the actual color itself remains the same and it is merely its representation under an alternative co-ordinate system which changes.
- a known alternative co-ordinate set in common usage is the subtractive color set of cyan, yellow, magenta and black (CYMK) used for printing.
- CYMK subtractive color set of cyan, yellow, magenta and black
- color space is that of luminance plus color difference.
- the luminance axis may be considered as the axis of constant red, green and blue, with color difference values, or hue and saturation values, being defined at positions on planes perpendicular to the luminance axis.
- color space defined in terms of luminance, hue and saturation, represents a cylindrical color space, where hue is defined as an angle with respect to the luminance axis.
- an infinity of color spaces are definable, each having a respective transformation matrix, such that color defined in a first color space may be transformed to a second color space, under the operation of the transformation matrix.
- the actual color and its conceptualisation as space remain constant with its co-ordinate and it is the co-ordinate definitions which change in accordance with the matrix transformations.
- color components are recorded as three components representing the primary colors red green and blue (RGB) with eight bits being assigned to each of these components.
- each RGB color may be identified as belonging to one of three regions in color space.
- the first region represents the full key color of the background which will often be a relatively small volume of colors having a relatively high blue component with relatively low red and green components. Surrounding this volume of colors will be the region of colors where a transition is to occur.
- This set will have blue values that are relatively lower than the hard key set, with red and green values that are relatively higher.
- This set of color values represent pixels where a key will have an intermediate value (between 1 and 254 in an eight bit system), so as to provide a degree of blending between the foreground object and the new background.
- a region of color space will exist representing allowed foreground values. In this region, all of the foreground image will be composited with no blending through to the background.
- RGB color space This arrangement of color values within an RGB color space is illustrated in Figure 3.
- a three dimensional color space is illustrated in which any point within the space is defined by orthogonal co-ordinates representing red, green and blue components.
- axis 301 represents the intensity of the red component
- axis 302 represents the intensity of the green component
- axis 303 represents the intensity of the blue component.
- every pixel within the image may be mapped onto a region within the RGB color space.
- the value of RGB (0,0,0) represents black (point 304) and the value of RGB (1 ,1 ,1 ) represents pure white of maximum intensity (point 305).
- the compositing process consists of compositing the foreground image with the background image and therefore it is necessary to provide a foreground image source 401 in combination with a background image source 402. These images are processed on a pixel by pixel basis and on a frame by frame basis. Color keying of this type is particularly attractive if associated data (the key or matte) may be established which allows a plurality of frames within the clip to be keyed in a single pass. Thus, after y
- control parameters have been established for a particular frame, the same control parameters may be employed for the other frames within the clip, thereby allowing the compositing procedure to be effected at a rate which is much faster than that attainable when generating keys manually.
- keying may be effected using a key generated by external equipment and therefore provision is made for an external key to be supplied to the process, as illustrated at 403.
- a key selector 404 is provided which, as shown in its left orientation, is configured to allow a key signal or matte to be generated from the foreground image source 401.
- an external key signal is supplied to a key (or matte) generation process 405, although the extent of processing carried out within process 405 will depend upon the quality of the external key supplied to the system.
- the system operates under the assumption that colors may be defined by three mutually orthogonal axes; effectively defining color as positions in three dimensional Cartesian RGB color-space.
- this selected color value is supplied to a color suppression process 406 as shown in Figure 4, although other colors may be selected as part of this process.
- a color suppression process 406 as shown in Figure 4, although other colors may be selected as part of this process.
- the output from color suppression process 406 and the background image from 402 are supplied to a blending process 407.
- the blending process is arranged to select an input from 406, an input from 402 or a mixture of these two inputs in response to the key signal generated by the key generation process 405.
- an operator views a selected frame within a video clip.
- a portion of the background is selected, such as portion 201 shown in Figure 2, thereby identifying the selected base color to process 405.
- This background base color should be totally removed from the composite image and replaced with a new background, possibly derived from another video clip.
- the process is complicated by areas of the image where a soft key is required. These include areas such as the wine bottle 202, glass 203 and regions such as region 204, around the guitarists hair.
- Region 204 is illustrated in Figure 5 and shows an 8 x 8 pixel array of key values.
- the key values are illustrated as ranging between zero and one, where the base color will produce a key value of zero, effectively black, with other regions producing key values greater than zero, up to a maximum of unity.
- most of the pixels have been set to a value of zero, representing the presence of the background base color.
- many of the pixels such as pixel 501 and pixel 502 have a value which is very close to zero, thereby resulting in a level of blending being introduced between the foreground image and the composited background image.
- the key is a monochrome image representing how a composite image is derived from background and foreground images.
- the key controls which part of the background and which part of the foreground is to be taken in order to render the corresponding pixel in the resulting image.
- the key for a given pixel is completely white, only the foreground image is taken for the resulting pixel and when the key is completely black only the background is taken for the resulting pixel.
- the resulting pixel will be derived from a percentage of the corresponding foreground pixel and a percentage of the corresponding background pixel.
- Figure 6A details displayed colors in RGB color-space corresponding to individual pixels scanned from a foreground image comprising a required foreground shot against a blue background.
- Red, green and blue color component axes, 601 , 602 and 603 respectively are shown with origin 604.
- a central point 605 has been determined as representing the blue background, following initial selection of an area of the blue background by manual operations performed by the operator.
- Point 605 represents the average color of the blue screen which is never perfectly blue but a mix of blue, green and red where blue is the dominant color.
- Point 605 now forms the origin of a new orthogonal coordinate system with axes K, A and B respectively. Pixels derived from the required foreground image are displaced from the blue screen color, origin 605.
- Regions are established around point 605.
- Region 606 is identified as a tolerance zone; bounded by a surface 607.
- Region 608 is identified as a softness zone, bounded by a further outer surface 609.
- the tolerance zone 606 corresponds to pixels that have RGB color components required to produce a corresponding black matte pixel. Pixels that lie on the surface of the tolerance zone, 607, similarly are required to produce a black matte pixel. All pixels that lie outside the softness zone, that is outside surface 609, are required to produce white matte pixels. In-between surfaces 607 and 609 scanned pixels of the foreground image represent transition pixels which are required to have a level of grey so as to blend foreground and background images in a realistic way.
- the grey levels depend on the distance in color space of the scanned pixel from the color space origin.
- the KAB axes are defined relative to the new origin 605 and in accordance with the axes of the ellipse, said ellipse for example being represented by surface 607.
- the K axis is situated along the major axis of the ellipse as shown.
- Figure 6 simply represents the scanned pixel colors in two dimensions, on three-dimensional axes for the purpose of illustration.
- ellipse 607 and ellipse 609 are three-dimensional ellipsoids.
- Ellipsoids bounded by surfaces 607 and 609 are displayed on video monitor 104, allowing a video graphics artist (as shown in Figure 1 ) to interactively modify the tolerance and softness surfaces. Thus the video artist may observe certain groups of displayed color data lying close to or on surfaces 607 and 609.
- Figure 6B illustrates color-space distance of a scanned pixel of the foreground image from the origin of the KAB color-space co-ordinate system shown in Figure 6A.
- the color of the scanned pixel is represented by the point 610.
- This point lies at a distance 611 from the origin 605 and has color components, x, y and z respectively.
- the distance 611 is given by Pythagoras's theorem in three-dimensions, equation 612.
- the distance 611 is given by the square root of the sum of the squares of the color distance components.
- this equation that is used for calculating distances in color-space relative to a transformed origin.
- RGB color-space it may be preferable to calculate color space distances in RGB color-space.
- a matrix transformation to transform RGB space into KAB color-space where the origin defines the position of the key color is not required. If color-space transformation is not incorporated then calculation of color distances will not be relative to an origin and the color distances of scanned pixel points will be relative to the non-zero point representing the color of the unrequired background. Thus without coordinate transformation the values that are squared in equation 611 will correspond to differences in each color component between the point corresponding to the scanned pixel and the point corresponding to the color of the unrequired background.
- Figure 7 illustrates the generation of the key signal by key generation process 405.
- processor 101 is instructed to get a foreground clip (clip A) to be processed.
- clip A a frame of clip A is read and at step 703 a question is asked as to whether selection parameters are to be set up. If the question asked at step 703 is answered in the affirmative, a base color is identified at step 704 and a forward transformation matrix ( F) is calculated. Following step 704, the tolerance level may be adjusted in response to instructions provided by the operator, as indicated at step 705. If the question asked at 703 is answered in the negative. Following selection of the pixel, the forward transformation matrix
- MF is applied to the current pixel being processed at step 707, resulting in co-ordinate axes being transformed from RGB color-space to KAB color- space; said axes being defined in Figure 6.
- a key generation condition is applied to the given pixel to create a resulting key pixel which is stored.
- the pixel in question is displayed in RGB color-space, as shown in Figure 6.
- a question is asked as to whether there is another pixel in the current frame to be processed. If the question asked at step 710 is answered in the affirmative control returns to step 706 wherein the next pixel for the frame is selected and steps 707, 708 and 709 are repeated. If the question asked at step 710 is answered in the negative a further question fs asked at step 711 as to whether the frame is to be reprocessed.
- step 702 This question may be answered by the video artist shown in Figure 1 and if answered in the affirmative control is returned to step 702 wherein the frame is retrieved and reprocessed in accordance with the steps thereafter. If the question asked at step 711 is answered in the negative a further question is asked at step 712 as to whether there is another frame in the clip to be processed. If this question is answered in the affirmative, control is returned to step 702 wherein the next frame is read. If the question asked at 712 is answered in the negative, the process for the generation of the key signal is terminated at step 713.
- Procedure 704 for the identification of a base color representing the background of the foreground image is detailed in Figure 8.
- the video artist selects background color points using a color picker or stylus 102 on a touch tablet 103.
- the selected points, specified as RGB components are stored in a buffer.
- processor 101 obtains the next point stored in the buffer.
- the point selected at step 803 is processed so as to form part of a 3-D convex hull.
- a convex hull is the smallest convex surface that contains a given set of points.
- a set of points is convex if for any two points in the set, the points on a straight line segment joining the two points are also contained within the set.
- step 804 a question is asked at step 805 as to whether there are further selected points to be processed. If this question is answered in the affirmative, control is returned to step 802 wherein steps 802 to 805 are repeated. If the question asked at step 805 is answered in the negative, processor 101 reads a sampled pixel at step 806. A sampled pixel represents a pixel color that has been selected by the video artist. The selected colors are then considered one by one such that only positions in color-space which actually lie on the surface of a three dimensional convex hull are retained. Thus, a question is asked at step 807 as to whether the point lies on the surface of the hull. If the question is answered in the affirmative, control is passed to step 808 wherein the point is stored.
- step 809 a further question is asked as to whether there are any other points to be processed. If this question is answered in the affirmative control is returned to step 806 wherein another convex hull point is read and steps 807 to 809 are repeated. If the question asked at step 807 is answered in the negative control is passed to step 809, the point identified not being stored in this case. If the question asked at step 809 is answered in the negative, to the effect that there are no further points in the generated convex hull to be processed, control is passed to step 810 where the centre of the convex hull is calculated. At this point it is also possible to display the shape of the convex hull. Following step 810 a matrix transformation (MF) is generated such that the origin of a new co-ordinate system, the KAB co-ordinate system shown in Figure 6, is determined as the centre of the convex hull.
- MF matrix transformation
- Step 708 identified in Figure 7 relating to application of a matte generation condition with resulting storage of a matte pixel is detailed in Figure 9.
- the current pixel under consideration expressed in KAB co-ordinates, is processed so as to determine the distance of the pixel's color from the convex hull centre.
- the distance of the color of this pixel is given by Pythagoras' theorem as the square root of the sum of the squares of the color components, wherein the color component distances are the distances in KAB color space as identified in Figure 6B.
- a question is asked as to whether the color distance calculated at step 901 is less than or equal to the tolerance level set by the video artist at step 705.
- step 903 If this question is answered in the affirmative control is passed to step 903 wherein the pixel generated for the key is stored as a black pixel and thus represents a point on the blue screen background. If the question asked at step 902 is answered in the negative, control is passed to step 904 wherein a question is asked as to whether the distance calculated at step 901 is greater than or equal to unity. This question corresponds to whether the calculated distance is greater than or equal to the surface defining the outer surface of the softness zone, surface 609 shown in Figure 6A.
- step 906 a grey level is calculated using a look-up table for the current pixel.
- questions resulting in step 906 being implemented are equivalent to a pixel being identified whose color lies in the softness region 608 shown in Figure 6. Such a pixel may lie on an object boundary and thus will not be appropriate for setting to either black or white. In this case a level of blending is required.
- the boundary pixel is stored ⁇ r .
- Pixels identified as background pixels are stored as black matte pixels at step 903 and pixels identified as required foreground image pixels are stored as white matte pixels at step 905.
- Step 705 relating to adjustment of a tolerance level is detailed in Figure 10.
- the tolerance zone 606 is bounded by surface 607 and the softness zone 608 is bounded by surface 609.
- Figure 10 is an example of a function defining the grey level of key pixels resulting from a calculated distance, R.
- a tolerance level T is defined by a user and provides a limit in terms of calculated distance below which an output key pixel is set to black. Thus calculated distances less than or equal to this limit are output as black on the key.
- the value T corresponds to the upper limit of color distances for which the current pixel being processed is considered to be part of the unrequired background of the foreground image.
- the softness zone is defined as those color distances greater than T, but less than unity.
- Pixels being processed which have associated color distances within these bounds are processed such that the resulting output key pixel is given a grey level defined by function 1001.
- the output key pixel is set to white and in this case takes the value of the foreground image pixel color.
- the function shown is by way of example only and other similar functions may be defined by the video artist. Thus the video artist may adjust the tolerance level T and also the nature of the function between the limits T and unity. Thus for example a non-linear relationship may be provided between input color distance values and output grey levels for the resulting matte pixels.
- the first matrix may represent tolerance, which is positioned within a second ellipsis representing softness.
- the two ellipses may have different orientations and different centres. They are substantially independent; the only limitation being to the effect that the tolerance ellipsis must be inside the softness ellipsis.
- control value When a matte is being generated, the control value will represent black if the processed pixel lies inside the tolerance ellipsis. Similarly, the matte value will be set to white if the pixel under consideration lies outside the softness ellipsis. In-between, the level of softness will depend upon the distance between the two ellipses calculated in the direction of a normal vector relative to the centre of the tolerance ellipsis.
- First image frames are derived from a foreground image comprising a required foreground image recorded against an unrequired background, such that a compositing process results in the unrequired background being substantially replaced by a new required background image.
- the procedure comprises the following basic steps. Firstly, as described a base color of the unrequired background is identified and defined in three-dimensional color- space. Secondly the foreground image data is processed to determine distance data which represents the distance in color-space of the foreground image data from the identified color. Thirdly the foreground image data is processed with reference to the distance data to produce associated data. The associated data is generally known as the alpha matte or key signal data. Finally the image data, comprising both the foreground and background images, is processed in combination with the associated data to produce output or composite data.
- a base color is identified which, by default, may be the same color specified for the key generation process 405. Alternatively the base color may be specifically identified for this process, by the video artist selecting pixels on the unrequired background using stylus 102 on touch tablet 103.
- the video artist is provided with the opportunity to set color suppression curves for defining the degree of color suppression to be performed for particular hues.
- the foreground image is scanned and at step 1104 the next pixel in the scanned foreground image is selected.
- the luminance of the selected pixel, Lo is calculated in accordance with the definition of luminance in RGB color-space.
- the value of the pixel luminance is given by the R, G and B components wherein each component is multiplied by a particular constant.
- the red component is multiplied by 0.299
- the green component is multiplied by 0.587
- the blue component is multiplied by 0.114.
- the hue of the selected pixel is calculated first to determine the position in terms of color on the color suppression curves set in step 1102.
- Hue represents the actual color, such as red, green, purple etc.
- a color suppression factor is determined.
- the co-ordinates of the selected pixel are transformed from RGB color- space to an orthogonal KAB color-space.
- a value is calculated for the K color component. This value represents the value of the K color component for which the corresponding blue component is equal to the minimum of either the red component or the green component. This value acts as an upper limit on the amount of suppression that can be applied to the given pixel and therefore is alternatively called the clamping level.
- a question is asked as to whether the maximum allowed suppression is less than the user defined suppression value, that is whether the suppression factor is greater than the maximum value for the pixel under consideration. If this question is answered in the affirmative, a final color suppression value is calculated. This value is calculated at step 1110 and is equal to the maximum value plus an additional quantity. The additional quantity is given by one tenth of the difference between the user value and the maximum value. If the question asked at step 1109 is answered in the negative, such that the value is not greater than the calculated maximum value, the final suppression value is set equal to the user defined value, that is, it is set to the user value as indicated at step 1111.
- the K color component for the pixel is modified in accordance with the final suppression value calculated.
- the K color component value is calculated as the original K color component value minus the K color component value multiplied by the final color suppression value.
- the modified KUV co-ordinates of the current pixel are transformed back to RGB color-space.
- the RGB components resulting will be modified due to procedures performed at steps 1109 to 1112.
- step 1113 the hue and saturation of the final RGB components are adjusted, at step 1114, in accordance with values provided by user defined colour curves.
- step 1115 the luminance of the resulting colour of a pixel under consideration is similarly adjusted in accordance with luminance curves.
- gain adjustments are performed on the R, G and B color components, again using values provided by corresponding curves.
- step 1117 a modified pixel is stored and at step 1118 a question is asked as to whether there is another pixel to be processed. If this question is answered in the affirmative, control is returned to step 1104 wherein the next pixel is selected. Alternatively if the question asked at step 1118 is answered in the negative a further question is asked at step 1119 as to whether there is another frame in the clip to be processed. If this question is asked in the affirmative, control is returned to step 1101. However if the question asked at step 1119 is answered in the negative, all of the frames in the clip have been processed and the session relating to color suppression is terminated at step 1120.
- Color-space considered by the color suppression process 406 at step 1107 in Figure 11 is illustrated in Figure 12A.
- Particular colors are specified in terms of their red, green and blue components, which may be represented as x, y and z orthogonal axes 1201, 1202 and 1203.
- a base color has been selected which, preferably, should lie at maximum extent upon the blue axis 1203. However, the selected base color will tend to be slightly off-set from this preferred position and its actual co-ordinate locations may be identified as red being equal to 0.1 , green being equal to 0.05 and blue being equal to 0.9.
- colors within the color-space are redefined with reference to a new orthogonal K, A, B set of axes, as shown in Figure 12B.
- the K axis is rotated such that it now intersects the identified base color 1204 which is now identified as a new color-space co-ordinate K.
- the axes maintain their orthogonal relationship, resulting in similar transformations being effected on the A and B axes.
- colors within the color-space may now be defined with reference to the new co-ordinate frame where each location consists of three components specified as the K in combination with an A component and a B component.
- the transformation of the new color-space definition is completed by scaling the axes so that the selected position 1204 occupies a co-ordinate location of 1 , 0, 0 in the new co-ordinate frame. This scaling is effected uniformly throughout the reference frame, so as to achieve similar scaling with respect to the A and B axes.
- the transformation required in order to move the red, green and blue axes onto the KAB axes (which in accordance with transformation theory may require two rotations and a scaling operation to be performed) is calculated such that the mathematical transformation, possibly defined in terms of a transformation matrix, may be applied to other colors within an input video source such that these colors are defined in terms of KAB color- space as an alternative to being defined in RGB color-space.
- the particular nature of the rotation will depend upon the dominant component of the identified base color. If the dominant component of the selected base color is blue, the rotation of axes RGB is performed about the green axis, followed by rotation about the red axis. The angles of rotation about these respective axes are calculated in accordance with the equations shown in Figure 13(a).
- a temporary variable C is calculated, following Pythagoras, by calculating the square root of the sum of the blue component squared plus the red component squared.
- the value of the angle of rotation about the green axis is then calculated by negating the arc cosine of the blue component value divided by the temporary variable C. This is followed by rotation about the red axis, as illustrated in Figure 13(a).
- the positive arc cosine is determined from the result of dividing temporary variable C by the square root of C 2 plus the green value squared. Finally, the whole space is scaled by dividing by the blue component value.
- Window 1401 comprises three rows, 1402, 1403 and 1404 respectively.
- Row 1402 displays the colors identified as components of the unrequired background color.
- Rows 1402 and 1403 are subdivided into columns 1405 representing red, 1406 representing orange, 1407 representing yellow, 1408 representing green, 1409 representing blue, 1410 representing indigo and 1411 representing violet.
- columns 1405 to 1411 represent a continuous color spectrum.
- curve 1412 representing said identified colors
- the most dominant color in the background has a hue, h, slightly off-set from the centre of the blue column 1409. Other hues are incorporated in the scanned background color and therefore a distribution of colors is observed.
- Row 1403 displays a curve generated by the computer to negate the background color distribution 1412.
- the color suppression curve 1413 is calculated as the inverse of curve 1412. Curve 1413 may be modified through commands issued by the video operator via the control buttons present in row 1404. Curve 1413 may therefore be modified in response to actions performed by the operator to manipulate the position of the screen pointer (cursor) 1414. Thus cursor 1414 may be moved down or up in response to the video operator selecting the down-arrow button 1415 or up-arrow button 1416 respectively. Similarly the operator may move cursor 1414 in the left or right direction via selection of buttons 1417 and 1418 respectively.
- Button 1419 is a save button so that the manipulations performed to curve 1413 by the video operator may be saved for use in processing a video frame currently being processed.
- Buttons 1420 to 1422 are standard window buttons relating respectively to decreasing window size (1420), increasing window size (1421 ) and closing the window (1422). Thus after the video operator has specified desirable modifications to the color suppression curve 1413 the window may be closed by the operator clicking on button 1422 via use of a mouse. Color-space transformations effected by color suppression process
- step 1107 in Figure 11 relating to transformation of pixel RGB co-ordinates to KAB- space is effected by a forward transformation matrix 1501 which operates on pixel color component data including control data 1502 to produce new co- ordinate data 1503.
- step 1108 to 1112 in Figure 11 KAB color-space information 1503 is transformed using a matrix 1504 to create color suppressed or final RGB data 1505.
- the backwards matrix 1504 is effectively the inverse matrix of forward matrix 1501.
- step 1108 Calculation of clamping levels for maximum suppression values for a K color component of a given pixel being processed occurs at step 1108 in Figure 11. This step is performed in accordance with the matrix manipulations identified in Figure 16.
- the maximum suppression is defined as the final blue component wherein said component is equal to the minimum of either the final red component or the final green component.
- BF is set equal to RF.
- the final blue component is given by the sum of the K, A and B color components, each said component multiplied by the appropriate backward matrix element given by matrix 1505.
- the blue component occurring in the third row of matrix 1505 is given by the third row of matrix
- step 1603 the corresponding value of the K component for the case when the final blue component is equal to the final red component is given by equating the two equations shown in step 1602.
- step 1604 the maximum suppression, SUPPJvlAX is calculated.
- SUPP_MAX is calculated as equal to the K component for the case when the blue component is equal to the red component divided by the K component for the current pixel, the resulting value being subtracted from unity.
- the calculation required to yield the value for SUPP_MAX is detailed in step 1605.
- FIG. 1701 pixel components represented in RGB color-space are transformed to representations in hue, luminance and saturation (HLS) space.
- HLS luminance and saturation
- the pixel is re-transformed back into RGB color-space.
- Process 1115 for the adjustment of luminance is detailed in Figure 18.
- a new luminance value is calculated from new components of R, G and B.
- the new luminance value is derived from scaling factors for each of the red, green and blue components which, as shown in Figure 18, consist of 0.299 for red, 0.587 for green and 0.114 for blue.
- a difference dl_ is calculated by subtracting the new luminance value from the previous luminance value. Thereafter, at step 1803 pixel luminance values are compensated by adding appropriately scaled components with respect to the difference value calculated at step 1802.
- Process 1116 for performing gain adjustments is detailed in Figure 19.
- a red component of the pixel is adjusted in accordance with manually defined color curves.
- the green component is adjusted and at step 1903 the blue component is adjusted.
- the present embodiments allow for chroma-key, chroma-matte and chroma-suppress signals to be generated from sophisticated manipulations performed within absolute color-space. This is particularly useful when effecting post-production procedures to generate alpha signals or control signals from source material that has been recorded under less than ideal conditions. It can reduce the number of passes required in order to generate a chroma-key and, ultimately, may allow keys to be generated from source material which would not otherwise allow for keying of this type.
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP97939109A EP0873552A1 (en) | 1996-09-12 | 1997-09-12 | Processing image data |
US09/068,421 US6445816B1 (en) | 1996-09-12 | 1997-09-12 | Compositing video image data |
GBGB9809851.0A GB9809851D0 (en) | 1996-09-12 | 1998-05-11 | Processing image data |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GBGB9619119.2A GB9619119D0 (en) | 1996-09-12 | 1996-09-12 | Processing image |
GB9619119.2 | 1996-09-12 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO1998011510A1 true WO1998011510A1 (en) | 1998-03-19 |
Family
ID=10799868
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB1997/001104 WO1998011510A1 (en) | 1996-09-12 | 1997-09-12 | Processing image data |
Country Status (5)
Country | Link |
---|---|
US (1) | US6445816B1 (en) |
EP (1) | EP0873552A1 (en) |
CA (1) | CA2237265A1 (en) |
GB (1) | GB9619119D0 (en) |
WO (1) | WO1998011510A1 (en) |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2336055A (en) * | 1998-04-01 | 1999-10-06 | Discreet Logic Inc | Chroma-keying system including modified matte softness region |
GB2336054A (en) * | 1998-04-01 | 1999-10-06 | Discreet Logic Inc | Deriving matte control signal in a chroma-keying system |
GB2336056A (en) * | 1998-04-01 | 1999-10-06 | Discreet Logic Inc | Chroma-keying system including modified matte control data for softness region |
US6128001A (en) * | 1997-04-04 | 2000-10-03 | Avid Technology, Inc. | Methods and apparatus for changing a color of an image |
WO2000063839A1 (en) * | 1999-04-16 | 2000-10-26 | Avid Technology, Inc. | Method and system for spill correction |
WO2000064189A2 (en) * | 1999-04-16 | 2000-10-26 | Avid Technology, Inc. | Safe color limiting of a color on a digital nonlinear editing system |
EP1056052A2 (en) * | 1999-04-26 | 2000-11-29 | Adobe Systems, Inc. | User-defined erasure brush for modifying digital image |
WO2000075870A1 (en) * | 1999-06-08 | 2000-12-14 | Panja, Inc. | System and method for multimedia display |
US6429875B1 (en) | 1998-04-02 | 2002-08-06 | Autodesk Canada Inc. | Processing image data |
US6434267B1 (en) * | 1998-03-26 | 2002-08-13 | Rolls-Royce Plc | Interpretation of thermal paint |
US6445816B1 (en) | 1996-09-12 | 2002-09-03 | Autodesk Canada Inc. | Compositing video image data |
US6456300B1 (en) | 1999-03-31 | 2002-09-24 | Autodesk Canada Inc. | Method and apparatus for processing image data to produce control data |
US6924821B2 (en) | 2000-04-01 | 2005-08-02 | Autodesk Canada Inc. | Processing pipeline responsive to input and output frame rates |
US7315646B2 (en) * | 2003-04-05 | 2008-01-01 | Autodesk Canada Co. | Degraining image data |
US9063739B2 (en) | 2005-09-07 | 2015-06-23 | Open Invention Network, Llc | Method and computer program for device configuration |
GB2610027A (en) * | 2021-06-18 | 2023-02-22 | Nvidia Corp | Pixel blending for neural network-based image generation |
Families Citing this family (66)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8396328B2 (en) | 2001-05-04 | 2013-03-12 | Legend3D, Inc. | Minimal artifact image sequence depth enhancement system and method |
US7907793B1 (en) | 2001-05-04 | 2011-03-15 | Legend Films Inc. | Image sequence depth enhancement system and method |
US7417640B1 (en) | 1999-01-29 | 2008-08-26 | Lg Electronics Inc. | Method for dominant color setting of video region and data structure and method of confidence measure extraction |
US7391929B2 (en) | 2000-02-11 | 2008-06-24 | Sony Corporation | Masking tool |
JP3642258B2 (en) * | 2000-05-08 | 2005-04-27 | 松下電器産業株式会社 | Video composition device |
US6721453B1 (en) * | 2000-07-10 | 2004-04-13 | The Board Of Trustees Of The University Of Illinois | Method and apparatus for processing an image of an agricultural field |
US7092122B2 (en) * | 2000-07-18 | 2006-08-15 | Fuji Photo Film Co., Ltd. | Image processing device and method |
WO2002027659A2 (en) * | 2000-09-26 | 2002-04-04 | Advantage 3D Llc | Method and system for generation, storage and distribution of omni-directional object views |
JP3581835B2 (en) * | 2001-03-14 | 2004-10-27 | 株式会社イマジカ | Color conversion method and apparatus in chroma key processing |
US8897596B1 (en) | 2001-05-04 | 2014-11-25 | Legend3D, Inc. | System and method for rapid image sequence depth enhancement with translucent elements |
US9286941B2 (en) * | 2001-05-04 | 2016-03-15 | Legend3D, Inc. | Image sequence enhancement and motion picture project management system |
US7181081B2 (en) * | 2001-05-04 | 2007-02-20 | Legend Films Inc. | Image sequence enhancement system and method |
US8401336B2 (en) | 2001-05-04 | 2013-03-19 | Legend3D, Inc. | System and method for rapid image sequence depth enhancement with augmented computer-generated elements |
US9031383B2 (en) | 2001-05-04 | 2015-05-12 | Legend3D, Inc. | Motion picture project management system |
JP3733873B2 (en) * | 2001-06-07 | 2006-01-11 | ノーリツ鋼機株式会社 | Photo image processing apparatus, method, and photo processing apparatus |
US7092584B2 (en) * | 2002-01-04 | 2006-08-15 | Time Warner Entertainment Company Lp | Registration of separations |
US7127125B2 (en) * | 2002-01-04 | 2006-10-24 | Warner Bros. Entertainment Inc. | Registration of separations |
US6947607B2 (en) | 2002-01-04 | 2005-09-20 | Warner Bros. Entertainment Inc. | Reduction of differential resolution of separations |
US7319415B2 (en) * | 2002-05-01 | 2008-01-15 | Thomson Licensing | Chroma deblocking filter |
GB2388287B (en) * | 2002-05-04 | 2005-06-15 | Autodesk Canada Inc | Processing image data |
US7221785B2 (en) * | 2002-05-21 | 2007-05-22 | Agilent Technologies, Inc. | Method and system for measuring a molecular array background signal from a continuous background region of specified size |
KR20050005531A (en) * | 2002-06-03 | 2005-01-13 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Encoding and decoding of watermarks in independent channels |
US20040109014A1 (en) * | 2002-12-05 | 2004-06-10 | Rovion Llc | Method and system for displaying superimposed non-rectangular motion-video images in a windows user interface environment |
DE102004008223A1 (en) * | 2004-02-19 | 2005-09-15 | Henkel Kgaa | A method and apparatus for determining a target hair color for a source hair color of a hair area in a digital image after hair color change |
WO2005086984A2 (en) * | 2004-03-15 | 2005-09-22 | Sarnoff Corporation | Method and apparatus for providing noise reduction |
US7508455B2 (en) * | 2004-03-26 | 2009-03-24 | Ross Video/Live Production Technology | Method, system, and device for automatic determination of nominal backing color and a range thereof |
US8205154B2 (en) * | 2004-04-16 | 2012-06-19 | Apple Inc. | User definable transition tool |
US7262780B2 (en) * | 2004-08-23 | 2007-08-28 | Micron Technology, Inc. | Simple and robust color saturation adjustment for digital images |
CN100531291C (en) | 2004-11-01 | 2009-08-19 | 彩色印片公司 | Method and system for mastering and distributing enhanced color space content |
CN101346984B (en) * | 2005-12-21 | 2012-12-26 | 汤姆森特许公司 | Method for displaying colorful image and color display device for image |
US7715620B2 (en) * | 2006-01-27 | 2010-05-11 | Lockheed Martin Corporation | Color form dropout using dynamic geometric solid thresholding |
US8022964B2 (en) * | 2006-04-21 | 2011-09-20 | Apple Inc. | 3D histogram and other user interface elements for color correcting images |
US20070247647A1 (en) * | 2006-04-21 | 2007-10-25 | Daniel Pettigrew | 3D lut techniques for color correcting images |
US7693341B2 (en) * | 2006-04-21 | 2010-04-06 | Apple Inc. | Workflows for color correcting images |
US20090167843A1 (en) * | 2006-06-08 | 2009-07-02 | Izzat Hekmat Izzat | Two pass approach to three dimensional Reconstruction |
TW200830271A (en) * | 2007-01-04 | 2008-07-16 | Novatek Microelectronics Corp | Method and apparatus of color adjustment |
JP2008205871A (en) * | 2007-02-21 | 2008-09-04 | Megachips Lsi Solutions Inc | Imaging unit, portable terminal device, and portable terminal system |
US8264468B1 (en) | 2007-06-19 | 2012-09-11 | Imaging Systems Technology, Inc. | Touch system for blue screen |
US8330730B1 (en) | 2007-09-04 | 2012-12-11 | Imaging Systems Technology, Inc. | Calibrating of interactive touch system for image compositing |
CN102804204B (en) * | 2009-06-25 | 2015-07-01 | 皇家飞利浦电子股份有限公司 | Geture recognition using chroma- keying |
US8320666B2 (en) * | 2009-08-14 | 2012-11-27 | Genesis Group Inc. | Real-time image and video matting |
JP2011109245A (en) * | 2009-11-13 | 2011-06-02 | Renesas Electronics Corp | Image processor and image processing method |
US8649592B2 (en) | 2010-08-30 | 2014-02-11 | University Of Illinois At Urbana-Champaign | System for background subtraction with 3D camera |
US8582878B1 (en) * | 2010-11-03 | 2013-11-12 | Csr Technology Inc. | Purple fringing automatic detection and correction |
US8730232B2 (en) | 2011-02-01 | 2014-05-20 | Legend3D, Inc. | Director-style based 2D to 3D movie conversion system and method |
US20120210229A1 (en) * | 2011-02-16 | 2012-08-16 | Andrew Bryant | Color workflow |
US9288476B2 (en) | 2011-02-17 | 2016-03-15 | Legend3D, Inc. | System and method for real-time depth modification of stereo images of a virtual reality environment |
US9407904B2 (en) | 2013-05-01 | 2016-08-02 | Legend3D, Inc. | Method for creating 3D virtual reality from 2D images |
US9241147B2 (en) | 2013-05-01 | 2016-01-19 | Legend3D, Inc. | External depth map transformation method for conversion of two-dimensional images to stereoscopic images |
US9113130B2 (en) | 2012-02-06 | 2015-08-18 | Legend3D, Inc. | Multi-stage production pipeline system |
US9282321B2 (en) | 2011-02-17 | 2016-03-08 | Legend3D, Inc. | 3D model multi-reviewer system |
US9007365B2 (en) | 2012-11-27 | 2015-04-14 | Legend3D, Inc. | Line depth augmentation system and method for conversion of 2D images to 3D images |
US9547937B2 (en) | 2012-11-30 | 2017-01-17 | Legend3D, Inc. | Three-dimensional annotation system and method |
US9241128B2 (en) | 2013-02-14 | 2016-01-19 | Warner Bros. Entertainment Inc. | Video conversion technology |
US9007404B2 (en) | 2013-03-15 | 2015-04-14 | Legend3D, Inc. | Tilt-based look around effect image enhancement method |
US9438878B2 (en) | 2013-05-01 | 2016-09-06 | Legend3D, Inc. | Method of converting 2D video to 3D video using 3D object models |
US9485433B2 (en) | 2013-12-31 | 2016-11-01 | Personify, Inc. | Systems and methods for iterative adjustment of video-capture settings based on identified persona |
EP3032497A3 (en) * | 2014-12-09 | 2016-06-29 | Thomson Licensing | Method and apparatus for color correction |
US9916668B2 (en) | 2015-05-19 | 2018-03-13 | Personify, Inc. | Methods and systems for identifying background in video data using geometric primitives |
US9563962B2 (en) | 2015-05-19 | 2017-02-07 | Personify, Inc. | Methods and systems for assigning pixels distance-cost values using a flood fill technique |
US9609307B1 (en) | 2015-09-17 | 2017-03-28 | Legend3D, Inc. | Method of converting 2D video to 3D video using machine learning |
WO2017139367A1 (en) | 2016-02-08 | 2017-08-17 | Imago Systems, Inc. | System and method for the visualization and characterization of objects in images |
US9883155B2 (en) * | 2016-06-14 | 2018-01-30 | Personify, Inc. | Methods and systems for combining foreground video and background video using chromatic matching |
GB2551396B (en) * | 2016-06-17 | 2018-10-10 | Imagination Tech Ltd | Augmented reality occlusion |
CN106408632B (en) * | 2016-09-08 | 2019-10-25 | 广州阿里巴巴文学信息技术有限公司 | A kind of tone variations cartoon implementing method and device based on attribute animation |
US9881207B1 (en) | 2016-10-25 | 2018-01-30 | Personify, Inc. | Methods and systems for real-time user extraction using deep learning networks |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2681967A1 (en) * | 1991-10-01 | 1993-04-02 | Electronics For Imaging Inc | Process and apparatus for modifying the colours of an image with the aid of a computer |
US5301016A (en) * | 1991-12-21 | 1994-04-05 | U.S. Philips Corporation | Method of and arrangement for deriving a control signal for inserting a background signal into parts of a foreground signal |
US5347622A (en) * | 1991-04-12 | 1994-09-13 | Accom Inc. | Digital image compositing system and method |
US5455633A (en) * | 1992-09-03 | 1995-10-03 | U.S. Philips Corporation | Chromakey method for processing picture signals in which fading operations are performed in proportional zones based on a control signal |
EP0735511A2 (en) * | 1995-03-29 | 1996-10-02 | Dainippon Screen Mfg. Co., Ltd. | Method and apparatus for changing specified color in a color image |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2084833A (en) * | 1980-04-11 | 1982-04-15 | Ampex | System for spatially transforming images |
US4864388A (en) | 1983-03-28 | 1989-09-05 | Ole Skrydstrup | Chroma keyer color discriminator |
GB9002477D0 (en) * | 1990-02-05 | 1990-04-04 | Crosfield Electronics Ltd | Improvements relating to control data arrays |
BE1004659A5 (en) * | 1991-03-01 | 1993-01-05 | Barco Graphics Nv | METHOD AND APPARATUS FOR transforming a KLEURCOORDINATENSET. |
US5218432A (en) * | 1992-01-02 | 1993-06-08 | Tandy Corporation | Method and apparatus for merging video data signals from multiple sources and multimedia system incorporating same |
US5557688A (en) * | 1992-11-18 | 1996-09-17 | Fuji Photo Film Co., Ltd. | Method of extracting characteristic image data and color data conversion device for image processing apparatus |
US5696839A (en) * | 1993-04-08 | 1997-12-09 | Linotype-Hell Ag | Method and apparatus for reproducing an image employing a transformation of color solids |
US5585944A (en) * | 1994-05-10 | 1996-12-17 | Kaleida Labs, Inc. | Method for compressing and decompressing images by subdividing pixel color distributions |
US5630037A (en) * | 1994-05-18 | 1997-05-13 | Schindler Imaging, Inc. | Method and apparatus for extracting and treating digital images for seamless compositing |
EP0771107B1 (en) * | 1995-05-12 | 2002-12-11 | Sony Corporation | Key signal generating device, picture producing device, key signal generating method, and picture producing method |
EP0763928B1 (en) * | 1995-09-15 | 2001-10-10 | Agfa-Gevaert N.V. | Colour separation method and apparatus for same |
US5850472A (en) * | 1995-09-22 | 1998-12-15 | Color And Appearance Technology, Inc. | Colorimetric imaging system for measuring color and appearance |
US5812214A (en) * | 1996-03-14 | 1998-09-22 | Sierra Video Systems, Inc. | Apparatus and method for compositing video images |
US5852673A (en) * | 1996-03-27 | 1998-12-22 | Chroma Graphics, Inc. | Method for general image manipulation and composition |
US6046118A (en) * | 1996-08-02 | 2000-04-04 | E. I. Du Pont De Nemours And Company | Composite sheet material |
GB9619119D0 (en) | 1996-09-12 | 1996-10-23 | Discreet Logic Inc | Processing image |
-
1996
- 1996-09-12 GB GBGB9619119.2A patent/GB9619119D0/en active Pending
-
1997
- 1997-09-12 EP EP97939109A patent/EP0873552A1/en not_active Ceased
- 1997-09-12 CA CA002237265A patent/CA2237265A1/en not_active Abandoned
- 1997-09-12 WO PCT/IB1997/001104 patent/WO1998011510A1/en not_active Application Discontinuation
- 1997-09-12 US US09/068,421 patent/US6445816B1/en not_active Expired - Lifetime
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5347622A (en) * | 1991-04-12 | 1994-09-13 | Accom Inc. | Digital image compositing system and method |
FR2681967A1 (en) * | 1991-10-01 | 1993-04-02 | Electronics For Imaging Inc | Process and apparatus for modifying the colours of an image with the aid of a computer |
US5301016A (en) * | 1991-12-21 | 1994-04-05 | U.S. Philips Corporation | Method of and arrangement for deriving a control signal for inserting a background signal into parts of a foreground signal |
US5455633A (en) * | 1992-09-03 | 1995-10-03 | U.S. Philips Corporation | Chromakey method for processing picture signals in which fading operations are performed in proportional zones based on a control signal |
EP0735511A2 (en) * | 1995-03-29 | 1996-10-02 | Dainippon Screen Mfg. Co., Ltd. | Method and apparatus for changing specified color in a color image |
Cited By (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6445816B1 (en) | 1996-09-12 | 2002-09-03 | Autodesk Canada Inc. | Compositing video image data |
US6128001A (en) * | 1997-04-04 | 2000-10-03 | Avid Technology, Inc. | Methods and apparatus for changing a color of an image |
US6434267B1 (en) * | 1998-03-26 | 2002-08-13 | Rolls-Royce Plc | Interpretation of thermal paint |
GB2336054B (en) * | 1998-04-01 | 2002-10-16 | Discreet Logic Inc | Processing image data |
GB2336056B (en) * | 1998-04-01 | 2002-10-16 | Discreet Logic Inc | Image processing |
US6571012B1 (en) | 1998-04-01 | 2003-05-27 | Autodesk Canada Inc. | Adjusting a softness region |
US6496599B1 (en) | 1998-04-01 | 2002-12-17 | Autodesk Canada Inc. | Facilitating the compositing of video images |
GB2336055A (en) * | 1998-04-01 | 1999-10-06 | Discreet Logic Inc | Chroma-keying system including modified matte softness region |
GB2336055B (en) * | 1998-04-01 | 2002-10-16 | Discreet Logic Inc | Image processing |
GB2336056A (en) * | 1998-04-01 | 1999-10-06 | Discreet Logic Inc | Chroma-keying system including modified matte control data for softness region |
GB2336054A (en) * | 1998-04-01 | 1999-10-06 | Discreet Logic Inc | Deriving matte control signal in a chroma-keying system |
US6429875B1 (en) | 1998-04-02 | 2002-08-06 | Autodesk Canada Inc. | Processing image data |
US6456300B1 (en) | 1999-03-31 | 2002-09-24 | Autodesk Canada Inc. | Method and apparatus for processing image data to produce control data |
WO2000063839A1 (en) * | 1999-04-16 | 2000-10-26 | Avid Technology, Inc. | Method and system for spill correction |
WO2000064189A3 (en) * | 1999-04-16 | 2001-02-15 | Avid Technology Inc | Safe color limiting of a color on a digital nonlinear editing system |
US6553140B1 (en) * | 1999-04-16 | 2003-04-22 | Avid Technology, Inc. | Method and system for spill correction |
WO2000064189A2 (en) * | 1999-04-16 | 2000-10-26 | Avid Technology, Inc. | Safe color limiting of a color on a digital nonlinear editing system |
US6791573B2 (en) | 1999-04-26 | 2004-09-14 | Adobe Systems Incorporated | Smart erasure brush |
EP1056052A2 (en) * | 1999-04-26 | 2000-11-29 | Adobe Systems, Inc. | User-defined erasure brush for modifying digital image |
EP1056052A3 (en) * | 1999-04-26 | 2003-04-09 | Adobe Systems, Inc. | User-defined erasure brush for modifying digital image |
US7627168B2 (en) | 1999-04-26 | 2009-12-01 | Adobe Systems Incorporated | Smart erasure brush |
US7400763B2 (en) | 1999-04-26 | 2008-07-15 | Adobe Systems Incorporated | Smart erasure brush |
WO2000075870A1 (en) * | 1999-06-08 | 2000-12-14 | Panja, Inc. | System and method for multimedia display |
AU770034B2 (en) * | 1999-06-08 | 2004-02-12 | Harman Professional, Inc. | System and method for multimedia display |
US6657646B2 (en) | 1999-06-08 | 2003-12-02 | Amx Corporation | System and method for multimedia display |
US6924821B2 (en) | 2000-04-01 | 2005-08-02 | Autodesk Canada Inc. | Processing pipeline responsive to input and output frame rates |
US7315646B2 (en) * | 2003-04-05 | 2008-01-01 | Autodesk Canada Co. | Degraining image data |
US9063739B2 (en) | 2005-09-07 | 2015-06-23 | Open Invention Network, Llc | Method and computer program for device configuration |
GB2610027A (en) * | 2021-06-18 | 2023-02-22 | Nvidia Corp | Pixel blending for neural network-based image generation |
GB2610027B (en) * | 2021-06-18 | 2024-02-07 | Nvidia Corp | Pixel blending for neural network-based image generation |
Also Published As
Publication number | Publication date |
---|---|
EP0873552A1 (en) | 1998-10-28 |
US6445816B1 (en) | 2002-09-03 |
US20020025066A1 (en) | 2002-02-28 |
GB9619119D0 (en) | 1996-10-23 |
CA2237265A1 (en) | 1998-03-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6445816B1 (en) | Compositing video image data | |
US6496599B1 (en) | Facilitating the compositing of video images | |
EP0947956B1 (en) | Primary and secondary color manipulations using hue, saturation, luminance and area isolation | |
US6751347B2 (en) | Color diamond chroma keying | |
US5077610A (en) | Previewing cuts and transformations in an electronic image composition system | |
US5105469A (en) | Control data array generation apparatus and method | |
US4984072A (en) | System and method for color image enhancement | |
US5204665A (en) | Color editing with simple encoded images | |
EP0302454B1 (en) | System and method for color image enhancement | |
US6571012B1 (en) | Adjusting a softness region | |
US20230370561A1 (en) | Interactive Three-Dimensional (3D) Color Histograms | |
JPH06225329A (en) | Method and device for chromakey processing | |
JP3449860B2 (en) | Image sharpness processing device | |
GB2312120A (en) | Producing a transition region surrounding an image | |
US6456300B1 (en) | Method and apparatus for processing image data to produce control data | |
GB2312348A (en) | Chromakeying with transition colour volumes | |
EP0240019B1 (en) | Television graphics system | |
US20020171764A1 (en) | Electronic image keying systems | |
JP2882754B2 (en) | Soft chroma key processing method | |
US6295369B1 (en) | Multi-dimensional color image mapping apparatus and method | |
Naiman | Color spaces and color contrast | |
Kalra | GamOpt: A tool for visualization and optimization of gamuts | |
JP3027620B2 (en) | Color editing method using simple coded images | |
US6052109A (en) | Processing image data | |
KR20000010958A (en) | Color correction device, color correction method, picture processing device, and picture processing method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): CA JP US |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE |
|
ENP | Entry into the national phase |
Ref document number: 2237265 Country of ref document: CA Ref country code: CA Ref document number: 2237265 Kind code of ref document: A Format of ref document f/p: F |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1997939109 Country of ref document: EP |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWP | Wipo information: published in national office |
Ref document number: 1997939109 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 09068421 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: JP Ref document number: 1998513438 Format of ref document f/p: F |
|
WWR | Wipo information: refused in national office |
Ref document number: 1997939109 Country of ref document: EP |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 1997939109 Country of ref document: EP |