Search Images Maps Play YouTube News Gmail Drive More »
Advanced Patent Search | Web History | Sign in

Patents

A system and method for editing digital images includes a processor for storing a digital image of an object and a background. The periphery, or edge, of the object has a first hue, and the background has a second hue. Based upon the difference between the hues and a predetermined hue difference, the processor locates the edge of the object and removes portions of the image (i.e., the background) that are outside the edge. Then, the object can be combined with a preselected background so as to form a composite image. Optionally, the gamma of the image of the preselected background and the gamma of the image of the object can be matched, thereby making the object appear as if it was imaged under the same lighting conditions as the preselected background.

InventorArthur M. Blank
Original AssigneeImageware Software, Inc
Primary Examiner: Kimberly A. Williams
Current U.S. Classification348/598; 348/584; 348/E05.058; 348/E09.056
International Classification: H04N 974; H04N 5262

View patent at USPTO
Search USPTO Assignment Database

Citations

Cited PatentFiling dateIssue dateOriginal AssigneeTitle
US4190856Nov 21, 1977Feb 26, 1980Three dimensional television system
US4439783Nov 23, 1981Mar 27, 1984Matsushita Electric Industrial Co., Ltd.Image synthesizing apparatus
US4506289Oct 19, 1982Mar 19, 1985Kokusai Denshin Denwa Kabushiki KaishaChroma-key signal generator
US4694329Apr 12, 1985Sep 15, 1987Corporate Communications Consultants, Inc.Color correction system and method with scene-change detection
US4827253Sep 26, 1988May 2, 1989Dubner Computer Systems, Inc.Video compositing using a software linear keyer
US4827344Sep 30, 1986May 2, 1989Intel CorporationApparatus for inserting part of one video image into another video image
US4864410Aug 1, 1986Sep 5, 1989Bally Manufacturing CorporationApparatus and method of making photographs from a video image
US4910661Dec 14, 1987Mar 20, 1990Edgar L. BarthMethod and apparatus for decorating cakes and other foods
US5117283Jun 25, 1990May 26, 1992Eastman Kodak CompanyPhotobooth compositing apparatus

Referenced by

Citing PatentFiling dateIssue dateOriginal AssigneeTitle
US5563988Aug 1, 1994Oct 8, 1996Massachusetts Institute of TechnologyMethod and system for facilitating wireless, full-body, real-time user interaction with a digitally represented visual environment
US5587740Aug 17, 1995Dec 24, 1996Digital photo kiosk
US5623581Jan 22, 1996Apr 22, 1997APBI Interactive Kiosk SystemsDirect view interactive photo kiosk and image forming process for same
US5630037May 18, 1994May 13, 1997Schindler Imaging, Inc.Method and apparatus for extracting and treating digital images for seamless compositing
US5668605Oct 25, 1994Sep 16, 1997R. T. SetObject keying in video images based on distance from camera
US5687306Nov 12, 1996Nov 11, 1997Image Ware Software, Inc.Image editing system including sizing function
US5778164May 21, 1996Jul 7, 1998Eastman Kodak Company
Hallmark Cards, Inc.
System for custom imprinting a variety of articles with images obtained from a variety of different sources
US5897220Dec 4, 1997Apr 27, 1999American Alpha Inc.Automatic photograph booth for forming sketches
US5913019Nov 19, 1997Jun 15, 1999Foto Fantasy, Inc.Direct view interactive photo kiosk and composite image forming process for same
US5923406Jun 27, 1997Jul 13, 1999Pitney Bowes Inc.Personal postage stamp vending machine
US5986718Sep 19, 1996Nov 16, 1999Video Magic, Inc.Photographic method using chroma-key and a photobooth employing the same
US6021417Oct 31, 1997Feb 1, 2000Foto Fantasy, Inc.Method of stimulating the creation of an artist's drawing or painting, and device for accomplishing same
US6052648Apr 10, 1997Apr 18, 2000EarthWatch Communications, Inc.Method and system for display of weather-related information
US6072537Jan 6, 1997Jun 6, 2000U-R Star Ltd.Systems for producing personalized video clips
US6195513Feb 17, 1998Feb 27, 2001Fuji Photo Film Co., Ltd.Electronic camera accessory and image composition system
US6198503Jul 28, 1997Mar 6, 2001Infra-red video key
US6370568Sep 18, 2000Apr 9, 2002Digital real time postcards including information such as geographic location or landmark
US6385628Mar 1, 1999May 7, 2002Foto Fantasy, Inc.Method for simulating the creation if an artist's drawing or painting of a caricature, and device for accomplishing same
US6400374Sep 18, 1996Jun 4, 2002Eyematic Interfaces, Inc.Video superposition system and method
US6448974Feb 26, 1999Sep 10, 2002Method and apparatus for chroma key data modifying insertion without video image fragmentation
US6507361Jun 23, 2000Jan 14, 2003Electronic personalized imaging production system including means for combining foreground images with background images
US6556775Feb 1, 1999Apr 29, 2003Matsushita Electric Industrial Co., Ltd.Image and sound reproduction system
US6766054Aug 14, 2000Jul 20, 2004International Business Machines CorporationSegmentation of an object from a background in digital photography
US6809762Jul 31, 2001Oct 26, 2004Multiple photograph service method and apparatus
US6885767May 11, 2001Apr 26, 2005Silhouetting apparatus and method
US6977673Sep 18, 1997Dec 20, 2005Avid Technology, Inc.Portable moving picture recording device including switching control for multiple data flow configurations
US7057650Jun 22, 1999Jun 6, 2006Fuji Photo Film Co., Ltd.Image sensing apparatus and method for synthesizing a composite image
US7212308Dec 18, 2002May 1, 2007Interactive photo kiosk
US7230641Jul 3, 2001Jun 12, 2007Avid Technolgy, Inc.Combined editing system and digital moving picture recording system
US7277579May 31, 2002Oct 2, 2007ArcSoft, Inc.Smart scan
US7324166Nov 15, 2004Jan 29, 2008Contour Entertainment IncLive actor integration in pre-recorded well known video
US7352393Apr 11, 2006Apr 1, 2008FUJIFILM CorporationImage sensing apparatus and method for synthesizing a composite image
US7477417Aug 25, 2000Jan 13, 2009Dai Nippon Printing Co., Ltd.Image processing system
US7532807Jul 23, 2004May 12, 2009Avid Technology, Inc.Combined editing system and digital moving picture recording system
US7548260Dec 21, 2000Jun 16, 2009Fujifilm CorporationIdentification photo system and image processing method which automatically corrects image data of a person in an identification photo
US7623754Sep 18, 1997Nov 24, 2009Avid Technology, Inc.Motion picture recording device using digital, computer-readable non-linear media
US7751643Aug 12, 2004Jul 6, 2010Semiconductor Insights Inc.Method and apparatus for removing uneven brightness in an image
US7800582Apr 20, 2005Sep 21, 2010Weather Central, Inc.Scene launcher system and method for weather report presentations and the like
US7830413Mar 30, 2007Nov 9, 2010Avid Technology, Inc.Combined editing system and digital moving picture recording system
US7859551Feb 25, 2002Dec 28, 2010Object customization and presentation system
US7860342Aug 2, 2005Dec 28, 2010The Invention Science Fund I, LLCModifying restricted images
US7999862Oct 24, 2008Aug 16, 2011Lightcraft Technology, LLCMethod and apparatus for an automated background lighting compensation system
US8022967Jun 1, 2005Sep 20, 2011Canon Kabushiki KaishaImage processing method and image processing apparatus
US8126190Jan 31, 2007Feb 28, 2012The Invention Science Fund I, LLCTargeted obstrufication of an image
US8126938May 25, 2007Feb 28, 2012The Invention Science Fund I, LLCGroup content substitution in media works
US8203609Jan 31, 2007Jun 19, 2012The Invention Science Fund I, LLCAnonymization pursuant to a broadcasted policy

Claims

1. A system for selectively combining digital images, comprising:

a processor having a memory for storing a first digital image having a plurality of pixels, wherein the first digital image includes an object bordered by an edge having a first hue, and a background having a second hue which can be any desired color;
means for locating the edge in the first digital image by comparing the hues of each background pixel with one of the object pixels of a predetermined hue, thereby mapping background pixels in an immediate vicinity of the edge of the first digital image; and
means for removing the background from the first digital image using the located edge.

2. The system of claim 1, additionally comprising means for combining the object with a second digital image.

3. The system of claim 2, wherein the combining means includes means for averaging the hue of the edge and the hue of the second digital image so as to generate an averaged hue, wherein the averaged hue replaces the edge and thereby produces a blended object.

4. The system of claim 3, wherein at least a portion of the blended object has a first gamma and at least portion of the second digital image has a second gamma, and additionally comprising means for setting one of: the first gamma and the second gamma, to equal the other gamma.

5. The system of claim 1, wherein each hue is characterized by a numeric value.

6. The system of claim 5, wherein the background includes a plurality of two-dimensional boxes, each box having a plurality of dots therein, the processor having an image of the background stored in memory, wherein the means for locating the edge compares the hue of pixel in the first digital image with the hue of a corresponding pixel of a background image stored in the memory, the predetermined hue for each comparison thus being the hue of the corresponding pixel in the background image.

7. The system of claim 5, wherein the means for locating the edge determines the difference between the numeric value of one pixel and the numeric value of a contiguous pixel, and compares the difference to a predetermined difference, the predetermined hue for each comparison thus being the hue of the adjacent pixel.

8. The system of claim 1, wherein the means for removing the background from the first digital image sets all background pixels to a preselected transparent value.

9. The system of claim 1, additionally comprising a video camera connected to the processor, the camera generating a signal which is stored as the first digital image.

10. The system of claim 7, additionally comprising a video monitor connected to the processor for displaying the first digital image.

11. A gamma correlator, comprising:

means for measuring a gamma of each pixel of an object in a first image and for measuring the gamma of each pixel of a background in a second image;
means for shifting the gamma of at least one selected pixel of the object or at least one selected pixel of one of a plurality of stored backgrounds to substantially equal the gamma of the other; and
means for shifting a first gamma of a selected object and a second gamma of a selected background to a third gamma of a lighting environment distinguishable from lighting conditions of the selected object and the selected background.

12. An image combiner, comprising:

a processor for receiving a signal representative of a first digital image, the signal including an object component representative of an object, the object being bordered by an edge having a first hue, the signal also including a background component representative of a background having a second hue, wherein the processor includes means for separating the background from the object by determining the location of the edge of the object and then removing all portions of the first digital image which are outside the edge from all the portions of the first digital image which are inside the edge; and
means for combining a portion of the first digital image with a second digital image, wherein said portion of the first digital image is alternatively (i) reoriented or (ii) reoriented and repositioned onto the second digital image.

13. The image combiner of claim 12, further comprising a video camera for generating the signal, the processor being electrically connected to the video camera for receiving the signal therefrom.

14. The image combiner of claim 13, further comprising a video monitor electrically connected to the processor for displaying the image of the object.

15. The image combiner of claim 12, wherein the first digital image has a periphery, and the processor further comprises:

means for determining the difference between the hue of a portion of the periphery and a predetermined hue;
means for comparing the difference to a predetermined difference;
wherein when the difference exceeds the predetermined difference, the processor identifies the location of the portion of the periphery as the location of a portion of the object, and then compares the hue of other portions of the periphery with the predetermined hue; and
wherein when the difference is less than the predetermined difference, the processor compares the hue of inwardly succeeding portions, relative to the periphery, of the first digital image with the predetermined hue until the difference between a portion and the predetermined hue exceeds the predetermined difference;
until the entire edge of the object has been identified.

16. The image combiner of claim 15, wherein the background includes a plurality of two-dimensional boxes, each box having a plurality of dots therein, the processor having an image of the background stored in memory, the stored image corresponding to the first digital image, wherein the processor compares the hue of at least some of the first video image with the hue of the corresponding portions of the image of the background stored in memory to determine the location of the edge of the object.

17. The image combiner of claim 15, wherein the processor receives a second digital signal representative of a preselected background, and the processor overlays the object onto the preselected background.

18. The image combiner of claim 17, wherein the preselected background has at least one hue, and the processor averages the hue of the object and the hue of the preselected background to generate an averaged signal representative of an averaged hue, the processor changing the hue of the edge of the object to equal the averaged hue, to thereby produce a blended object.

19. The image combiner of claim 18, wherein at least a portion of the blended object has a first gamma and at least a portion of the preselected background has a second gamma, and the processor sets one of the first gamma and the second gamma to equal the other gamma.

20. The image combiner of claim 15, wherein the digital signal comprises a plurality of pixels, each pixel having a hue and each hue having a corresponding numeric value, and the background is a continuous hue, wherein the processor determines the location of the edge of the object by determining the difference between the numeric value of one pixel and the numeric value of an adjacent pixel, and comparing the difference to the predetermined difference.

21. The image combiner of claim 20, wherein the processor removes the background component from the object component by setting all background pixels to a preselected transparent value.

22. The image combiner of claim 15, wherein the background has a single continuous hue, and the predetermined hue is the hue of the background.

23. A method for generating an edited digital image from a first digital image, the first digital image including an object having a first hue and a background having a second hue, the method comprising the steps of:

detecting in the first image an edge defined by the difference in hue between the object and the background;
comparing the hues of each background pixel with one of the object pixels of a predetermined hue, thereby mapping background pixels in an immediate vicinity of the edge of the first digital image; and
selectively removing the background from the first digital image by setting the mapped background pixels to a preselected transparent value so as to only retain substantially the entire object in the first digital image.

24. The method of claim 23 including a second digital image having a third hue, the method further comprising the steps of:

overlaying the object from the first digital image on the second digital image; and
averaging the hue of the object and the second digital image along the edge of the object, thereby producing a blended object in the second digital image.

25. The method of claim 24, further comprising the step of setting one of: the first hue in at least a portion of the blended object and the third hue in the second digital image, to equal the other hue.

26. A method of integrating a digital image of an object into a digital image of a background, comprising the steps of:

measuring the gamma of the object in a first hue;
measuring the gamma of the background in a second hue; and
shifting the gamma of a selected one of the object or the background to alternatively (i) substantially equal the gamma of the other or (ii) shift a first gamma of a selected object and a second gamma of a selected background to a third gamma of a lighting environment distinguishable from lighting conditions of the selected object or the selected background.

27. A system for selectively combining digital images, comprising:

a processor having a memory for storing a first digital image having a plurality of pixels, wherein the first digital image includes an object bordered by an edge having a first hue, and a background having a second hue which can be any desired color;
means for locating the edge in the first digital image by comparing, for background pixels and some of, but not all, the object pixels, the hues of the pixels with a predetermined hue, wherein each hue is characterized by a numeric value;
means for removing the background from the first digital image using the located edge; and
means for combining the object with a second digital image, wherein the combining means includes means for averaging the hue of the edge and the hue of the second digital image so as to generate an averaged hue, wherein the averaged hue replaces the edge and thereby produces a blended object.

28. The system of claim 27, wherein the background includes a plurality of two-dimensional boxes, each box having a plurality of dots therein, the processor having an image of the background stored in memory, wherein the means for locating the edge compares the hue of a pixel in the first digital image with the hue of a corresponding pixel of a background image stored in the memory, the predetermined hue for each comparison thus being the hue of the corresponding pixel in the background image.

29. The system of claim 27, wherein a portion of the object is selectively combined with the second digital image in real-time by an operator, wherein said portion of the object is alternatively (i) reoriented or (ii) reoriented and repositioned onto the second digital image.

30. The system of claim 27, wherein at least a portion of the blended object has a first gamma and at least a portion of the second digital image has a second gamma, and additionally comprising means for setting one of the first gamma and the second gamma to equal the other gamma.

31. An image combiner, comprising:

a processor for receiving a signal representative of a first digital image, the signal including an object component representative of an object, the object being bordered by an edge having a first hue, the signal also including a background component representative of a background having a second hue, wherein the processor includes means for separating the background from the object by determining the location of the edge of the object and then removing all portions of the first digital image which are outside the edge from all the portions of the first digital image which are inside the edge, wherein the first digital image has a periphery, and the processor further comprises:
means for determining the difference between the hue of a portion of the periphery and a predetermined hue;
means for comparing the difference to a predetermined difference;
wherein when the difference exceeds the predetermined difference, the processor identifies the location of the portion of the periphery as the location of a portion of the object, and then compares the hue of other portions of the periphery with the predetermined hue;
wherein when the difference is less than the predetermined difference, the processor compares the hue of inwardly succeeding portions, relative to the periphery, of the first digital image with the predetermined hue until the difference between a portion of the first digital image and the predetermined hue exceeds the predetermined difference; and
wherein the background includes a plurality of two-dimensional boxes, each box having a plurality of dots therein, the processor having an image of the background stored in memory, the stored image corresponding to the first digital image, wherein the processor compares the hue of at least some of the first video image with the hue of the corresponding portions of the image of the background stored in memory to determine the location of the edge of the object, thereby mapping the entire edge of the object.

32. The image combiner of claim 31, wherein the preselected background has at least one hue, and the processor averages the hue of the object and the hue of the preselected background to generate an averaged signal representative of an averaged hue, the processor changing the hue of the edge of the object to equal the averaged hue, to thereby produce a blended object.

33. The image combiner of claim 32, wherein at least a portion of the blended object has a first gamma and at least a portion of the preselected background has a second gamma, and the processor sets one of the first gamma and the second gamma to equal the other gamma.

34. A method for generating an edited digital image from a first digital image, the first digital image including an object having a first hue and a background having a second hue, and further including a second digital image having a third hue, the method comprising the steps of:

detecting in the first image an edge defined by the difference in hue between the object and the background;
selectively removing the background from the first digital image so as to retain substantially the entire object in the first digital image;
overlaying the object from the first digital image on the second digital image; and
averaging the hue of the object and the second digital image along the edge of the object, thereby producing a blended object in the second digital image.

35. The method of claim 34, further comprising the step of setting one of the first hue in at least a portion of the blended object and the third hue in the second digital image to equal the other hue.