WO2005076985A2 - Digital watermarking image signals on-chip and photographic travel logs through digital watermarking - Google Patents

Digital watermarking image signals on-chip and photographic travel logs through digital watermarking Download PDF

Info

Publication number
WO2005076985A2
WO2005076985A2 PCT/US2005/003777 US2005003777W WO2005076985A2 WO 2005076985 A2 WO2005076985 A2 WO 2005076985A2 US 2005003777 W US2005003777 W US 2005003777W WO 2005076985 A2 WO2005076985 A2 WO 2005076985A2
Authority
WO
WIPO (PCT)
Prior art keywords
image
watermark
pixels
location
color
Prior art date
Application number
PCT/US2005/003777
Other languages
French (fr)
Other versions
WO2005076985A3 (en
Inventor
Tony F. Rodriguez
Trent J. Brundage
Steven Michael Shovoly
Original Assignee
Digimarc Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Digimarc Corporation filed Critical Digimarc Corporation
Priority to JP2006552319A priority Critical patent/JP4981455B2/en
Priority to EP05722787.8A priority patent/EP1751690B1/en
Publication of WO2005076985A2 publication Critical patent/WO2005076985A2/en
Publication of WO2005076985A3 publication Critical patent/WO2005076985A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/0021Image watermarking
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/01Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/13Receivers
    • G01S19/14Receivers specially adapted for specific applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/0021Image watermarking
    • G06T1/005Robust watermarking, e.g. average attack or collusion attack resistant
    • G06T1/0064Geometric transfor invariant watermarking, e.g. affine transform invariant
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H04N1/32149Methods relating to embedding, encoding, decoding, detection or retrieval operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/28Indexing scheme for image data processing or generation, in general involving image processing hardware
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2201/00General purpose image data processing
    • G06T2201/005Image watermarking
    • G06T2201/0051Embedding of the watermark in the spatial domain
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2201/00General purpose image data processing
    • G06T2201/005Image watermarking
    • G06T2201/0052Embedding of the watermark in the frequency domain
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3225Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
    • H04N2201/3253Position information, e.g. geographical position at time of capture, GPS data

Definitions

  • the present invention relates to digital watermarking and steganography.
  • the present invention relates to digital watermarking - on chip - signals produced from a CMOS or other image sensor.
  • the present invention also relates to communication and image management.
  • the present invention relates to watermarking images with location information (e.g., GPS data) to facilitate image management and creation of visual travel logs.
  • Digital watermarking is a process for modifying physical or electronic media to embed a machine-readable code into the media.
  • the media may be modified such that the embedded code is imperceptible or nearly imperceptible to the user, yet may be detected through an automated detection process.
  • digital watermarking is applied to media signals such as image signals, audio signals, and video signals.
  • media signals such as image signals, audio signals, and video signals.
  • it may also be applied to other types of media objects, including documents (e.g., through line, word or character shifting), software, multidimensional graphics models, and surface textures of objects.
  • Digital watermarking systems typically have two primary components: an encoder (or “embedder”) that embeds the watermark in a host media signal, and a decoder that detects and reads the embedded watermark from a signal suspected of containing a watermark (a suspect signal).
  • the encoder embeds a watermark by subtly altering the host media signal.
  • the physical manifestation of altered host media most commonly takes the form of altered signal values, such as slightly changed pixel values, image luminance, color or color values, picture colors, altered DCT coefficients, etc.
  • the detector component analyzes a suspect signal to detect whether a watermark is present. In applications where the watermark encodes information, the reader extracts this information from the detected watermark.
  • Watermark embedding is preferably integrated "on-chip.”
  • the term on-chip is used to reflect that at least a portion of watermark embedding is facilitated through circuits, electronics or logic provided on silicon or other semiconductor structure associated or in communication with an imaging aoay.
  • the embedding circuitry is co-located with an image sensor array.
  • the CMOS sensor array communicates with embedding circuits on a remote chip location.
  • CMOS imagers are well known in the art, e.g., see U.S. Patent Nos. 6,645,788, 6,654,057, 6,639,261, 5,708,263 and 5,471,515.
  • the literature is also full of illustrative work including, e.g., Nixon et al., "256X256 CMOS Active Pixel Sensor Camera-on-a-Chip," IEEE Journal of Solid-State Circuits, Vol. 31(12) pp. 2046-2050, 1996; and Mendis et al, "CMOS Active Pixel Image Sensors," LEEE Transactions on Electron Devices, Vol. 41(3) pp. 452-453, 1994.
  • a CMOS imager circuit may include a focal plane array of pixel cells, each one of the cells including a photo-detector, e.g., a photogate, photoconductor or a photodiode, overlying a substrate for accumulating photo-generated charge in the underlying portion of the substrate.
  • a readout circuit is connected to pixel cells and may include an output field effect transistor formed in the substrate and a charge transfer section formed on the substrate adjacent the photogate, photoconductor or photodiode having a sensing node, typically a floating diffusion node, connected to the gate of an output transistor.
  • the imager may include an electronic device (such as a transistor) for transferring charge from the underlying portion of the substrate to the floating diffusion node and a device for resetting the node to a predetermined charge level prior to charge transference.
  • the active elements of a pixel cell preferably perform functions, e.g., of: (1) photon (e.g., light) to charge conversion; (2) accumulation of image charge; (3) transfer of charge to the floating diffusion node accompanied by charge amplification; (4) resetting a floating diffusion node to a known state; (5) selection of a pixel or image area for readout; and (6) output and amplification of a signal representing pixel charge.
  • a communications channel overlays most, if not all, of a pixel array to apply timing, control and read out signals and an array of column output signal interconnects.
  • Column lines connect to electronics that are arranged by column outside of the pixel array.
  • This type of architecture allows signals from the entire array, a portion of the array (e.g., rows or pixel windows), or a single pixel in the array to be read out by simple X-Y addressing or row/column clocking.
  • our inventive watermarking techniques apply to other on-chip imagers including CCD sensors and other CMOS configurations.
  • a first aspect of the invention is a method of introducing a digital watermark component to imagery generated by an image sensor (e.g., a CMOS or other image sensor).
  • the image sensor includes a plurality of pixels.
  • the method includes providing slight variations to physical characteristics of a set of the plurality of pixels. The variations are provided so as to introduce the digital watermark component during image capture.
  • the method further includes generating imagery with the image sensor.
  • the imagery includes the digital watermark component.
  • Another aspect of the invention is a method of embedding a digital watermark in image data captured by an imager.
  • the watermark embedding occurs on-chip with the imager, and the imager includes a plurality of pixels. Each of the plurality of pixels is filtered to represent a single color.
  • the method includes, prior to approximating a multi-color value for each pixel, adjusting single color values for select pixels. The adjusting introduces a digital watermark into the image data.
  • the method further includes approximating a multi-color value for each pixel.
  • GPS or location data can be provided to a watermark embedder located, e.g., on-chip with or external to, an image sensor.
  • the watermark embedder can embed the GPS coordinates or other location data, perhaps with a timestamp, in data captured by the image sensor.
  • Location data can be combined or associated with an operator or photographer identifier (e.g., a plural-bit identifier) to even further identify imagery captured by the image sensor.
  • yet another aspect of the invention is a method including: i) receiving an image including a digital watermark embedded therein, wherein the digital watermark comprises location information; ii) decoding the digital watermark to obtain the location information; iii) identifying a map depicting a location corresponding to the location information; and iv) providing the map for access over a computer network.
  • Still another aspect of the invention is a method of visually or graphically identifying locations on a map.
  • the map is to be displayed via a computer display.
  • the method includes receiving data representing a first image, and analyzing the data to obtain information steganographically encoded therein.
  • the information includes or links to first location information associated with the first image.
  • the method further includes providing a map including an area associated with the first location information, wherein the map is to be displayed via a computer display, and identifying a first location on the map that is associated with the first location information.
  • identification of a first location includes providing a visual or graphical object on the map at or near a map location that is associated with the first location information.
  • the object includes a representation (e.g., a "thumbnail") of the first image.
  • Another aspect of the invention is a method of representing a geographically location.
  • the method includes receiving an image captured from a first cell phone.
  • the image includes location information steganographic embedded therein.
  • the method further includes decoding the steganographic embedding to obtain the location information; by using the location information or information identified by the location information, identifying a map representing a location associated with the location information; and displaying the map.
  • the method includes displaying a visual or graphical object on the map to identify the location.
  • the object may include a representation of the image.
  • FIG. 1 is a block diagram illustrating a CMOS pixel array.
  • FIG. 2 A is a block diagram for one implementation of an on-chip watermark embedder
  • FIG. 2B is a block diagram for another implementation of an on-chip watermark embedder.
  • FIG. 3 illustrates on-chip parallel watermark embedding modules.
  • FIG. 4 illustrates image capture of a similar geo-location, but from different camera angles.
  • FIG. 5 illustrates an image including location information encoded therein.
  • FIG. 6 is a block diagram illustrating interaction of a controller with a map application.
  • FIG. 7 illustrates a map generated by a map application, including visual or graphical objects displayed therewith.
  • FIG. 8A illustrates image capture with a first mobile device
  • FIG. 8B illustrates commumcation of a captured image to a second mobile device
  • FIG. 8C illustrates the second device showing a corresponding map with which the image corresponds to.
  • FIG. 1 is a general block diagram of a CMOS imager array 10.
  • the array 10 includes rows and columns of photo-detectors. Each photo-detector preferably corresponds with an image pixel. Each photo-detector may include active circuitry, e.g., a signal amplifier (allowing for a so-called "active-pixel sensor"). While the aoay 10 is illustrated as including twenty- five photo-detectors, it will be appreciated that an actual imager aoay may include millions of photo-detectors.
  • the array 10 includes a communications network or signal grid to allow image or pixel information to be read out from pixel locations.
  • the network may even allow for a pixel window, block of data, or rows to be output from the aoay.
  • a window selection (or direct random access ability) allows a CMOS sensor to intelligently choose to readout select groups of pixels rather than the entire sensor array.
  • the array 10 may cooperate with a variety of other circuitry including, e.g., timing control, row and column drivers, decoders, analog to digital converters, color converters, memory, etc.
  • Photodetectors typically record intensity of light from full black to white, with appropriate intervening gray.
  • a layer of color filters is provided over an aoay of photo-detectors.
  • each photo-detector cooperates with a color filter (e.g., red (R), green (G) or blue (B)) or a portion of a color filter aoay (CFA).
  • a color filter e.g., red (R), green (G) or blue (B)
  • CFA color filter aoay
  • the filters can be arranged in a predetermined pattern, e.g., the Bayer pattern:
  • Raw color data is read out from the array (e.g., row by row or via window selection).
  • the raw color data is processed, e.g., amplified, adjusted, converted, etc.
  • a color converter converts color data into RGB values per pixel.
  • Color values for individual pixels are determined through various forms of estimation (e.g., interpolation, quadratic estimation, cubic spline, linear, nearest neighbor comparison, etc.). For example, a 24-bit value per pixel is determined (8-bits for red, 8-bits for green and 8-bits for blue). This color conversion is typically performed on-chip.
  • RGB image data is provided from the chip or imager as an output.
  • RGB values instead of RGB values, a CMY conversion could be undertaken as well.
  • each pixel value cooesponds to a gray-scale value.
  • the gray-scale value per pixel is output from the chip, perhaps after signal processing.
  • CMOS sensor may also include a compression module (e.g., JPEG or MPEG) for compressing image data.
  • a compression module e.g., JPEG or MPEG
  • Assignee Digimarc Corporation has previously contemplated the manifestation of watermark functionality through dedicated hardware as discussed, e.g., in U.S. Patent Nos. 5,862,260, 6,674,876 and 6,549,638, and contemplated watermarking circuitry being co-located on chip with CMOS imagers, e.g., as discussed in U.S. Patent No. 6,650,761.
  • the watermark embedder includes a Signal Generator 22 and Signal Combiner 24.
  • the Signal Generator 22 receives an orientation component and message as inputs.
  • An orientation component helps to make a watermark more robust to geometric distortion (e.g., scaling, rotation, translation, etc.), or may help identify certain message bits.
  • One type of watermark orientation signal is an image signal that comprises a set of impulse functions in a transform domain, like a Fourier magnitude domain, e.g., each with pseudorandom phase.
  • a watermark decoder converts the watermarked image to the Fourier magnitude domain and then performs, e.g., a log polar resampling of the Fourier magnitude image.
  • a generalized matched filter cooelates a known orientation signal with the re-sampled watermarked signal to find the rotation and scale parameters providing the highest cooelation.
  • a watermark decoder performs additional cooelation operations between the phase information of the known orientation signal and the watermarked signal to determine translation parameters, which identify the origin of the watermark message signal. Having determined the rotation, scale and translation of the watermark signal, the reader then adjusts the image data to compensate for this distortion, and extracts the watermark message signal, if any.
  • Alternative orientation components include a predetermined start string or message property which aids message detection. Still other orientation components are known to those of ordinary skill in the art and can be suitably interchanged with related aspect of the invention.
  • the image data may cooespond with: i) RGB (or CMY) data after color conversion; ii) raw, pre-color conversion, data (e.g., pre-Bayer pattern reconstruction); or iii) compressed color converted image data.
  • the Combiner 24 outputs an embedded or watermarked image signal.
  • the Signal Generator 22 may provide raw data bits to Combiner 24 or even a more sophisticated signal, such as an image data block or line.
  • the message can be eoor corrected and spread or expanded, and in some implementations the message and orientation components are provided as a combined signal.
  • a watermark embedder may use knowledge of an expected color conversion process (e.g., inte ⁇ olation) to help efficiently embed a watermark signal. For example, a 24-bit color value for a first pixel may have color contribution from adjacent or neighboring pixels. A watermark embedder may tweak (or adjust) data from multiple pixels that will ultimately affect the first pixel's 24-bit color value. Similarly, a watermark decoder may then use knowledge of a color conversion process to ensure proper detection. Or is a color conversion is expected to use an inte ⁇ olation, the embedder may use this knowledge to weight or adjust certain pixels relative to other pixels so as to convey a watermark in the post-inte ⁇ olated color data.
  • an expected color conversion process e.g., inte ⁇ olation
  • Embedding pre-color conversion data also efficiently facilitates embedding image data, row-by-row or block-by-block. Embedding can also take place in parallel, as shown in FIG. 3, wherein multiple embedding units are provided. Multiple embedding units, while they may take up more chip space, significantly reduce embedding time.
  • image data Prior to color processing, image data is embedded by separate embedders. First embedding units may, optionally, communicate image data statistics to later or following embedders (shown with the dotted arrows in FIG. 3). The later or following embedders use the statistics to (e.g., color properties, noise analysis, sensor characteristics, variance, etc.) as inputs to adjust their embedding process.
  • Such adjustments may, e.g., increase or decrease watermark signal strength, alter or switch between different embedding protocols or even isolate certain image regions for selective embedding.
  • image windows e.g., a block of pixels
  • One improvement is watermark only pixels within a block that is selected from an image array. Once the window is selected, pixels within the window are communicated to one or more watermark embedders.
  • the watermark may include an array location to help identify where in the aoay the pixel window was extracted from.
  • Perceptual analysis refers generally to techniques for evaluating signal properties based on the extent to which those properties are (or are likely to be) perceptible to humans (e.g., listeners or viewers of the media content).
  • the illustrated watermark embedder e.g., blocks 22 and 24 in FIGS. 2A and 2B
  • HVS Human Visual System
  • Perceptual analysis can play an integral role in gain control because it helps indicate how the gain can be adjusted relative to the impact on the perceptibility of the watermark.
  • Perceptual analysis can also play an integral role in locating the watermark in a host signal. For example, one might design the embedder to hide a watermark in portions of a host signal that are more likely to mask the watermark from human perception.
  • Various forms of statistical analyses may be performed on a signal to identify places to locate the watermark, and to identify places where to extract the watermark. For example, a statistical analysis can identify portions of a host image that have noiselike properties that are likely to make recovery of the watermark signal difficult. Similarly, statistical analyses may be used to characterize the host signal to determine where to locate the watermark. [0041] Each of the techniques may be used alone, in various combinations, and in combination with other signal processing techniques.
  • the watermark may be embedded in one or more of the color components of an image. For example, when embedding pre-color reconstructed image data, a watermark may be selectively embedded only in the red channel. Or, a weighting scheme may distribute a watermark only between the red and blue and/or green channels. In some implementations, the embedder may transform the input image into a target color space, and then proceed with the embedding process in that color space.
  • a message is static. That is, the message is the same for all images.
  • the static message is uniquely associated with particular silicon manufacturing mask, manufacturer, intended customer, or even a particular chip batch run.
  • the message is stored, e.g., in on-chip registers or ROM and embedded in each image produced by the image sensor.
  • a message has a static component and a dynamic component.
  • the dynamic component can be provided by a number of different methods. For example, if a CMOS chip includes EPROM-like fuses, particular fuses are blown to create a unique identifier. More likely is for a CMOS chip to include or communicate with RAM. The dynamic identifier is provided from RAM (or another interface) for embedding.
  • an entire watermark payload is dynamic. That is, the message is unique for each image, for a set of images or personalized for a particular user or application.
  • the watermark message may include unique plural bits that identify a particular cell phone or sensor in which the imager is inco ⁇ orated. The unique plural bits are communicated to the embedder for embedding in image data.
  • the unique plural bits cooespond to a user's biometric. The biometric is embedded in the imagery.
  • a cell phone includes or communicates with a finge ⁇ rint reader. The finge ⁇ rint reader captures a user's finge ⁇ rint.
  • the finge ⁇ rint is hashed or otherwise represented, e.g., as discussed in assignee's U.S. Patent Application No. 10/893,141, filed August 7, 2003.
  • the hash or representation is used as a watermark component which ties the imagery to a user or photographer.
  • a biometric a user may be required to enter her PIN or password prior to device operation.
  • the user is identified from such and a user ID is embedded in each image.
  • the orientation component can be repeated, e.g., in 64X64 or 128X128 pixel blocks, across the sensor aoay.
  • the variations can be provided in a number of ways, including changing the potential, doping or characteristics of select photodiodes or photogates to introduce image data offsets during the manufacture process. These image offsets are slight - preferably imperceptible to a human observer of resulting image data, while still collectively conveying a steganographic component in captured imagery.
  • the variations introduce a fixed watermark component in all imagery captured by the image sensor. With reference to FIG. 2B, image data including a fixed watermark component is provided to a watermark embedder.
  • the embedder receives a variable component (e.g., a message) and embeds the variable component in the image data. If, for example, the fixed component includes a watermark orientation component, the variable component is preferably registered with the fixed component and then embedded in imagery. Registration of the variable component with the fixed component is simplified since the embedder knows how (and where) the fixed component is aligned in the sensor aoay.
  • a variable component e.g., a message
  • an orientation component can be similarly introduced by altering a set of color filters or microlens.
  • a pattern is designed to cooespond with an orientation component.
  • the altered filters or microlens are then aoanged in the pattern to convey the orientation component.
  • the altered lens or filter may provide a subtle color value offset.
  • a set of the offset values is sufficient to convey the orientation component in the captured image data itself.
  • a CMOS sensor is manufactured so as to embed a machine-readable feature during the process of image capture itself.
  • an orientation component is introduced by providing different signal amplifications values. That is, a set of amplifiers is arranged to introduce a subtle signal variation to image data.
  • a fixed watermark component e.g., an orientation component or fixed payload or message component
  • introducing a fixed watermark orientation component during image capture allows for manufacturing quality control. For example, an image sensor is illuminated with white light. The resulting image data from the image sensor is read out and a watermark detector searches the image data to detect the orientation component. The orientation component is evaluated to ensure sensor integrity. (For example, if the orientation component is undetectable, or is detected in a degraded manner, a sensor defect is likely present.).
  • a fixed payload or message component can be introduced during image capture.
  • the fixed payload may represent a chip batch or lot number, manufacturing process, chip type, intended recipient, creation date or location, etc.
  • a watermark embedder (or HVS module) can be configured to take advantage of chip characteristics. For example, embedding is adjusted based on silicon characteristics or color processing. If the embedder (or HVS) determines the existence of fixed pattern noise, the embedding can use the noise to guide or mask embedding locations. The embedder (or HVS) can track statistics and image quality and make adjustments to compensate or increase imperceptibility.
  • an embedder can gather image statistics regarding image data and use this data for embedding rows to come, or pass the statistics to other embedding modules.
  • Multiple embedders also allow for enhanced rate control.
  • a rate-control algorithm can be imposed to ensure that for any given frame (or row) a fixed rate is achieved and that it is optimized for not only visibility, but resulting size of compressed bitstream. This allows an individual embedder to manage an amount of entropy per frame/window/row so as not to adversely affect compressed size.
  • a sensor imager may optionally include additional circuitry to characterize image data.
  • the characterizing circuitry may generate a digital signature or hash (or finge ⁇ rint) of an image or a subset of the image.
  • the signature or hash is embedded as a component of a digital watermark.
  • We preferably use an algorithm that is insensitive to watermark embedding. That is, a signature or hashing algorithm will generate the same hash or signature despite the presence of a digital watermark embedded therein.).
  • the signature or hash helps to establish whether the image has been tampered with. In some implementations we identify low frequency JPEG values and embed those values into image data, along with a date, time and location.
  • Hashing can also provide detailed (e.g., row by row) image authentication. For example, we can generate a hash of a first row or block of pixels (e.g., based on color values or pre-color converted pixel values). The hash is embedded in a subsequent row or block of pixels. The process preferably continues to allow for each row or block of pixels to be hashed, with the hash being embedded as a watermark component in subsequent rows or blocks. If a pixel or row is altered, it will no longer correspond to the hash of that pixel or row. This method can be applied to post-compressed data as well. A hash is generated to represent a block of compressed image data. The hash is stored in a subsequent block of compressed data.
  • an embedder is integrated into the imager of a web camera.
  • the image or video stream of the web camera carries an embedded digital watermark, either dynamic or static as above.
  • a dynamic message component is provided from a host computer rather than a stand-alone web camera.
  • This implementation supports secret messaging for consumers, or time stamping or otherwise tagging video for video management on a computer server, or even to help authenticate a video source.
  • a web camera may include optimizations to help read a watermark.
  • the web camera includes watermark pre-processing circuitry co-located with its image sensor. The circuitry may identify the presence of watermarking without decoding the watermarking and signal to a watermark detector to look closely at the particular imagery.
  • the circuitry may also include hardware accelerations to speed watermark detection, or a protocol for handling keys and encryption to create private systems.
  • image data can be realigned, on-chip, to compensate for distortion relative to an expected orientation of the orientation component.
  • This feature can be used for video stabilization (like a so- called "steady-cam" feature in some video cameras). That is, received image data is adjusted to better align to the watermark's expected orientation (e.g., in terms of rotation, scale and translation).
  • An image sensor includes a digital watermark decoder. The decoder decodes watermarks to recover orientation information (relative to an expected or base orientation).
  • the orientation information is provided to a controller (e.g., logic gates) which controls the image sensor to realign the data.
  • Control may include shifting image data in the aoay (a buffer can be used to help move the data around), altering detector gain, inte ⁇ olating image data, etc.
  • image data can be rotated or scaled - on chip - to compensate for a jittery photographer.
  • keys for encryption and keys for access to the digital watermark can be managed either internal or external to an on-chip watermark embedder.
  • an encryption key can be supplied through hardware or firmware interface, which is communicated to an on-chip watermark embedder.
  • an encryption key and even static payload portions preferably reside in onboard ROM, programmed during production or manufacturing of the CMOS sensor/embedder.
  • a method of embedding a steganographic component in imagery captured by an image sensor wherein the image sensor comprises a plurality of rows of image detectors, with a first steganographic encoder associated with at least a first row of image detectors and a second steganographic encoder associated with at least a second row of image detectors, wherein the first steganographic encoder and the second steganographic encoder are co-located with the image sensor, said method comprising: embedding steganographic data in imagery captured by the first row of image detectors with the first steganographic encoder; and embedding steganographic data in imagery captured by the second row of image detectors with the second steganographic encoder.
  • A2 The combination of Al, further comprising gathering information associated with at least one of: i) image data captured by the first row of image detectors; ii) operation or characteristics of the first row of image detectors; and iii) the first steganographic encoder.
  • An image sensor comprising: a controller; an image sensor aoay; at least one watermark detector co-located with the image senor aoay, wherein the watermark detector operates to decode digital watermarks from imagery captured by the image sensor aoay, wherein the digital watermarks comprise an orientation component, and wherein the watermark detector provides ooentation infoonation, relative to an expected watermark orientation, to the controller, and wherein said controller operates at least to adjust imagery captured by the image sensor aoay according to the orientation information.
  • B3 The combination of Bl or B2, wherein the controller stabilizes video captured by the image sensor.
  • a method of marking image content captured by an image sensor comprising: generating a first reduced-bit representation of a first group of pixels; generating a second reduced-bit representation of a second group of pixels; embedding the first reduced-bit representation in the second group of pixels; and embedding the second reduced-bit representation in a third group of pixels.
  • C2 The combination of CI, further comprising generating a reduced-bit representation for each group of pixels in the image content and embedding the reduced-bit representations in different groups.
  • GPS or location data can be provided to a watermark embedder located on chip with a CMOS sensor.
  • CMOS complementary metal-oxide-semiconductor
  • the watermark embedder embeds the GPS coordinates or other location data, perhaps with a timestamp, in data captured by the CMOS array.
  • Location data can be combined or associated with an operator or photographer identifier (e.g., a plural-bit identifier) to even further identify imagery captured by the CMOS aoay.
  • a camera can also create a list or log of images taken, cooelated by a depicted geo-location and/or a digital watermark identifier.
  • the log can be secured, e.g., with encryption and conventional digital signatures.
  • the secure log is communicated to a trusted party, who can then verify, via crosschecking an embedded location/timestamp or watermark identifier with the secure log, whether a particular image corresponds to the log.
  • GPS embedded imagery can be used as a front end (or index) into a data repository or service like the service provided by direction guru MapQuest. For example, a CMOS camera cell phone captures an image at a particular geo-location.
  • a GPS or other location data generator generates location information.
  • the location information is provided to an on-chip watermark embedder that embeds the location information in the cooesponding image captured by the CMOS camera.
  • the embedded image is provided to MapQuest (or to an image management service or software application).
  • MapQuest server includes a watermark detector to decode a watermark in the image to recover the location data. MapQuest tracks and manages images and related information (e.g., maps) based on the location data, e.g., depicted image location and image capture time/day.
  • MapQuest (or another service or application) can then provide a number of useful services.
  • embedded location data is used to identify a corresponding location on a map.
  • the image includes a digital watermark embedded therein with geo-coordinates associated with Bear Lake. Once decoded, the watermark location information is used to identify a map depicting the same or similar geographical area.
  • the map is provided to the user through a computer (e.g., internet or intranet) or cellular network. If the user provides her cuoent location via a graphical user interface (e.g., cell phone or PC-based web browser) MapQuest can generate directions from the user's location to the watermark location, i.e., Bear Lake.
  • a graphical user interface e.g., cell phone or PC-based web browser
  • Another implementation associates related imagery based on their geo- locations. For example, a user queries an image management service, archive or application to determine whether it includes any images that are geographically similarly-located to a user provided (or selected) image.
  • the service or application or archive
  • location data is used to index an image archive to retrieve related images.
  • a further improvement allows a user to select images based on geo-location or image conditions.
  • a service interface can establish a geo-location via an embedded image provided by the user via the service interface.
  • the user may then request a picture of the same shoreline and image capture angle, but from 50 years ago.
  • Digital watermarking provides a backbone for such a system.
  • an embedded digital wateonark includes the information, e.g., location, camera angle, date/time, season, depicted subject matter (e.g., lake, waterfall, grandkids, etc.); but, of course, the watermark may include a subset of such information and/or may include an identifier that is used to link to the information.
  • the image may also include multiple watermarks. For example, a first watermark is embedded (on-chip) during image capture and includes location and capture time information, while a second watermark is embedded after image capture (off-chip) and may include more refined geo-coordinates and/or subject matter or key words.
  • FIG. 4 Another example is discussed with reference to FIG. 4.
  • Two images are captured of the Washington Monument, each from a different viewing angle.
  • the images depict the same geo-location (or similar geo-location within an excepted tolerance).
  • a digital wateonark is embedded in each image.
  • the digital wateonark includes the geo-location and viewing angle (e.g., South or North, etc.) for each depicted image.
  • the embedded information is used to identify the geo-location (i.e., the Washington Monument) and which viewing angle is shown (e.g., depicting a South by South- West viewing angle).
  • a central server communicates with a plurality of user computers.
  • Each of the user computers includes images stored thereon.
  • the images include digital watermarks embedded therein with at least related location information.
  • the watermark information is decoded (preferably by the user computers, but alternatively by the central server) to obtain the location information.
  • the location information is used as an index or identifier and is stored by the central server.
  • the central server maintains a listing of location information and cooesponding internet addresses of where the images are located.
  • Users interface with the central server and query the listing with desired geo-coordinates. (Alternately, the user may query with text terms (e.g., Bear Lake or Washington Monument) for which the server identifies cooesponding geo-coordinates.).
  • the central server provides a listing of related images for user access.
  • Candidate photographs are returned to the user for selection.
  • Embedded location and time information provide the basis for such functionality. (Since the photographer's camera embedded geo-location information in her bluoy or blocked image, the photographer or photographer's watermark decoder extracts the watermark - revealing the location and time - and use the extracted watermark (or information contained therein) as an index or search term to ensure the same geo-location and time are searched.)
  • Another implementation is illustrated by a vacationer who snaps a low resolution image of a bluff overlooking the Pacific Ocean. Since the low resolution includes geolocation information steganographically embedded therein (e.g., longitude, latitude, date, time, and/or viewing angle, etc.) the vacationer can find a higher- resolution image, perhaps online, that cooesponds to the lower-resolution image. (The details are straight forward at this point in this patent document: a watermark decoder finds and decodes a digital watermark that is steganographically embedded in the low- resolution image. The digital wateonark includes or links to location information.
  • geolocation information steganographically embedded therein e.g., longitude, latitude, date, time, and/or viewing angle, etc.
  • the details are straight forward at this point in this patent document: a watermark decoder finds and decodes a digital watermark that is steganographically embedded in the low- resolution image.
  • the digital wateonark
  • the location information is provided to a database or image search engine, which finds other images that cooespond with the geocoordinates of the low-resolution image.
  • the vacationer peruses the images and selects one or more higher resolution images. These images can be added, e.g., to the vacationer's photo album, e.g., paper, DVD or electronic album.).
  • Digital watermarking is used to help create a travel log, visual representation of a trip and/or to aid in graphical picture management.
  • a traveler takes pictures while vacationing in the Western United States of America.
  • the traveler takes her pictures with a GPS-equipped camera (or a camera receiving or communicating with location information).
  • the camera can use a triangulation approach common in some cell phones.
  • the camera e.g., a cell phone including a camera
  • receives location information from a cell tower which is typically derived based on reception of cell phone signals at a plurality of cell towers. Regardless of the source of the location information, the location information is steganographically embedded in images taken by the camera (FIG. 5).
  • a controller 100 e.g., a software application, software plug-in, processor under the control of software, or software or hardware module
  • a controller 100 includes or cooperates with a steganographic decoder 120 (e.g., a digital watermarking decoder).
  • the decoder 120 analyzes the images in the Trip directory to decode the embedded location information (e.g., longitude and latitude, and/or other geocoordinates and/or metadata associated with the images or objects depicted in the images).
  • the controller 100 cooperates with a map software application 140 (e.g., MapPoint or Pocket Streets provided by Microsoft, online GeoSnapper.com, or Keyhole products by Keyhole, Inc., etc.).
  • a map software application 140 e.g., MapPoint or Pocket Streets provided by Microsoft, online GeoSnapper.com, or Keyhole products by Keyhole, Inc., etc.
  • the controller 100 is integrated in or associated with (e.g., as a plug-in) the map software application 140 itself.
  • the controller 100 is a separate, but cooperating, module. If a separate module, access to map software application 140 typically occurs through a software application program interface (API). Such cooperation may even occur over a network like the internet or home network.
  • API software application program interface
  • map software application 140 like MapPoint for example, a user is preferable able to locate and illustrate points on maps (e.g., with so-called "pushpins" or other graphic or visual objects), with either the user's own data or other information.
  • MapPoint a map software application 140
  • the map application 140 preferably allows information to be imported thereto.
  • the controller 100 provides the map application 140 with location information decoded from the images.
  • the controller 100 can optionally provide a graphic or visual object to the map application 140 that is associated with the location information.
  • the controller 100 generates or obtains a thumbnail image that is associated with an image in the Trip directory and provides the thumbnail image to the map application 140.
  • the map application 140 identifies or generates a map that is associated with the location information.
  • the map is provided for display, along with an object representation associated with the provided information. If the controller 100 passed in objects (e.g., thumbnail images) to the map application 140, the objects can be displayed according to their relative position on the map. For example, with reference to FIG. 7, a map of the Western United States of America is displayed by map application 140.
  • the map includes thumbnail images aoanged geospatially relative to where the images were taken. (For example, photo 2 depicts a scene near La Grande, Oregon USA. Thus, photo 2 is positioned near La Grande on the FIG. 7 map.).
  • Visual or graphical objects can be associated with related information via, e.g., watermark indexing, hyperlinks or object linking and embedding (OLE).
  • the related information may include images or groups of images. Referring back to photo 2 (FIG. 7), clicking on the thumbnail photo may link a user to a higher resolution image of the photo 2, or to a group of images that are related (preferably by geolocation) to photo 2.
  • photo 2 may link to (or show) metadata, a website or audio/video clips.
  • the photograph may be associated with audio or video files that were taken at or near the geolocation.
  • the photo 2 may also link to (or show) metadata (e.g., date/time, coordinates, camera, photographer, weather or lighting conditions, etc.), text (e.g., a Word file including a trip journal), a website photo gallery or to a collage or photo-mosaic of photos from the trip.
  • metadata e.g., date/time, coordinates, camera, photographer, weather or lighting conditions, etc.
  • text e.g., a Word file including a trip journal
  • FIG. 7 also shows a highlighted route 40 between objects (and associated geo locations) provided by controller 100 (Fig. 6).
  • the route is preferably automatically generated once the geolocations are passed to the map application 140 by the controller 100.
  • the map application 14 automatically generates and highlights a probably route between the two locations.
  • the application optionally prompts (e.g., through a graphical user interface or pop-up window) the user to ensure that the generated route cooesponds to the actual route traveled.).
  • Map application 140 preferably allows a user to zoom in and zoom out of a map area.
  • An improvement is to provide or display a higher resolution image (relative to a thumbnail image) as the user zooms in. For example, if a user zooms in around the area associated with photo 2, a higher resolution image is displayed with the zoomed-in region. The higher resolution image is automatically retrieved via the object's associated link.
  • a first user captures an image with a camera.
  • the camera may cooperate with (e.g., via BlueTooth or tethered cable) or be inco ⁇ orated in a cell phone (as shown in FIG. 8 A).
  • Location information e.g., longitude and latitude
  • the embedded image is then email or otherwise communicated to a second user as shown in FIG. 8B.
  • the second user opens the message and a steganographic decoder analyzes the image to obtain the embedded location information.
  • the location information is provided to a map application (e.g., Pocket Streets or GeoSnapper.com).
  • the first user's location (or a location associated with the transmitted image) is displayed on a map (FIG. 8C). Like the implementation discussed above with respect to FIG. 7, the image or a thumbnail representation of the image can be displayed at or by the user's first location.
  • the second user need not be a mobile user.
  • a first mobile user e.g., a grandson
  • the pictures are steganographically embedded with their respective location information.
  • the first user communicates the embedded pictures to a second user (e.g., a grandmother).
  • the second user's home or laptop computer decodes the embedded location information and provides the location information to a map application, which displays the location of the images relative to a map.
  • the second user remotely tracks the travels of the first user via steganographically embedded images.
  • Voice commands are used to identify a location, which is embedded in a captured image.
  • a photographer takes a picture of a natural hot springs near McCall, Idaho USA.
  • the photographer talks into a microphone (e.g., the photographer says: "Hot springs near McCall, Idaho.”).
  • the captured speech is analyzed via speech recognition or audio analysis software. Recognized speech is used to identify a location associated with the hot springs.
  • the location is preferably embedded in the image.
  • Captured or recognized speech can also be used as metadata associated with the picture (e.g., a voice journal).
  • the image can include a link to a storage location at which the audio (e.g., voice journal) stored.
  • Another implementation uses voice input as a watermark component. For example, a photographer audibly describes which of his children are depicted in a photograph (e.g., via a microphone in the camera; or, later, at home when the photographer reviews the pictures). Speech analyses or recognition software associates the speech with an identifier. For example, the word "Jane" is mapped or reduced to an identifier. The identifier is steganographically embedded in the cooesponding image. The embedded image is stored in a directory or in an electronic album. Later, the embedded information (e.g., identifier representing "Jane”) can be used to identify that Jane is depicted in the image.
  • identifier e.g., identifier representing "Jane
  • Embedded identifiers can be used to represent places, objects, people, trips, etc. in a similar manner.
  • Image search engines e.g., to search an electronic photo album or the internet
  • a method of identifying locations on a map, wherein the map is to be displayed via a computer display comprising: receiving data representing a first image; analyzing the data to obtain information steganographically encoded therein, wherein the information comprises or links to first location information associated with the first image; providing a map including an area associated with the first location information, wherein the map is to be displayed via a computer display; and visually or graphically identifying a first location on the map that is associated with the first location information.
  • A5. The combination of A4, wherein the object comprises a representation of the first image.
  • A6 The combination of A4, wherein the object comprises a thumbnail representation of the first image.
  • A7 The combination of A4, wherein the object is associated with a link.
  • A8 The combination of A7, wherein the link links to a copy of the first image.
  • A9 The combination of A7, wherein the link links to a plurality of images that are associated with the first location information.
  • AlO The combination of A7, wherein the link links to metadata associated with the first image.
  • Al 1 The combination of AlO, wherein the metadata comprises at least one of audio, video, text, and document files.
  • A12. The combination of Al, further comprising: receiving data representing a second image; analyzing the data to obtain information steganographically encoded therein, wherein the information composes or links to second location information associated with the second image; and visually or graphically identifying a second location on the map that is associated with the second location information
  • A13 The combination of A12, further comprising generating a route between the first location and the second location.
  • A14 The combination of A13, wherein the route is highlighted on the map.
  • a computer readable medium have computer executable instructions stored thereon, the instructions comprising instructions to cause a processor to carry out the method of any one of A1-A14.
  • a method of representing a location comprising: receiving an image captured from a first wireless device, wherein the image comprises location infoonation steganographic embedded therein; decoding the steganographic embedding to obtain the location information; by using the location information or information identified by the location information, identifying a map representing a location associated with the location information; and displaying the map.
  • B2 The combination of Bl, further comprising displaying a visual or graphical object on or with the map to identify the location.
  • B3 The combination of Bl, wherein the object comprises a representation of the image.
  • B4 The combination of Bl, wherein the method is carried out at least in part on a second wireless device.
  • B5. The combination of any one of B1-B5, wherein the first wireless device comprises at least one of a cell phone and a wireless, portable computing device.
  • B6 The combination of B4, wherein the second wireless device comprises at least one of a cell phone and wireless, portable computing device.
  • a computer readable medium have computer executable instructions stored thereon, the instructions comprising instructions to cause a processor to caoy out the method of any one of B1-B6.
  • a computer comprising: a display; a processor; a communications bus; and memory in communication with said processor via said communications bus, wherein said memory comprises instructions stored therein for execution by said processor, said instructions comprising instructions to: decode a digital watermark embedded in an image, the digital watermark including location information; provide the location information to a map software module, wherein said map software module, upon receipt of the location information, provides a map depicting at least one area associated with the location information, and provides a visual or graphical object on the map to identify the area.
  • the instructions further include instructions to: provide a reduced-bit representation of the image for use by the map software module, wherein the object comprises the reduced-bit representation of the image.
  • Dl A method of managing images, wherein each of the images comprise plural-bit data steganographically embedded therein in the form of a digital wateonark, and wherein the plural-bit data cooesponds to a geo-location, said method comprising: receiving a first query regarding a first geo-location; identifying images cooesponding to the first geo-location; providing at least a listing of the images corresponding to the first geo-location; and in response to the listing receiving a second query narrowing the listing.
  • D2 The combination of Dl, wherein the second query comprises a date range.
  • D4 The combination of D 1 , wherein the second query comprises a directional angle.
  • a method of managing images wherein at least some of the images comprise plural-bit data steganographically embedded therein in the form of a digital watermark, and wherein the plural-bit data cooesponds to a geo-location, said method comprising: receiving a first query cooesponding to a first geo-location and a first image capture angle; identifying images cooesponding to the first geo-location and first image capture angle; providing at least a listing of the images cooesponding to the first geo-location and first image capture angle.
  • a method of sharing images in a file sharing network wherein each of the images comprise plural-bit data steganographically embedded therein in the form of a digital watermark, and wherein the plural-bit data cooesponds to a geo-location, said method comprising: maintaining a catalog on a computer server comprising a listing of images indexed according to geo-location, the catalog comprising an internet address associated with the images; and providing a sub-set of the catalog in response to a geo-location based inquiry.
  • Gl A method comprising: receiving an image including a digital watermark embedded therein, wherein the digital watermark comprises location information; decoding the digital watermark to obtain the location information; identifying a map depicting a location cooesponding to the location infoonation; and providing the map for access over a computer network.
  • G2 The combination of Gl, further comprising identifying a location on the map that is particularly associated with the location.
  • HI A method of providing searchable images comprising: receiving audio associated with an image; reducing the audio to an identifier; and embedding the identifier in the image as a steganographic component or storing the identifier in a header associated with the image. [0122] H2. A combination of HI , wherein further comprising adding the identifier to a table or data record, wherein the table or data record maps the audio to the identifier.
  • H3 A combination of H2, wherein the table or data record is mapped to the audio through text representing the audio.
  • H4 A combination of H2, wherein the table or data record is mapped to the audio through a pattern match of the audio.
  • a first watermark may include information evidencing (or pointing to) georeferencing information
  • a second watermark includes a database identifier or location.
  • the second watermark may alternatively include (or point toward) information pertaining to events, people or animals identified in the photograph, occasions, groups, institutions, copyright ownership, etc.
  • an image may include both a robust watermark and a copy-tamper fragile watermark.
  • map is intended to apply to a wide variety of maps including, but not limited to, street maps, teoain maps, demographics maps, photographic maps (e.g., think satellite images or Keyhole, Inc.), topographical maps, physical maps, geological maps, historical maps, nautical charts, 3D-representations, political maps, road maps, Geographical Information System (GIS) layers, etc., etc.
  • GIS Geographical Information System
  • the methods, processes, and systems described above may be implemented in hardware, software or a combination of hardware and software.
  • the location information encoding processes may be implemented in a programmable computer or a special pu ⁇ ose digital circuit.
  • location information decoding may be implemented in software, firmware, hardware, or combinations of software, firmware and hardware.
  • the methods and processes described above may be implemented in programs executed from a system's memory (a computer readable medium, such as an electronic, optical or magnetic storage device).

Abstract

The disclosure describes methods and apparatus for providing digital watermarks in image data. One implementation embeds digital watermarks on-chip with respect to a CMOS or CCD image array. Some implementations introduce a watermark component during image capture, the watermark being introduced through variations in physical characteristics of a set of pixels. Other implementations involve managing images through geo-location information embedded therein. The disclosure also describes methods and apparatus for identifying travel points through digital watermarked images. For example, an image includes location information steganographically embedded therein. The location information is used to identify or provide a map corresponding to the location information. A location on the map that is associated with the location information is visually marked with an object. In some implementations the object is the image or a thumbnail version of the image.

Description

Digital Watermarking Image Signals On-Chip and Photographic Travel Logs through Digital Watermarking
Related Application Data
[0001] This application claims the benefit of U.S. Provisional Patent Application Nos. 60/542,095, filed February 4, 2004, and 60/600,618, filed August 9, 2004. This patent application is also related to U.S. Patent Application No. 10/053,488 (published as US 2002-0120849 Al), filed November 2, 2001. The 10/053,488 application claims priority to U.S. Provisional Patent Application No. 60/327,687, filed October 5, 2001. The 10/053,488 patent application is also related to U.S. Patent Application No. 09/503,881 (now U.S. Patent No. 6,614,914), filed February 14, 2000.
Technical Field
[0002] The present invention relates to digital watermarking and steganography. In first implementations, the present invention relates to digital watermarking - on chip - signals produced from a CMOS or other image sensor. The present invention also relates to communication and image management. In second implementations, the present invention relates to watermarking images with location information (e.g., GPS data) to facilitate image management and creation of visual travel logs.
Background and Summary
[0003] Digital watermarking is a process for modifying physical or electronic media to embed a machine-readable code into the media. The media may be modified such that the embedded code is imperceptible or nearly imperceptible to the user, yet may be detected through an automated detection process. Most commonly, digital watermarking is applied to media signals such as image signals, audio signals, and video signals. However, it may also be applied to other types of media objects, including documents (e.g., through line, word or character shifting), software, multidimensional graphics models, and surface textures of objects.
[0004] Digital watermarking systems typically have two primary components: an encoder (or "embedder") that embeds the watermark in a host media signal, and a decoder that detects and reads the embedded watermark from a signal suspected of containing a watermark (a suspect signal). The encoder embeds a watermark by subtly altering the host media signal. The physical manifestation of altered host media most commonly takes the form of altered signal values, such as slightly changed pixel values, image luminance, color or color values, picture colors, altered DCT coefficients, etc. The detector component analyzes a suspect signal to detect whether a watermark is present. In applications where the watermark encodes information, the reader extracts this information from the detected watermark.
[0005] Several particular watermarking techniques have been developed. The reader is presumed to be familiar with the literature in this field. Example techniques for embedding and detecting imperceptible watermarks in media signals are detailed in the assignee's U.S. Patent Nos. 5,862,260, 6,122,403 and 6,614,914.
[0006] Some of the present methods and apparatus are provided to affect embedding a digital watermark (or other steganographic indicia) in signals created by a CMOS or other image sensor. Watermark embedding is preferably integrated "on-chip." The term on-chip is used to reflect that at least a portion of watermark embedding is facilitated through circuits, electronics or logic provided on silicon or other semiconductor structure associated or in communication with an imaging aoay. In some implementations the embedding circuitry is co-located with an image sensor array. In other implementations the CMOS sensor array communicates with embedding circuits on a remote chip location.
[0007] CMOS imagers are well known in the art, e.g., see U.S. Patent Nos. 6,645,788, 6,654,057, 6,639,261, 5,708,263 and 5,471,515. The literature is also full of illustrative work including, e.g., Nixon et al., "256X256 CMOS Active Pixel Sensor Camera-on-a-Chip," IEEE Journal of Solid-State Circuits, Vol. 31(12) pp. 2046-2050, 1996; and Mendis et al, "CMOS Active Pixel Image Sensors," LEEE Transactions on Electron Devices, Vol. 41(3) pp. 452-453, 1994.
[0008] As discussed in at least some of the above-mentioned patents, a CMOS imager circuit may include a focal plane array of pixel cells, each one of the cells including a photo-detector, e.g., a photogate, photoconductor or a photodiode, overlying a substrate for accumulating photo-generated charge in the underlying portion of the substrate. A readout circuit is connected to pixel cells and may include an output field effect transistor formed in the substrate and a charge transfer section formed on the substrate adjacent the photogate, photoconductor or photodiode having a sensing node, typically a floating diffusion node, connected to the gate of an output transistor. The imager may include an electronic device (such as a transistor) for transferring charge from the underlying portion of the substrate to the floating diffusion node and a device for resetting the node to a predetermined charge level prior to charge transference. In an exemplary CMOS imager, the active elements of a pixel cell preferably perform functions, e.g., of: (1) photon (e.g., light) to charge conversion; (2) accumulation of image charge; (3) transfer of charge to the floating diffusion node accompanied by charge amplification; (4) resetting a floating diffusion node to a known state; (5) selection of a pixel or image area for readout; and (6) output and amplification of a signal representing pixel charge.
[0009] A communications channel (or "grid" including rows and columns) overlays most, if not all, of a pixel array to apply timing, control and read out signals and an array of column output signal interconnects. Column lines connect to electronics that are arranged by column outside of the pixel array. This type of architecture allows signals from the entire array, a portion of the array (e.g., rows or pixel windows), or a single pixel in the array to be read out by simple X-Y addressing or row/column clocking. [0010] (Of course, our inventive watermarking techniques apply to other on-chip imagers including CCD sensors and other CMOS configurations. Thus, the above imager description illustrates only a few of the many possible on-chip environments in which our inventive techniques flourish. As will be appreciated by those of ordinary skill in the art, there are many other on-chip environments are suitably interchangeable with our watermarking methods and apparatus.).
[0011] A first aspect of the invention is a method of introducing a digital watermark component to imagery generated by an image sensor (e.g., a CMOS or other image sensor). The image sensor includes a plurality of pixels. The method includes providing slight variations to physical characteristics of a set of the plurality of pixels. The variations are provided so as to introduce the digital watermark component during image capture. The method further includes generating imagery with the image sensor. The imagery includes the digital watermark component.
[0012] Another aspect of the invention is a method of embedding a digital watermark in image data captured by an imager. The watermark embedding occurs on-chip with the imager, and the imager includes a plurality of pixels. Each of the plurality of pixels is filtered to represent a single color. The method includes, prior to approximating a multi-color value for each pixel, adjusting single color values for select pixels. The adjusting introduces a digital watermark into the image data. The method further includes approximating a multi-color value for each pixel.
[0013] GPS or location data can be provided to a watermark embedder located, e.g., on-chip with or external to, an image sensor. The watermark embedder can embed the GPS coordinates or other location data, perhaps with a timestamp, in data captured by the image sensor. Location data can be combined or associated with an operator or photographer identifier (e.g., a plural-bit identifier) to even further identify imagery captured by the image sensor. [0014] Accordingly, yet another aspect of the invention is a method including: i) receiving an image including a digital watermark embedded therein, wherein the digital watermark comprises location information; ii) decoding the digital watermark to obtain the location information; iii) identifying a map depicting a location corresponding to the location information; and iv) providing the map for access over a computer network.
[0015] Still another aspect of the invention is a method of visually or graphically identifying locations on a map. The map is to be displayed via a computer display. The method includes receiving data representing a first image, and analyzing the data to obtain information steganographically encoded therein. The information includes or links to first location information associated with the first image. The method further includes providing a map including an area associated with the first location information, wherein the map is to be displayed via a computer display, and identifying a first location on the map that is associated with the first location information. In some implementations identification of a first location includes providing a visual or graphical object on the map at or near a map location that is associated with the first location information. In some cases the object includes a representation (e.g., a "thumbnail") of the first image.
[0016] Another aspect of the invention is a method of representing a geographically location. The method includes receiving an image captured from a first cell phone. The image includes location information steganographic embedded therein. The method further includes decoding the steganographic embedding to obtain the location information; by using the location information or information identified by the location information, identifying a map representing a location associated with the location information; and displaying the map. In some implementations the method includes displaying a visual or graphical object on the map to identify the location. The object may include a representation of the image. [0017] Further features, advantages and aspects of the present invention become even more apparent with reference to the following detailed description and accompanying drawings.
Brief Description of the Drawings
[0018] FIG. 1 is a block diagram illustrating a CMOS pixel array.
[0019] FIG. 2 A is a block diagram for one implementation of an on-chip watermark embedder; and FIG. 2B is a block diagram for another implementation of an on-chip watermark embedder.
[0020] FIG. 3 illustrates on-chip parallel watermark embedding modules.
[0021] FIG. 4 illustrates image capture of a similar geo-location, but from different camera angles.
[0022] FIG. 5 illustrates an image including location information encoded therein.
[0023] FIG. 6 is a block diagram illustrating interaction of a controller with a map application.
[0024] FIG. 7 illustrates a map generated by a map application, including visual or graphical objects displayed therewith.
[0025] FIG. 8A illustrates image capture with a first mobile device; FIG. 8B illustrates commumcation of a captured image to a second mobile device; and FIG. 8C illustrates the second device showing a corresponding map with which the image corresponds to. Detailed Description
Introduction
[0026] The detailed description is organized into two main sections: i) embedding auxiliary information on-chip in, e.g., CMOS sensors; and ii) watermarking location information in images and related applications. The division into sections (and subsections) is not intended to limit the scope of the present invention. We imagine that methods and apparatus discussed under one section can be readily applied and combined with method and apparatus discussed under another section.
Embedding Auxiliary Information On-Chip
CMOS Imaser Array
[0027] FIG. 1 is a general block diagram of a CMOS imager array 10. The array 10 includes rows and columns of photo-detectors. Each photo-detector preferably corresponds with an image pixel. Each photo-detector may include active circuitry, e.g., a signal amplifier (allowing for a so-called "active-pixel sensor"). While the aoay 10 is illustrated as including twenty- five photo-detectors, it will be appreciated that an actual imager aoay may include millions of photo-detectors. The array 10 includes a communications network or signal grid to allow image or pixel information to be read out from pixel locations. The network may even allow for a pixel window, block of data, or rows to be output from the aoay. A window selection (or direct random access ability) allows a CMOS sensor to intelligently choose to readout select groups of pixels rather than the entire sensor array. Of course the array 10 may cooperate with a variety of other circuitry including, e.g., timing control, row and column drivers, decoders, analog to digital converters, color converters, memory, etc.
[0028] Photodetectors typically record intensity of light from full black to white, with appropriate intervening gray. To provide color, a layer of color filters is provided over an aoay of photo-detectors. For color imagers, each photo-detector cooperates with a color filter (e.g., red (R), green (G) or blue (B)) or a portion of a color filter aoay (CFA). As photons pass through the filter to reach the photo-detector, only wavelengths cooesponding to a particular color lens reach the photo-detectors. The filters can be arranged in a predetermined pattern, e.g., the Bayer pattern:
G R G R G B G B G B G R G R G B G B G B
[0029] Raw color data is read out from the array (e.g., row by row or via window selection). The raw color data is processed, e.g., amplified, adjusted, converted, etc. A color converter converts color data into RGB values per pixel. Color values for individual pixels are determined through various forms of estimation (e.g., interpolation, quadratic estimation, cubic spline, linear, nearest neighbor comparison, etc.). For example, a 24-bit value per pixel is determined (8-bits for red, 8-bits for green and 8-bits for blue). This color conversion is typically performed on-chip. (Some CMOS designs call for color conversion co-located with the pixels themselves, while other designs communicate image data to a color converter or other on-chip image processing circuitry.) RGB image data is provided from the chip or imager as an output. Of course, instead of RGB values, a CMY conversion could be undertaken as well.
[0030] (For a monochrome imager - or more precisely a "panchromic imager" — each pixel value cooesponds to a gray-scale value. The gray-scale value per pixel is output from the chip, perhaps after signal processing.)
[0031] Of course, a CMOS sensor may also include a compression module (e.g., JPEG or MPEG) for compressing image data.
Watermarking Image Data
[0032] Assignee Digimarc Corporation has previously contemplated the manifestation of watermark functionality through dedicated hardware as discussed, e.g., in U.S. Patent Nos. 5,862,260, 6,674,876 and 6,549,638, and contemplated watermarking circuitry being co-located on chip with CMOS imagers, e.g., as discussed in U.S. Patent No. 6,650,761.
[0033] Some improvements and alternative aoangements are detailed herein.
[0034] With reference to FIG. 2A, we provide a digital watermark embedder co- located on-chip to watermark image data. In one implementation the watermark embedder includes a Signal Generator 22 and Signal Combiner 24. The Signal Generator 22 receives an orientation component and message as inputs. An orientation component helps to make a watermark more robust to geometric distortion (e.g., scaling, rotation, translation, etc.), or may help identify certain message bits.
[0035] One type of watermark orientation signal is an image signal that comprises a set of impulse functions in a transform domain, like a Fourier magnitude domain, e.g., each with pseudorandom phase. To detect rotation and scale of a watermarked image (e.g., after printing and scanning of the watermarked image), a watermark decoder converts the watermarked image to the Fourier magnitude domain and then performs, e.g., a log polar resampling of the Fourier magnitude image. A generalized matched filter cooelates a known orientation signal with the re-sampled watermarked signal to find the rotation and scale parameters providing the highest cooelation. A watermark decoder performs additional cooelation operations between the phase information of the known orientation signal and the watermarked signal to determine translation parameters, which identify the origin of the watermark message signal. Having determined the rotation, scale and translation of the watermark signal, the reader then adjusts the image data to compensate for this distortion, and extracts the watermark message signal, if any. Alternative orientation components include a predetermined start string or message property which aids message detection. Still other orientation components are known to those of ordinary skill in the art and can be suitably interchanged with related aspect of the invention. [0036] The Signal Generator 22 provides a watermark signal to the Combiner 24. The Combiner 24 combines watermark signal with image data. The image data may cooespond with: i) RGB (or CMY) data after color conversion; ii) raw, pre-color conversion, data (e.g., pre-Bayer pattern reconstruction); or iii) compressed color converted image data. The Combiner 24 outputs an embedded or watermarked image signal. The Signal Generator 22 may provide raw data bits to Combiner 24 or even a more sophisticated signal, such as an image data block or line. The message can be eoor corrected and spread or expanded, and in some implementations the message and orientation components are provided as a combined signal.
[0037] If embedding pre-color conversion data, a watermark embedder may use knowledge of an expected color conversion process (e.g., inteφolation) to help efficiently embed a watermark signal. For example, a 24-bit color value for a first pixel may have color contribution from adjacent or neighboring pixels. A watermark embedder may tweak (or adjust) data from multiple pixels that will ultimately affect the first pixel's 24-bit color value. Similarly, a watermark decoder may then use knowledge of a color conversion process to ensure proper detection. Or is a color conversion is expected to use an inteφolation, the embedder may use this knowledge to weight or adjust certain pixels relative to other pixels so as to convey a watermark in the post-inteφolated color data.
[0038] Embedding pre-color conversion data also efficiently facilitates embedding image data, row-by-row or block-by-block. Embedding can also take place in parallel, as shown in FIG. 3, wherein multiple embedding units are provided. Multiple embedding units, while they may take up more chip space, significantly reduce embedding time. Prior to color processing, image data is embedded by separate embedders. First embedding units may, optionally, communicate image data statistics to later or following embedders (shown with the dotted arrows in FIG. 3). The later or following embedders use the statistics to (e.g., color properties, noise analysis, sensor characteristics, variance, etc.) as inputs to adjust their embedding process. Such adjustments may, e.g., increase or decrease watermark signal strength, alter or switch between different embedding protocols or even isolate certain image regions for selective embedding. We discuss above how certain imagers may allow for image windows (e.g., a block of pixels) to be read from an image aoay. One improvement is watermark only pixels within a block that is selected from an image array. Once the window is selected, pixels within the window are communicated to one or more watermark embedders. The watermark may include an array location to help identify where in the aoay the pixel window was extracted from.
[0039] Another useful tool in watermark embedding and reading is perceptual analysis. Perceptual analysis refers generally to techniques for evaluating signal properties based on the extent to which those properties are (or are likely to be) perceptible to humans (e.g., listeners or viewers of the media content). The illustrated watermark embedder (e.g., blocks 22 and 24 in FIGS. 2A and 2B) can optionally include or cooperate with a Human Visual System (HVS) model 26 to determine where to place a watermark and how to control the intensity of the watermark so that chances of accurately recovering the watermark are enhanced, resistance to tampering is increased, and perceptibility of the watermark is reduced. Such perceptual analysis can play an integral role in gain control because it helps indicate how the gain can be adjusted relative to the impact on the perceptibility of the watermark. Perceptual analysis can also play an integral role in locating the watermark in a host signal. For example, one might design the embedder to hide a watermark in portions of a host signal that are more likely to mask the watermark from human perception.
[0040] Various forms of statistical analyses may be performed on a signal to identify places to locate the watermark, and to identify places where to extract the watermark. For example, a statistical analysis can identify portions of a host image that have noiselike properties that are likely to make recovery of the watermark signal difficult. Similarly, statistical analyses may be used to characterize the host signal to determine where to locate the watermark. [0041] Each of the techniques may be used alone, in various combinations, and in combination with other signal processing techniques.
[0042] The watermark may be embedded in one or more of the color components of an image. For example, when embedding pre-color reconstructed image data, a watermark may be selectively embedded only in the red channel. Or, a weighting scheme may distribute a watermark only between the red and blue and/or green channels. In some implementations, the embedder may transform the input image into a target color space, and then proceed with the embedding process in that color space.
Message [0043] Since watermark embedding is occurring on-chip, there are several different ways to efficiently facilitate message creation.
[0044] In a first implementation a message is static. That is, the message is the same for all images. The static message is uniquely associated with particular silicon manufacturing mask, manufacturer, intended customer, or even a particular chip batch run. The message is stored, e.g., in on-chip registers or ROM and embedded in each image produced by the image sensor.
[0045] In another implementation, a message has a static component and a dynamic component. The dynamic component can be provided by a number of different methods. For example, if a CMOS chip includes EPROM-like fuses, particular fuses are blown to create a unique identifier. More likely is for a CMOS chip to include or communicate with RAM. The dynamic identifier is provided from RAM (or another interface) for embedding.
[0046] In still another implementation, an entire watermark payload is dynamic. That is, the message is unique for each image, for a set of images or personalized for a particular user or application. For example, the watermark message may include unique plural bits that identify a particular cell phone or sensor in which the imager is incoφorated. The unique plural bits are communicated to the embedder for embedding in image data. In other implementations the unique plural bits cooespond to a user's biometric. The biometric is embedded in the imagery. For example, a cell phone includes or communicates with a fingeφrint reader. The fingeφrint reader captures a user's fingeφrint. The fingeφrint is hashed or otherwise represented, e.g., as discussed in assignee's U.S. Patent Application No. 10/893,141, filed August 7, 2003. The hash or representation is used as a watermark component which ties the imagery to a user or photographer. Instead of a biometric a user may be required to enter her PIN or password prior to device operation. The user is identified from such and a user ID is embedded in each image.
Fixed Orientation Component [0047] We can reduce embedding time and gate complexity by introducing a steganographic orientation component during image data capture, instead of tweaking captured image data to embed such an orientation component at a later embedder stage. To accomplish this we introduce slight physical variations to a set of photodetectors located in an image aoay during chip manufacture. The variations provide a subtle image characteristics (e.g., color changes) or value offsets - analogous to subtle fixed pattern noise. The variations need not be the same from pixel to pixel, and may vary to achieve a fixed orientation component. The variations are introduced to the pixel aoay in a predetermined pattern cooesponding to an orientation component. Thus, collectively, the offset values introduce an orientation component in the image data. Of course, the orientation component can be repeated, e.g., in 64X64 or 128X128 pixel blocks, across the sensor aoay. The variations can be provided in a number of ways, including changing the potential, doping or characteristics of select photodiodes or photogates to introduce image data offsets during the manufacture process. These image offsets are slight - preferably imperceptible to a human observer of resulting image data, while still collectively conveying a steganographic component in captured imagery. The variations introduce a fixed watermark component in all imagery captured by the image sensor. With reference to FIG. 2B, image data including a fixed watermark component is provided to a watermark embedder. The embedder receives a variable component (e.g., a message) and embeds the variable component in the image data. If, for example, the fixed component includes a watermark orientation component, the variable component is preferably registered with the fixed component and then embedded in imagery. Registration of the variable component with the fixed component is simplified since the embedder knows how (and where) the fixed component is aligned in the sensor aoay.
[0048] Instead of changing the physical characteristics of a photo-detector, an orientation component can be similarly introduced by altering a set of color filters or microlens. A pattern is designed to cooespond with an orientation component. The altered filters or microlens are then aoanged in the pattern to convey the orientation component. (For example, the altered lens or filter may provide a subtle color value offset. Collectively, a set of the offset values is sufficient to convey the orientation component in the captured image data itself. Thus, a CMOS sensor is manufactured so as to embed a machine-readable feature during the process of image capture itself.)
[0049] Still further, in so-called active-pixel sensors, where each photo-sensor (pixel) cooperates with an amplifier, an orientation component is introduced by providing different signal amplifications values. That is, a set of amplifiers is arranged to introduce a subtle signal variation to image data. Thus, a fixed watermark component (e.g., an orientation component or fixed payload or message component) is conveyed through signal amplification at the pixel level of an image sensor.
[0050] In addition to reducing gate or circuitry complexity, introducing a fixed watermark orientation component during image capture allows for manufacturing quality control. For example, an image sensor is illuminated with white light. The resulting image data from the image sensor is read out and a watermark detector searches the image data to detect the orientation component. The orientation component is evaluated to ensure sensor integrity. (For example, if the orientation component is undetectable, or is detected in a degraded manner, a sensor defect is likely present.). [0051] Instead of (or in addition to) an orientation component, a fixed payload or message component can be introduced during image capture. The fixed payload may represent a chip batch or lot number, manufacturing process, chip type, intended recipient, creation date or location, etc.
Adjusting Embedding Based on Chip Characteristics
[0052] A watermark embedder (or HVS module) can be configured to take advantage of chip characteristics. For example, embedding is adjusted based on silicon characteristics or color processing. If the embedder (or HVS) determines the existence of fixed pattern noise, the embedding can use the noise to guide or mask embedding locations. The embedder (or HVS) can track statistics and image quality and make adjustments to compensate or increase imperceptibility.
[0053] Moreover, if the embedder HVS (or a plurality of embedders) are embedding or evaluating row-by-row or window-by- window, an embedder can gather image statistics regarding image data and use this data for embedding rows to come, or pass the statistics to other embedding modules. Multiple embedders also allow for enhanced rate control. As an example, if a system employs an embedder for each row of pixels (which pixels are embedded as they are clocked out), a rate-control algorithm can be imposed to ensure that for any given frame (or row) a fixed rate is achieved and that it is optimized for not only visibility, but resulting size of compressed bitstream. This allows an individual embedder to manage an amount of entropy per frame/window/row so as not to adversely affect compressed size.
Additional Applications
Image Authentication [0054] A sensor imager may optionally include additional circuitry to characterize image data. For example, the characterizing circuitry may generate a digital signature or hash (or fingeφrint) of an image or a subset of the image. The signature or hash is embedded as a component of a digital watermark. (We preferably use an algorithm that is insensitive to watermark embedding. That is, a signature or hashing algorithm will generate the same hash or signature despite the presence of a digital watermark embedded therein.). The signature or hash helps to establish whether the image has been tampered with. In some implementations we identify low frequency JPEG values and embed those values into image data, along with a date, time and location. The JPEG values, date, time and location serve to identify the image. Hashing can also provide detailed (e.g., row by row) image authentication. For example, we can generate a hash of a first row or block of pixels (e.g., based on color values or pre-color converted pixel values). The hash is embedded in a subsequent row or block of pixels. The process preferably continues to allow for each row or block of pixels to be hashed, with the hash being embedded as a watermark component in subsequent rows or blocks. If a pixel or row is altered, it will no longer correspond to the hash of that pixel or row. This method can be applied to post-compressed data as well. A hash is generated to represent a block of compressed image data. The hash is stored in a subsequent block of compressed data.
[0055] In another implementation, an embedder is integrated into the imager of a web camera. The image or video stream of the web camera carries an embedded digital watermark, either dynamic or static as above. A dynamic message component is provided from a host computer rather than a stand-alone web camera. This implementation supports secret messaging for consumers, or time stamping or otherwise tagging video for video management on a computer server, or even to help authenticate a video source. From a watermark detecting side, a web camera may include optimizations to help read a watermark. For example the web camera includes watermark pre-processing circuitry co-located with its image sensor. The circuitry may identify the presence of watermarking without decoding the watermarking and signal to a watermark detector to look closely at the particular imagery. The circuitry may also include hardware accelerations to speed watermark detection, or a protocol for handling keys and encryption to create private systems. [0056] If the watermark includes an orientation component, image data can be realigned, on-chip, to compensate for distortion relative to an expected orientation of the orientation component. This feature can be used for video stabilization (like a so- called "steady-cam" feature in some video cameras). That is, received image data is adjusted to better align to the watermark's expected orientation (e.g., in terms of rotation, scale and translation). An image sensor includes a digital watermark decoder. The decoder decodes watermarks to recover orientation information (relative to an expected or base orientation). The orientation information is provided to a controller (e.g., logic gates) which controls the image sensor to realign the data. Control may include shifting image data in the aoay (a buffer can be used to help move the data around), altering detector gain, inteφolating image data, etc. Thus, image data can be rotated or scaled - on chip - to compensate for a jittery photographer.
[0057] In encryption implementations, where at least a portion of a digital watermark component is encrypted, keys for encryption and keys for access to the digital watermark can be managed either internal or external to an on-chip watermark embedder. Externally, an encryption key can be supplied through hardware or firmware interface, which is communicated to an on-chip watermark embedder. Internally, an encryption key and even static payload portions preferably reside in onboard ROM, programmed during production or manufacturing of the CMOS sensor/embedder.
[0058] In addition to the combinations recited in the claims, a few additional combinations include:
[0059] Al. A method of embedding a steganographic component in imagery captured by an image sensor, wherein the image sensor comprises a plurality of rows of image detectors, with a first steganographic encoder associated with at least a first row of image detectors and a second steganographic encoder associated with at least a second row of image detectors, wherein the first steganographic encoder and the second steganographic encoder are co-located with the image sensor, said method comprising: embedding steganographic data in imagery captured by the first row of image detectors with the first steganographic encoder; and embedding steganographic data in imagery captured by the second row of image detectors with the second steganographic encoder.
[0060] A2. The combination of Al, further comprising gathering information associated with at least one of: i) image data captured by the first row of image detectors; ii) operation or characteristics of the first row of image detectors; and iii) the first steganographic encoder.
[0061] Bl. An image sensor comprising: a controller; an image sensor aoay; at least one watermark detector co-located with the image senor aoay, wherein the watermark detector operates to decode digital watermarks from imagery captured by the image sensor aoay, wherein the digital watermarks comprise an orientation component, and wherein the watermark detector provides ooentation infoonation, relative to an expected watermark orientation, to the controller, and wherein said controller operates at least to adjust imagery captured by the image sensor aoay according to the orientation information.
[0062] B2. A video camera including the image sensor of Bl .
[0063] B3. The combination of Bl or B2, wherein the controller stabilizes video captured by the image sensor.
[0064] CI . A method of marking image content captured by an image sensor comprising: generating a first reduced-bit representation of a first group of pixels; generating a second reduced-bit representation of a second group of pixels; embedding the first reduced-bit representation in the second group of pixels; and embedding the second reduced-bit representation in a third group of pixels.
[0065] C2. The combination of CI, further comprising generating a reduced-bit representation for each group of pixels in the image content and embedding the reduced-bit representations in different groups.
Embedding Location Data
[0066] Assignee's U.S. Published Patent Applications 2002-0122564 Al, 2002- 0124024 Al, 2002-0124171 Al and 2004-0008866 Al, U.S. Patent No. 6,664,976 and published PCT Application No. WO 02/071685 include details regarding embedding location information (e.g., GPS data) in image and video data. We disclose additional improvements herein.
[0067] GPS or location data can be provided to a watermark embedder located on chip with a CMOS sensor. (Of course, the applications discussed below are device- type independent. Instead of a CMOS sensor, we could use a CCD or other image sensor. For consistency - and not by way of limitation - we will usually refer to an image sensor as a "CMOS" sensor.) The watermark embedder embeds the GPS coordinates or other location data, perhaps with a timestamp, in data captured by the CMOS array. Location data can be combined or associated with an operator or photographer identifier (e.g., a plural-bit identifier) to even further identify imagery captured by the CMOS aoay. A camera can also create a list or log of images taken, cooelated by a depicted geo-location and/or a digital watermark identifier. The log can be secured, e.g., with encryption and conventional digital signatures. The secure log is communicated to a trusted party, who can then verify, via crosschecking an embedded location/timestamp or watermark identifier with the secure log, whether a particular image corresponds to the log. [0068] GPS embedded imagery can be used as a front end (or index) into a data repository or service like the service provided by direction guru MapQuest. For example, a CMOS camera cell phone captures an image at a particular geo-location. A GPS or other location data generator generates location information. The location information is provided to an on-chip watermark embedder that embeds the location information in the cooesponding image captured by the CMOS camera. The embedded image is provided to MapQuest (or to an image management service or software application). A MapQuest server includes a watermark detector to decode a watermark in the image to recover the location data. MapQuest tracks and manages images and related information (e.g., maps) based on the location data, e.g., depicted image location and image capture time/day.
[0069] MapQuest (or another service or application) can then provide a number of useful services. In one implementation, embedded location data is used to identify a corresponding location on a map. Consider an image depicting Bear Lake in Idaho. The image includes a digital watermark embedded therein with geo-coordinates associated with Bear Lake. Once decoded, the watermark location information is used to identify a map depicting the same or similar geographical area. The map is provided to the user through a computer (e.g., internet or intranet) or cellular network. If the user provides her cuoent location via a graphical user interface (e.g., cell phone or PC-based web browser) MapQuest can generate directions from the user's location to the watermark location, i.e., Bear Lake.
[0070] Another implementation associates related imagery based on their geo- locations. For example, a user queries an image management service, archive or application to determine whether it includes any images that are geographically similarly-located to a user provided (or selected) image. The service (or application or archive) decodes a digital watermark from the user provided or selected image to obtain location data. (Alternatively, the user's computer decodes the watermark and forwards only the decoded location data.) The location data is used to index an image archive to retrieve related images. [0071] A further improvement allows a user to select images based on geo-location or image conditions. For example, if the user likes a particular picture of Bear Lake, maybe she would enjoy another picture of the same location, but from a different angle, or different time of day, or even captured during a different season. These desired characteristics can be provided, along with a geo-location through a service interface. Of course, the service can establish a geo-location via an embedded image provided by the user via the service interface. Or, if the user is interested in shore erosion over the last 50 years, she may then request a picture of the same shoreline and image capture angle, but from 50 years ago. Digital watermarking provides a backbone for such a system. In prefeoed implementations an embedded digital wateonark includes the information, e.g., location, camera angle, date/time, season, depicted subject matter (e.g., lake, waterfall, grandkids, etc.); but, of course, the watermark may include a subset of such information and/or may include an identifier that is used to link to the information. The image may also include multiple watermarks. For example, a first watermark is embedded (on-chip) during image capture and includes location and capture time information, while a second watermark is embedded after image capture (off-chip) and may include more refined geo-coordinates and/or subject matter or key words.
[0072] Another example is discussed with reference to FIG. 4. Two images are captured of the Washington Monument, each from a different viewing angle. The images depict the same geo-location (or similar geo-location within an excepted tolerance). A digital wateonark is embedded in each image. The digital wateonark includes the geo-location and viewing angle (e.g., South or North, etc.) for each depicted image. The embedded information is used to identify the geo-location (i.e., the Washington Monument) and which viewing angle is shown (e.g., depicting a South by South- West viewing angle).
Finding Related Imagery [0073] Now consider these and other photographs available in a file-sharing network (e.g., Napster like) environment. A central server communicates with a plurality of user computers. Each of the user computers includes images stored thereon. The images include digital watermarks embedded therein with at least related location information. The watermark information is decoded (preferably by the user computers, but alternatively by the central server) to obtain the location information. The location information is used as an index or identifier and is stored by the central server. The central server maintains a listing of location information and cooesponding internet addresses of where the images are located. Users interface with the central server and query the listing with desired geo-coordinates. (Alternately, the user may query with text terms (e.g., Bear Lake or Washington Monument) for which the server identifies cooesponding geo-coordinates.). The central server provides a listing of related images for user access.
[0074] Consider the possibilities.
[0075] A user already has a picture of the Washington Monument from Viewing Angle 1 (see Fig. 4), but would like a complementary photograph from Viewing Angle 2. The user queries the filing sharing network (or a centralized database) with the watermark location information and the second viewing angle specifics. Candidate photographs are returned to the user for selection. Now consider an amateur photographer who takes a picture of the finish line at the Kentucky Derby (2004) as the wining horse gallops by. When the photographer arrives home, she finds that her photo-finish picture is bluoy or blocked. But not to worry, if using our inventive techniques, the photographer goes on-line and searches for the same GPS location, at the same time/date to find a better or related picture. The photographer may also specify an alternative image capture angle to find images from a different viewing perspective. Embedded location and time information provide the basis for such functionality. (Since the photographer's camera embedded geo-location information in her bluoy or blocked image, the photographer or photographer's watermark decoder extracts the watermark - revealing the location and time - and use the extracted watermark (or information contained therein) as an index or search term to ensure the same geo-location and time are searched.)
[0076] Another implementation is illustrated by a vacationer who snaps a low resolution image of a bluff overlooking the Pacific Ocean. Since the low resolution includes geolocation information steganographically embedded therein (e.g., longitude, latitude, date, time, and/or viewing angle, etc.) the vacationer can find a higher- resolution image, perhaps online, that cooesponds to the lower-resolution image. (The details are straight forward at this point in this patent document: a watermark decoder finds and decodes a digital watermark that is steganographically embedded in the low- resolution image. The digital wateonark includes or links to location information. The location information is provided to a database or image search engine, which finds other images that cooespond with the geocoordinates of the low-resolution image. The vacationer peruses the images and selects one or more higher resolution images. These images can be added, e.g., to the vacationer's photo album, e.g., paper, DVD or electronic album.).
Travel Log and Picture Management
[0077] Digital watermarking is used to help create a travel log, visual representation of a trip and/or to aid in graphical picture management. For example, a traveler takes pictures while vacationing in the Western United States of America. The traveler takes her pictures with a GPS-equipped camera (or a camera receiving or communicating with location information). Instead of a GPS-equipped camera, the camera can use a triangulation approach common in some cell phones. For example, the camera (e.g., a cell phone including a camera) receives location information from a cell tower, which is typically derived based on reception of cell phone signals at a plurality of cell towers. Regardless of the source of the location information, the location information is steganographically embedded in images taken by the camera (FIG. 5). Our prefeoed foon of steganographic embedding is digital watermarking. The location information can even be redundantly embedded in the images. [0078] The traveler transfers or communicates (e.g., wirelessly) the steganographically embedded photographs to a computer resource, directory or file (FIG. 6). By way of illustration, we'll call this computer resource, directory or file, "Trip." A controller 100 (e.g., a software application, software plug-in, processor under the control of software, or software or hardware module) includes or cooperates with a steganographic decoder 120 (e.g., a digital watermarking decoder). The decoder 120 analyzes the images in the Trip directory to decode the embedded location information (e.g., longitude and latitude, and/or other geocoordinates and/or metadata associated with the images or objects depicted in the images).
[0079] The controller 100 cooperates with a map software application 140 (e.g., MapPoint or Pocket Streets provided by Microsoft, online GeoSnapper.com, or Keyhole products by Keyhole, Inc., etc.). In some implementations the controller 100 is integrated in or associated with (e.g., as a plug-in) the map software application 140 itself. In other implementations the controller 100 is a separate, but cooperating, module. If a separate module, access to map software application 140 typically occurs through a software application program interface (API). Such cooperation may even occur over a network like the internet or home network. In the case of a map software application 140, like MapPoint for example, a user is preferable able to locate and illustrate points on maps (e.g., with so-called "pushpins" or other graphic or visual objects), with either the user's own data or other information. The map application 140 preferably allows information to be imported thereto.
[0080] The controller 100 provides the map application 140 with location information decoded from the images. The controller 100 can optionally provide a graphic or visual object to the map application 140 that is associated with the location information. For example, the controller 100 generates or obtains a thumbnail image that is associated with an image in the Trip directory and provides the thumbnail image to the map application 140. The map application 140 identifies or generates a map that is associated with the location information. The map is provided for display, along with an object representation associated with the provided information. If the controller 100 passed in objects (e.g., thumbnail images) to the map application 140, the objects can be displayed according to their relative position on the map. For example, with reference to FIG. 7, a map of the Western United States of America is displayed by map application 140. The map includes thumbnail images aoanged geospatially relative to where the images were taken. (For example, photo 2 depicts a scene near La Grande, Oregon USA. Thus, photo 2 is positioned near La Grande on the FIG. 7 map.).
[0081] Visual or graphical objects can be associated with related information via, e.g., watermark indexing, hyperlinks or object linking and embedding (OLE). The related information may include images or groups of images. Referring back to photo 2 (FIG. 7), clicking on the thumbnail photo may link a user to a higher resolution image of the photo 2, or to a group of images that are related (preferably by geolocation) to photo 2. Instead of linking to a related photograph, photo 2 may link to (or show) metadata, a website or audio/video clips. For example, the photograph may be associated with audio or video files that were taken at or near the geolocation. The photo 2 may also link to (or show) metadata (e.g., date/time, coordinates, camera, photographer, weather or lighting conditions, etc.), text (e.g., a Word file including a trip journal), a website photo gallery or to a collage or photo-mosaic of photos from the trip.
[0082] FIG. 7 also shows a highlighted route 40 between objects (and associated geo locations) provided by controller 100 (Fig. 6). The route is preferably automatically generated once the geolocations are passed to the map application 140 by the controller 100. (For example, given the geolocations associated with photo 2 and photo 3, the map application 14 automatically generates and highlights a probably route between the two locations. The application optionally prompts (e.g., through a graphical user interface or pop-up window) the user to ensure that the generated route cooesponds to the actual route traveled.).
[0083] Map application 140 preferably allows a user to zoom in and zoom out of a map area. An improvement is to provide or display a higher resolution image (relative to a thumbnail image) as the user zooms in. For example, if a user zooms in around the area associated with photo 2, a higher resolution image is displayed with the zoomed-in region. The higher resolution image is automatically retrieved via the object's associated link.
[0084] Our inventive techniques are also applicable to mobile users. For example, with reference to FIGS. 8A-8C, a first user captures an image with a camera. The camera may cooperate with (e.g., via BlueTooth or tethered cable) or be incoφorated in a cell phone (as shown in FIG. 8 A). Location information, e.g., longitude and latitude, are steganographically embedded in a captured image. The embedded image is then email or otherwise communicated to a second user as shown in FIG. 8B. The second user opens the message and a steganographic decoder analyzes the image to obtain the embedded location information. The location information is provided to a map application (e.g., Pocket Streets or GeoSnapper.com). The first user's location (or a location associated with the transmitted image) is displayed on a map (FIG. 8C). Like the implementation discussed above with respect to FIG. 7, the image or a thumbnail representation of the image can be displayed at or by the user's first location.
[0085] The second user need not be a mobile user. For example, a first mobile user (e.g., a grandson) takes pictures while hiking in the Rocky Mountains. The pictures are steganographically embedded with their respective location information. The first user communicates the embedded pictures to a second user (e.g., a grandmother). The second user's home or laptop computer decodes the embedded location information and provides the location information to a map application, which displays the location of the images relative to a map. Thus, the second user remotely tracks the travels of the first user via steganographically embedded images.
[0086] We use voice commands in some related implementations. Voice commands are used to identify a location, which is embedded in a captured image. For example, a photographer takes a picture of a natural hot springs near McCall, Idaho USA. The photographer talks into a microphone (e.g., the photographer says: "Hot springs near McCall, Idaho."). The captured speech is analyzed via speech recognition or audio analysis software. Recognized speech is used to identify a location associated with the hot springs. The location is preferably embedded in the image. Captured or recognized speech can also be used as metadata associated with the picture (e.g., a voice journal). The image can include a link to a storage location at which the audio (e.g., voice journal) stored.
[0087] Another implementation uses voice input as a watermark component. For example, a photographer audibly describes which of his children are depicted in a photograph (e.g., via a microphone in the camera; or, later, at home when the photographer reviews the pictures). Speech analyses or recognition software associates the speech with an identifier. For example, the word "Jane" is mapped or reduced to an identifier. The identifier is steganographically embedded in the cooesponding image. The embedded image is stored in a directory or in an electronic album. Later, the embedded information (e.g., identifier representing "Jane") can be used to identify that Jane is depicted in the image. Embedded identifiers can be used to represent places, objects, people, trips, etc. in a similar manner. Image search engines (e.g., to search an electronic photo album or the internet) decode steganographically embedded identifiers in search of relevant search criteria.
[0088] Some possible combinations of the above techniques are described below:
[0089] Al. A method of identifying locations on a map, wherein the map is to be displayed via a computer display, said method comprising: receiving data representing a first image; analyzing the data to obtain information steganographically encoded therein, wherein the information comprises or links to first location information associated with the first image; providing a map including an area associated with the first location information, wherein the map is to be displayed via a computer display; and visually or graphically identifying a first location on the map that is associated with the first location information.
[0090] A2. The combination of Al, wherein the information is steganographically encoded in the form of a digital watermark.
[0091] A3. The combination of Al, wherein the computer display comprises a cell phone display screen.
[0092] A4. The combination of Al, wherein said identifying a first location comprises providing a visual or graphical object on or with the map at the first location.
[0093] A5. The combination of A4, wherein the object comprises a representation of the first image.
[0094] A6. The combination of A4, wherein the object comprises a thumbnail representation of the first image.
[0095] A7. The combination of A4, wherein the object is associated with a link.
[0096] A8. The combination of A7, wherein the link links to a copy of the first image.
[0097] A9. The combination of A7, wherein the link links to a plurality of images that are associated with the first location information.
[0098] AlO. The combination of A7, wherein the link links to metadata associated with the first image.
[0099] Al 1. The combination of AlO, wherein the metadata comprises at least one of audio, video, text, and document files. [0100] A12. The combination of Al, further comprising: receiving data representing a second image; analyzing the data to obtain information steganographically encoded therein, wherein the information composes or links to second location information associated with the second image; and visually or graphically identifying a second location on the map that is associated with the second location information
[0101] A13. The combination of A12, further comprising generating a route between the first location and the second location.
[0102] A14. The combination of A13, wherein the route is highlighted on the map.
[0103] A15. A computer readable medium have computer executable instructions stored thereon, the instructions comprising instructions to cause a processor to carry out the method of any one of A1-A14.
[0104] B 1. A method of representing a location comprising: receiving an image captured from a first wireless device, wherein the image comprises location infoonation steganographic embedded therein; decoding the steganographic embedding to obtain the location information; by using the location information or information identified by the location information, identifying a map representing a location associated with the location information; and displaying the map.
[0105] B2. The combination of Bl, further comprising displaying a visual or graphical object on or with the map to identify the location. [0106] B3. The combination of Bl, wherein the object comprises a representation of the image.
[0107] B4. The combination of Bl, wherein the method is carried out at least in part on a second wireless device.
[0108] B5. The combination of any one of B1-B5, wherein the first wireless device comprises at least one of a cell phone and a wireless, portable computing device.
[0109] B6. The combination of B4, wherein the second wireless device comprises at least one of a cell phone and wireless, portable computing device.
[0110] B7. A computer readable medium have computer executable instructions stored thereon, the instructions comprising instructions to cause a processor to caoy out the method of any one of B1-B6.
[0111] C 1. A computer comprising: a display; a processor; a communications bus; and memory in communication with said processor via said communications bus, wherein said memory comprises instructions stored therein for execution by said processor, said instructions comprising instructions to: decode a digital watermark embedded in an image, the digital watermark including location information; provide the location information to a map software module, wherein said map software module, upon receipt of the location information, provides a map depicting at least one area associated with the location information, and provides a visual or graphical object on the map to identify the area. [0112] C2. The computer of CI, wherein the instructions further include instructions to: provide a reduced-bit representation of the image for use by the map software module, wherein the object comprises the reduced-bit representation of the image.
[0113] Dl. A method of managing images, wherein each of the images comprise plural-bit data steganographically embedded therein in the form of a digital wateonark, and wherein the plural-bit data cooesponds to a geo-location, said method comprising: receiving a first query regarding a first geo-location; identifying images cooesponding to the first geo-location; providing at least a listing of the images corresponding to the first geo-location; and in response to the listing receiving a second query narrowing the listing.
[0114] D2. The combination of Dl, wherein the second query comprises a date range.
[0115] D3. The combination of Dl, wherein the second query comprises a season.
[0116] D4. The combination of D 1 , wherein the second query comprises a directional angle.
[0117] El. A method of managing images, wherein at least some of the images comprise plural-bit data steganographically embedded therein in the form of a digital watermark, and wherein the plural-bit data cooesponds to a geo-location, said method comprising: receiving a first query cooesponding to a first geo-location and a first image capture angle; identifying images cooesponding to the first geo-location and first image capture angle; providing at least a listing of the images cooesponding to the first geo-location and first image capture angle.
[0118] Fl . A method of sharing images in a file sharing network, wherein each of the images comprise plural-bit data steganographically embedded therein in the form of a digital watermark, and wherein the plural-bit data cooesponds to a geo-location, said method comprising: maintaining a catalog on a computer server comprising a listing of images indexed according to geo-location, the catalog comprising an internet address associated with the images; and providing a sub-set of the catalog in response to a geo-location based inquiry.
[0119] Gl. A method comprising: receiving an image including a digital watermark embedded therein, wherein the digital watermark comprises location information; decoding the digital watermark to obtain the location information; identifying a map depicting a location cooesponding to the location infoonation; and providing the map for access over a computer network.
[0120] G2. The combination of Gl, further comprising identifying a location on the map that is particularly associated with the location.
[0121] HI. A method of providing searchable images comprising: receiving audio associated with an image; reducing the audio to an identifier; and embedding the identifier in the image as a steganographic component or storing the identifier in a header associated with the image. [0122] H2. A combination of HI , wherein further comprising adding the identifier to a table or data record, wherein the table or data record maps the audio to the identifier.
[0123] H3. A combination of H2, wherein the table or data record is mapped to the audio through text representing the audio.
[0124] H4. A combination of H2, wherein the table or data record is mapped to the audio through a pattern match of the audio.
Conclusion
[0125] The foregoing are just exemplary implementations of the present invention. It will be recognized that there are a great number of variations on these basic themes. The foregoing illustrates but a few applications of the detailed technology. There are many others.
[0126] The particular combinations of elements and features in the above-detailed embodiments are exemplary only; the interchanging and substitution of these teachings with other teachings in this application and the above-mentioned patents/applications are also contemplated.
[0127] There are many embodiments discussed herein which may benefit from the inclusion of two different watermarks. For example, a first watermark may include information evidencing (or pointing to) georeferencing information, while a second watermark includes a database identifier or location. The second watermark may alternatively include (or point toward) information pertaining to events, people or animals identified in the photograph, occasions, groups, institutions, copyright ownership, etc. Or an image may include both a robust watermark and a copy-tamper fragile watermark. [0128] We intend this application to be inteφreted broadly. For example, the term "map" is intended to apply to a wide variety of maps including, but not limited to, street maps, teoain maps, demographics maps, photographic maps (e.g., think satellite images or Keyhole, Inc.), topographical maps, physical maps, geological maps, historical maps, nautical charts, 3D-representations, political maps, road maps, Geographical Information System (GIS) layers, etc., etc.
[0129] The methods, processes, and systems described above may be implemented in hardware, software or a combination of hardware and software. For example, the location information encoding processes may be implemented in a programmable computer or a special puφose digital circuit. Similarly, location information decoding may be implemented in software, firmware, hardware, or combinations of software, firmware and hardware. The methods and processes described above may be implemented in programs executed from a system's memory (a computer readable medium, such as an electronic, optical or magnetic storage device).
[0130] As mentioned above, while our discussion has focused on CMOS sensors, it will be appreciated that our techniques will apply to other on-chip environments (e.g., CCD) as well. Also, while we have used RGB and CMY color spaces as examples, the present invention is not limited there to. Of course, our technique will apply to a myriad of other possible color models that a sensor could produce to minimize color gamut compression for a fixed pixel size (e.g., a fixed number of bits.)
[0131] In view of the wide variety of embodiments to which the principles and features discussed above can be applied, it should be apparent that the detailed embodiments are illustrative only and should not be taken as limiting the scope of the invention.

Claims

We claim:
1. A method of introducing a steganographic component to imagery generated by an image sensor, the image sensor includes a plurality of pixels, wherein the plurality of pixels includes physical characteristics, said method comprising: providing variations in the physical characteristics of a set of the plurality of pixels, wherein the variations are provided so as to introduce the steganographic component during image capture; and generating imagery with the image sensor, wherein the imagery includes the steganographic component.
2. The method of claim 1, wherein the set of pixels each comprise a photo- detector, and wherein the variations are provided by varying at least one of electrical potential, doping characteristics and dimensions of the photo-detectors.
3. The method of claim 1, wherein each pixel within the set of pixels includes a color filter, and wherein the variations are provided through the color filters associated with the set of pixels.
4. The method of claim 1, wherein each pixel within the set of pixels includes a microlens, and wherein the variations are provided through variations in the micro lens associated with the set of pixels.
5. The method of claim 1, wherein the variations introduce a color value change or data offset for respective pixels.
6. The method of claim 1, wherein the variations are provided during manufacture of the image sensor.
7. The method of claim 1, wherein the steganographic component comprises an orientation component.
8. A CMOS imager comprising: a plurality of pixels aoanged in columns and rows, wherein each of the pixels includes: a photodetector; a color filter portion; and a microlens; and a communications bus to selectively read out image data from the plurality of pixels, wherein the plurality of pixels includes at a first set of pixels, with the first set of pixels having physical properties so as to introduce a digital watermark component to image data during image capture by the CMOS imager.
9. The CMOS imager of claim 8, wherein the physical properties include at least one of electrical potential, doping characteristics and dimensions of the photodetectors relative to pixels not within the first set of pixels.
10. The CMOS imager of claim 8, wherein the physical properties are provided through color filter portions associated with the first set of pixels.
11. The CMOS imager of claim 8, wherein the physical properties are provided through microlens associated with the first set of pixels.
12. The CMOS imager of claim 8, wherein the watermark component is introduced by an image pixel value change for the first set of pixels.
13. The CMOS imager of claim 8, wherein each of the plurality of pixels communicates with different amplifiers, and wherein the physical properties comprise varied gain of the different amplifiers.
14. The CMOS imager of claim 8, wherein the digital watermark component is introduced to image data captured by the CMOS imager without further processing of the image data.
15. The CMOS imager of claim 10, wherein the watermark component comprises an orientation component.
16. A method of embedding a digital watermark in image data captured by an imager, wherein watermark embedding occurs on-chip with the imager, wherein the imager comprises a plurality of pixels, and wherein each of the plurality of pixels is filtered to represent a single color, said method comprising: prior to approximating a multi-color value for each pixel, adjusting single color values for select pixels, the adjusting introducing a digital watermark into the image
data; and approximating a multi-color value for pixels.
17. The method of claim 16, wherein the single color comprises at least one of red, green and blue.
18. The method of claim 17, wherein the adjusting adjusts only red color values.
19. The method of claim 17, wherein the adjusting weights a watermark signal across red, blue and green channels.
20. A method of introducing a watermark message to a watermark embedder located on-chip with an image aoay, said method comprising: color converting image data provided from the image array, wherein the color converting provides a multi-color approximation per pixel; receiving color converted image data at the watermark embedder; receiving the wateonark message on-chip from at least one of a random access memory (RAM) and a chip interface; communicating the watermark message to the watermark embedder; and embedding the watermark message in the color converted image data.
21. A method of identifying locations on a map, wherein the map is to be displayed via a computer display, said method comprising: receiving data representing a first image; analyzing the data to obtain information steganographically encoded therein, wherein the information comprises or links to first location information associated with the first image; providing a map including an area associated with the first location information, wherein the map is to be displayed via a computer display; and visually or graphically identifying a first location on the map that is associated with the first location information.
22. The method of claim 21, wherein the information is steganographically encoded in the form of a digital watermark.
23. The method of claim 21, wherein the computer display comprises a cell phone display screen.
24. The method of claim 21, wherein said identifying a first location comprises providing a visual or graphical object on or with the map at the first location.
25. The method of claim 24, wherein the object comprises a representation of the first image.
26. The method of claim 25, wherein the object comprises a thumbnail representation of the first image.
27. A method of managing images, wherein each of the images comprise plural-bit data steganographically embedded therein in the form of a digital watermark, and wherein the plural-bit data cooesponds to a geo-location, said method comprising: receiving a first query regarding a first geo-location; identifying images cooesponding to the first geo-location; providing at least a listing of the images corresponding to the first geo-location; and in response to the listing receiving a second query naoowing the listing.
28. The method of claim 27, wherein the second query comprises at least one of a date range, a season, and a directional angle.
PCT/US2005/003777 2004-02-04 2005-02-03 Digital watermarking image signals on-chip and photographic travel logs through digital watermarking WO2005076985A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2006552319A JP4981455B2 (en) 2004-02-04 2005-02-03 On-chip digital watermarked image signal and photo travel log with digital watermark
EP05722787.8A EP1751690B1 (en) 2004-02-04 2005-02-03 Digital watermarking image signals on-chip and photographic travel logs through digital watermarking

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US54209504P 2004-02-04 2004-02-04
US60/542,095 2004-02-04
US60061804P 2004-08-09 2004-08-09
US60/600,618 2004-08-09

Publications (2)

Publication Number Publication Date
WO2005076985A2 true WO2005076985A2 (en) 2005-08-25
WO2005076985A3 WO2005076985A3 (en) 2007-07-12

Family

ID=34864491

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/003777 WO2005076985A2 (en) 2004-02-04 2005-02-03 Digital watermarking image signals on-chip and photographic travel logs through digital watermarking

Country Status (4)

Country Link
US (6) US8457346B2 (en)
EP (1) EP1751690B1 (en)
JP (1) JP4981455B2 (en)
WO (1) WO2005076985A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7616777B2 (en) 2004-02-04 2009-11-10 Digimarc Corporation Digital watermarking methods, systems and apparatus
US10764492B2 (en) 2016-03-31 2020-09-01 Sony Corporation Image sensor, image pickup apparatus, image sensor-identifying method, image forgery-preventing method, and image alternation-limiting method
CN112184535A (en) * 2020-10-29 2021-01-05 维沃移动通信有限公司 Image anti-counterfeiting method, device and equipment
US11386517B2 (en) 2015-05-29 2022-07-12 Digimarc Corporation Serialized digital watermarking for variable data printing

Families Citing this family (143)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030133592A1 (en) 1996-05-07 2003-07-17 Rhoads Geoffrey B. Content objects with computer instructions steganographically encoded therein, and associated methods
US6590996B1 (en) 2000-02-14 2003-07-08 Digimarc Corporation Color adaptive watermarking
US8103877B2 (en) * 2000-12-21 2012-01-24 Digimarc Corporation Content identification and electronic tickets, coupons and credits
US7046819B2 (en) 2001-04-25 2006-05-16 Digimarc Corporation Encoded reference signal for digital watermarks
US7712675B2 (en) * 2003-01-15 2010-05-11 Hewlett-Packard Development Company, L.P. Physical items for holding data securely, and methods and apparatus for publishing and reading them
DE102004012897B4 (en) * 2004-03-16 2006-01-12 Siemens Ag Method for displaying graphic objects and communication device
US7668334B2 (en) * 2004-07-02 2010-02-23 Digimarc Corp Conditioning imagery to better receive steganographic encoding
CN101137890A (en) * 2005-01-06 2008-03-05 艾伦·舒尔曼 Navigation and inspection system
US7688994B2 (en) * 2005-05-19 2010-03-30 Uti Limited Partnership Digital watermarking CMOS sensor
US8280098B2 (en) * 2005-05-19 2012-10-02 Uti Limited Partnership Digital watermarking CMOS sensor
US8045998B2 (en) 2005-06-08 2011-10-25 Cisco Technology, Inc. Method and system for communicating using position information
JP4722599B2 (en) * 2005-07-13 2011-07-13 富士通株式会社 Electronic image data verification program, electronic image data verification system, and electronic image data verification method
US7706339B2 (en) * 2005-08-10 2010-04-27 Cisco Technology, Inc. Method and system for communicating media based on location of media source
US7869386B2 (en) * 2005-08-29 2011-01-11 Cisco Technology, Inc. Method and system for conveying media source location information
US7724399B2 (en) * 2005-09-19 2010-05-25 Silverbrook Research Pty Ltd Method of downloading and installing a software object
US8072629B2 (en) * 2005-09-19 2011-12-06 Silverbrook Research Pty Ltd Print subscribed content on a mobile device
US7654444B2 (en) 2005-09-19 2010-02-02 Silverbrook Research Pty Ltd Reusable sticker
US7747280B2 (en) * 2005-09-19 2010-06-29 Silverbrook Research Pty Ltd Retrieving a product via a coded surface
US7738674B2 (en) * 2005-09-19 2010-06-15 Silverbrook Research Pty Ltd Retrieving location data by sensing coded data on a surface
US7407092B2 (en) * 2005-09-19 2008-08-05 Silverbrook Research Pty Ltd Printing gaming information using a mobile device
US7805162B2 (en) * 2005-09-19 2010-09-28 Silverbrook Research Pty Ltd Print card with linked object
US7855805B2 (en) * 2005-09-19 2010-12-21 Silverbrook Research Pty Ltd Printing a competition entry form using a mobile device
US7970435B2 (en) * 2005-09-19 2011-06-28 Silverbrook Research Pty Ltd Printing an advertisement using a mobile device
US7697714B2 (en) * 2005-09-19 2010-04-13 Silverbrook Research Pty Ltd Associating an object with a sticker and a surface
US7672664B2 (en) * 2005-09-19 2010-03-02 Silverbrook Research Pty Ltd Printing a reminder list using mobile device
US7380709B2 (en) * 2005-09-19 2008-06-03 Silverbrook Research Pty Ltd Printing a trading card using a mobile device
US7761090B2 (en) * 2005-09-19 2010-07-20 Silverbrook Research Pty Ltd Print remotely to a mobile device
US7469829B2 (en) * 2005-09-19 2008-12-30 Silverbrook Research Pty Ltd Printing video information using a mobile device
US7575172B2 (en) * 2005-09-19 2009-08-18 Silverbrook Research Pty Ltd Printing a greeting card using a mobile device
US7428986B2 (en) * 2005-09-19 2008-09-30 Silverbrook Research Pty Ltd Printing a health report using a mobile device
US7438215B2 (en) * 2005-09-19 2008-10-21 Silverbrook Research Pty Ltd Printing location-based information using a mobile device
US7558599B2 (en) * 2005-09-19 2009-07-07 Silverbrook Research Pty Ltd Printing a bill using a mobile device
US7992213B2 (en) * 2005-09-19 2011-08-02 Silverbrook Research Pty Ltd Gaining access via a coded surface
US7742755B2 (en) * 2005-09-19 2010-06-22 Silverbrook Research Pty Ltd Retrieving a bill via a coded surface
US7689249B2 (en) * 2005-09-19 2010-03-30 Silverbrook Research Pty Ltd Printing a security identification using a mobile device
US7506802B2 (en) * 2005-09-19 2009-03-24 Silverbrook Research Pty Ltd Method of performing an action in relation to a software object
US20070064130A1 (en) * 2005-09-19 2007-03-22 Silverbrook Research Pty Ltd Link object to form field on surface
US7738862B2 (en) * 2005-09-19 2010-06-15 Silverbrook Research Pty Ltd Retrieve information via card on mobile device
US7558597B2 (en) 2005-09-19 2009-07-07 Silverbrook Research Pty Ltd. Retrieving a ringtone via a coded surface
US7621442B2 (en) 2005-09-19 2009-11-24 Silverbrook Research Pty Ltd Printing a subscription using a mobile device
US7708203B2 (en) 2005-09-19 2010-05-04 Silverbrook Research Pty Ltd Link object to sticker
US7637424B2 (en) 2005-09-19 2009-12-29 Silverbrook Research Pty Ltd Printing audio information using a mobile device
US7756526B2 (en) 2005-09-19 2010-07-13 Silverbrook Research Pty Ltd Retrieving a web page via a coded surface
US7668540B2 (en) * 2005-09-19 2010-02-23 Silverbrook Research Pty Ltd Print on a mobile device with persistence
CN100364326C (en) * 2005-12-01 2008-01-23 北京北大方正电子有限公司 Method and apparatus for embedding and detecting digital watermark in text file
WO2007067760A2 (en) * 2005-12-08 2007-06-14 Decarta, Inc. High precision internet local search
US7945070B2 (en) * 2006-02-24 2011-05-17 Digimarc Corporation Geographic-based watermarking keys
US8260338B2 (en) 2006-02-28 2012-09-04 Cisco Technology, Inc. Method and system for providing interoperable communications with dynamic event area allocation
US20070244925A1 (en) * 2006-04-12 2007-10-18 Jean-Francois Albouze Intelligent image searching
US20080184375A1 (en) * 2006-05-09 2008-07-31 Masao Nonaka Confidential data protection apparatus, autonomous mobile robot, confidential data protection method, computer program, and integrated circuit
WO2007139516A1 (en) * 2006-05-31 2007-12-06 Datamark Technologies Pte Ltd A secure media storage device and method of securing media storage devices
US20080037825A1 (en) * 2006-08-08 2008-02-14 Gcs Research Llc Digital Watermarking for Geospatial Images
US7774023B2 (en) * 2007-03-26 2010-08-10 Kyocera Corporation System and method for associating device information with digital images
US7911465B2 (en) * 2007-03-30 2011-03-22 Ricoh Company, Ltd. Techniques for displaying information for collection hierarchies
JP4752827B2 (en) * 2007-09-04 2011-08-17 ソニー株式会社 MAP INFORMATION DISPLAY DEVICE, MAP INFORMATION DISPLAY METHOD, AND PROGRAM
US20090086021A1 (en) * 2007-09-27 2009-04-02 Rockwell Automation Technologies, Inc. Dynamically generating real-time visualizations in industrial automation environment as a function of contect and state information
US8681129B2 (en) * 2007-11-12 2014-03-25 Hewlett-Packard Development Company, L.P. Associating auxiliary data with digital ink
US8270664B2 (en) 2007-11-27 2012-09-18 Broadcom Corporation Method and system for utilizing GPS information to secure digital media
US8380993B2 (en) 2007-12-07 2013-02-19 Broadcom Corporation Method and system for robust watermark insertion and extraction for digital set-top boxes
US8385588B2 (en) * 2007-12-11 2013-02-26 Eastman Kodak Company Recording audio metadata for stored images
AU2007249105B2 (en) * 2007-12-18 2010-02-18 Canon Kabushiki Kaisha Alpha-masked RST image registration
AU2007254661A1 (en) * 2007-12-24 2009-07-09 Canon Kabushiki Kaisha Printing and authentication of a security document on a substrate
JP5018504B2 (en) * 2008-01-21 2012-09-05 株式会社ニコン Data processing device, imaging device, data processing program
US9521292B2 (en) * 2008-03-12 2016-12-13 Omnivision Technologies, Inc. Image sensor apparatus and method for embedding recoverable data on image sensor pixel arrays
US7953796B2 (en) * 2008-04-02 2011-05-31 Microsoft Corporation Sharing content using selection and proposal
WO2009126164A1 (en) * 2008-04-11 2009-10-15 The Nielsen Company (U.S.), Inc. Methods and apparatus to generate and use content- related watermarks
US8805689B2 (en) * 2008-04-11 2014-08-12 The Nielsen Company (Us), Llc Methods and apparatus to generate and use content-aware watermarks
US20110038594A1 (en) * 2008-04-25 2011-02-17 Symons Gary M Handheld recorder incorporating true raw audio or video certification
US8006291B2 (en) * 2008-05-13 2011-08-23 Veritrix, Inc. Multi-channel multi-factor authentication
US8520979B2 (en) * 2008-08-19 2013-08-27 Digimarc Corporation Methods and systems for content processing
US8595638B2 (en) * 2008-08-28 2013-11-26 Nokia Corporation User interface, device and method for displaying special locations on a map
US8447989B2 (en) * 2008-10-02 2013-05-21 Ricoh Co., Ltd. Method and apparatus for tamper proof camera logs
US20110066437A1 (en) * 2009-01-26 2011-03-17 Robert Luff Methods and apparatus to monitor media exposure using content-aware watermarks
JP5366130B2 (en) * 2009-02-18 2013-12-11 富士通株式会社 POSITIONING DEVICE AND POSITIONING PROGRAM
JP5742057B2 (en) * 2009-03-03 2015-07-01 ディジマーク コーポレイション Narrow casting from public displays and related arrangements
US20100299134A1 (en) * 2009-05-22 2010-11-25 Microsoft Corporation Contextual commentary of textual images
US20110055075A1 (en) * 2009-09-01 2011-03-03 The Tms Way Limited System, method and apparatus for search code information retrieval
US8548810B2 (en) * 2009-11-04 2013-10-01 Digimarc Corporation Orchestrated encoding and decoding multimedia content having plural digital watermarks
US8345569B2 (en) * 2009-11-23 2013-01-01 Dialogic Corporation Multiple watermarks for fidelity assessment
JP5864437B2 (en) 2010-01-15 2016-02-17 ディジマーク コーポレイション Method and configuration for signal rich art
EP2362384A1 (en) * 2010-02-26 2011-08-31 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Watermark generator, watermark decoder, method for providing a watermark signal, method for providing binary message data in dependence on a watermarked signal and a computer program using improved synchronization concept
US9237172B2 (en) * 2010-05-25 2016-01-12 Qualcomm Incorporated Application notification and service selection using in-band signals
KR20110139375A (en) * 2010-06-23 2011-12-29 삼성전자주식회사 Method for displaying image including a position information and apparatus of enabling the method
US8365243B1 (en) * 2010-07-14 2013-01-29 Trend Micro, Inc. Image leak prevention using geotagging
CN103098453B (en) 2010-09-13 2016-12-21 杜比实验室特许公司 Use the data transmission of the outer color coordinates of colour gamut
US8644501B2 (en) * 2010-12-20 2014-02-04 International Business Machines Corporation Paired carrier and pivot steganographic objects for stateful data layering
US8644620B1 (en) * 2011-06-21 2014-02-04 Google Inc. Processing of matching regions in a stream of screen images
US8674356B2 (en) * 2011-08-31 2014-03-18 M/A-Com Technology Solutions Holdings, Inc. Electrically measurable on-chip IC serial identifier and methods for producing the same
EP2812848B1 (en) 2012-02-09 2020-04-01 Hewlett-Packard Development Company, L.P. Forensic verification utilizing forensic markings inside halftones
WO2013119233A1 (en) 2012-02-09 2013-08-15 Hewlett-Packard Development Company, L.P. Forensic verification utilizing halftone boundaries
CN107028623B (en) * 2012-02-21 2020-09-01 毛伊图像公司 Determination of material stiffness using porous ultrasound
US9286912B2 (en) 2012-09-26 2016-03-15 The Nielsen Company (Us), Llc Methods and apparatus for identifying media
KR101988311B1 (en) * 2012-11-07 2019-06-12 엘지전자 주식회사 Digital device and the method for controlling the same
US9607011B2 (en) * 2012-12-19 2017-03-28 Intel Corporation Time-shifting image service
USD723045S1 (en) * 2013-03-11 2015-02-24 Microsoft Corporation Display screen with graphical user interface
US10331733B2 (en) 2013-04-25 2019-06-25 Google Llc System and method for presenting condition-specific geographic imagery
US9672223B2 (en) 2013-04-25 2017-06-06 Google Inc. Geo photo searching based on current conditions at a location
US10915868B2 (en) 2013-06-17 2021-02-09 Microsoft Technology Licensing, Llc Displaying life events while navigating a calendar
US9384520B2 (en) 2013-06-21 2016-07-05 Signs & Wonders Unlimited, Llc System and method for encoding and authenticating a digital image
US20160379330A1 (en) 2013-06-21 2016-12-29 Signs & Wonders Unlimited, Llc Method and apparatus for protecting digital photos from alteration
WO2015013954A1 (en) 2013-08-01 2015-02-05 Google Inc. Near-duplicate filtering in search engine result page of an online shopping system
KR20230157519A (en) * 2013-08-30 2023-11-16 가부시키가이샤 한도오따이 에네루기 켄큐쇼 Display device
KR102288238B1 (en) * 2013-09-03 2021-08-09 가부시키가이샤 한도오따이 에네루기 켄큐쇼 Light-emitting device
US9477689B2 (en) 2014-02-15 2016-10-25 Barry Crutchfield Embedding digital content within a digital photograph during capture of the digital photograph
US9600720B1 (en) * 2014-03-18 2017-03-21 Amazon Technologies, Inc. Using available data to assist in object recognition
US10516799B2 (en) * 2014-03-25 2019-12-24 Immervision, Inc. Automated definition of system behavior or user experience by recording, sharing, and processing information associated with wide-angle image
US20150278545A1 (en) * 2014-03-28 2015-10-01 Aruba Networks, Inc. Anonymization of client data
WO2015152951A1 (en) 2014-03-31 2015-10-08 Hewlett-Packard Development Company, L.P. Media navigation recommendations
US10367818B2 (en) 2014-04-30 2019-07-30 Hewlett-Packard Development Company, L.P. Response to a machine-readable link
ES2813904T3 (en) * 2014-06-20 2021-03-25 Signs&Wonders Unlimited Llc System and method to encode and authenticate a digital image
US10742749B2 (en) 2014-08-11 2020-08-11 Hewlett-Packard Development Company, L.P. Media hotspot payoffs with alternatives lists
FR3025378B1 (en) * 2014-08-28 2017-12-22 Thales Sa PROCESSING METHOD IN A RADIO COMMUNICATION SYSTEM, RADIO FREQUENCY TERMINAL AND COMPUTER PROGRAM
CN105391952B (en) * 2014-09-03 2019-04-16 芯视达系统公司 Image processing equipment with incorporated broadcast and business prototype
JP6442060B2 (en) * 2014-12-18 2018-12-19 ノキア テクノロジーズ オサケユイチア Method and apparatus for publishing watermarked video protected by local copyright
US20170192645A1 (en) * 2015-01-06 2017-07-06 Brad Murray System and method for storing and searching digital media
CN107251042A (en) * 2015-02-19 2017-10-13 维萨国际服务协会 Hidden image on mancarried device
US9584696B2 (en) 2015-03-24 2017-02-28 Semiconductor Components Industries, Llc Imaging systems with embedded data transmission capabilities
US9871658B2 (en) * 2015-03-24 2018-01-16 Semiconductor Components Industries, Llc Imaging systems with data encryption and embedding capabalities
US9972106B2 (en) * 2015-04-30 2018-05-15 TigerIT Americas, LLC Systems, methods and devices for tamper proofing documents and embedding data in a biometric identifier
US9542714B2 (en) * 2015-05-28 2017-01-10 The Boeing Company Concealing data within images
US20180181281A1 (en) * 2015-06-30 2018-06-28 Sony Corporation Information processing apparatus, information processing method, and program
US9300678B1 (en) 2015-08-03 2016-03-29 Truepic Llc Systems and methods for authenticating photographic image data
US10650039B2 (en) * 2016-02-25 2020-05-12 Lionheart Legacy Uco Customizable world map
US11036833B2 (en) * 2016-07-11 2021-06-15 Ricoh Company, Ltd. Image processing system, information processing method, and non-transitory computer-readable medium
CN106373080B (en) * 2016-08-31 2019-09-13 南京师范大学 A kind of multiple digital watermarking of vector geographic data is dynamically embedded into method
US10177183B2 (en) 2016-09-08 2019-01-08 Sensors Unlimited, Inc. Embedded orientation markers for imaging sensors
US9972060B2 (en) * 2016-09-08 2018-05-15 Google Llc Detecting multiple parts of a screen to fingerprint to detect abusive uploading videos
US20180191651A1 (en) * 2016-12-29 2018-07-05 Facebook, Inc. Techniques for augmenting shared items in messages
GB2562041B (en) * 2017-04-28 2020-11-25 Imagination Tech Ltd Multi-output decoder for texture decompression
JP6953865B2 (en) * 2017-07-28 2021-10-27 富士フイルムビジネスイノベーション株式会社 Information processing system
US10375050B2 (en) 2017-10-10 2019-08-06 Truepic Inc. Methods for authenticating photographic image data
US10630483B2 (en) 2017-10-23 2020-04-21 Legitipix, LLC Anonymous image/video digital signature insertion and authentication
CN108322757B (en) * 2018-01-16 2020-12-11 暨南大学 Video steganography method based on intra-frame prediction coding
US11057685B2 (en) * 2018-03-29 2021-07-06 Ncr Corporation Media content proof of play over optical medium
US11025900B2 (en) * 2018-07-18 2021-06-01 Universal City Studios Llc System and method for identifying b-roll conditions in live streams or live rendered content
US10361866B1 (en) 2018-08-13 2019-07-23 Truepic Inc. Proof of image authentication on a blockchain
US10360668B1 (en) 2018-08-13 2019-07-23 Truepic Inc. Methods for requesting and authenticating photographic image data
CN110728613B (en) * 2019-09-18 2021-03-16 武汉大学 Non-additive distortion JPEG image steganography method based on blocking effect
CN112541853A (en) 2019-09-23 2021-03-23 阿里巴巴集团控股有限公司 Data processing method, device and equipment
CN110909320B (en) * 2019-10-18 2022-03-15 北京字节跳动网络技术有限公司 Webpage watermark tamper-proofing method, device, medium and electronic equipment
US11037284B1 (en) 2020-01-14 2021-06-15 Truepic Inc. Systems and methods for detecting image recapture
US11501786B2 (en) 2020-04-30 2022-11-15 The Nielsen Company (Us), Llc Methods and apparatus for supplementing partially readable and/or inaccurate codes in media
US20230319434A1 (en) * 2020-09-14 2023-10-05 Sony Semiconductor Solutions Corporation Solid-state imaging device, signal processing method, and electronic device

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030025805A1 (en) 2001-07-31 2003-02-06 Canon Kabushiki Kaisha Image sensing apparatus, image processing apparatus and method, and image processing system

Family Cites Families (375)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4084241A (en) 1974-10-19 1978-04-11 Toshihiro Tsumura System for processing movement information of vehicle
US3971065A (en) 1975-03-05 1976-07-20 Eastman Kodak Company Color imaging array
US4403869A (en) 1980-08-18 1983-09-13 Timex Corporation Electro-optic identifiction code system in a timepiece
JPS6225689Y2 (en) 1980-11-26 1987-07-01
JPS58208690A (en) * 1982-05-28 1983-12-05 Seiko Instr & Electronics Ltd Bar code input electronic time piece
EP0126915B1 (en) 1983-05-27 1988-01-13 VDO Adolf Schindling AG Information input arrangement
SE463897B (en) * 1983-07-01 1991-02-04 Esselte Security Syst Ab PROCEDURE PROVIDES TO SAY SIMPLE CODES
US4789962A (en) 1984-10-31 1988-12-06 International Business Machines Corporation Methods of displaying help information nearest to an operation point at which the help information is requested
AT388252B (en) 1986-12-12 1989-05-26 Skidata Gmbh PORTABLE HAND DEVICE FOR MACHINE READING VALUE CARDS
US4807031A (en) * 1987-10-20 1989-02-21 Interactive Systems, Incorporated Interactive video method and apparatus
US4920428A (en) * 1988-07-08 1990-04-24 Xerox Corporation Offset, gain and bad pixel correction in electronic scanning arrays
US5010405A (en) * 1989-02-02 1991-04-23 Massachusetts Institute Of Technology Receiver-compatible enhanced definition television system
US5113445A (en) 1990-07-09 1992-05-12 Symbol Technologies Inc. System for encoding data in machine readable graphic form
US5214757A (en) 1990-08-07 1993-05-25 Georesearch, Inc. Interactive automated mapping system
FR2684214B1 (en) 1991-11-22 1997-04-04 Sepro Robotique INDEXING CARD FOR GEOGRAPHIC INFORMATION SYSTEM AND SYSTEM INCLUDING APPLICATION.
JP2554219B2 (en) 1991-11-26 1996-11-13 日本電信電話株式会社 Digital signal superposition transmission method
US5671277A (en) 1992-06-30 1997-09-23 Minolta Camera Kabushiki Kaisha Image forming apparatus and copy management system
US5502576A (en) 1992-08-24 1996-03-26 Ramsay International Corporation Method and apparatus for the transmission, storage, and retrieval of documents in an electronic domain
US5861841A (en) 1992-11-18 1999-01-19 Trimble Navigation Limited Compact GPS receiver/processor
US6119944A (en) 1997-02-03 2000-09-19 Symbol Technologies, Inc. Down-loadable hand-held optical reader
US5857038A (en) * 1993-06-29 1999-01-05 Canon Kabushiki Kaisha Image processing apparatus and method for synthesizing first and second image data
US5481294A (en) 1993-10-27 1996-01-02 A. C. Nielsen Company Audience measurement system utilizing ancillary codes and passive signatures
US5822436A (en) 1996-04-25 1998-10-13 Digimarc Corporation Photographic products and methods employing embedded information
US5768426A (en) 1993-11-18 1998-06-16 Digimarc Corporation Graphics processing system employing embedded code signals
US6516079B1 (en) * 2000-02-14 2003-02-04 Digimarc Corporation Digital watermark screening and detecting strategies
US5841978A (en) 1993-11-18 1998-11-24 Digimarc Corporation Network linking method using steganographically embedded data objects
US7515733B2 (en) * 1993-11-18 2009-04-07 Digimarc Corporation Methods and arrangements employing digital content items
US6408082B1 (en) 1996-04-25 2002-06-18 Digimarc Corporation Watermark detection using a fourier mellin transform
US5636292C1 (en) 1995-05-08 2002-06-18 Digimarc Corp Steganography methods employing embedded calibration data
US6424725B1 (en) * 1996-05-16 2002-07-23 Digimarc Corporation Determining transformations of media signals with embedded code signals
US5748763A (en) 1993-11-18 1998-05-05 Digimarc Corporation Image steganography system featuring perceptually adaptive and globally scalable signal embedding
US7158654B2 (en) * 1993-11-18 2007-01-02 Digimarc Corporation Image processor and image processing method
US7313251B2 (en) * 1993-11-18 2007-12-25 Digimarc Corporation Method and system for managing and controlling electronic media
US6549638B2 (en) * 1998-11-03 2003-04-15 Digimarc Corporation Methods for evidencing illicit use of a computer system or device
US20020009208A1 (en) 1995-08-09 2002-01-24 Adnan Alattar Authentication of physical and electronic media objects using digital watermarks
US6449377B1 (en) 1995-05-08 2002-09-10 Digimarc Corporation Methods and systems for watermark processing of line art images
US6122403A (en) 1995-07-27 2000-09-19 Digimarc Corporation Computer system linked by using information in data objects
US6681028B2 (en) * 1995-07-27 2004-01-20 Digimarc Corporation Paper-based control of computer systems
US5862260A (en) * 1993-11-18 1999-01-19 Digimarc Corporation Methods for surveying dissemination of proprietary empirical data
US6611607B1 (en) 1993-11-18 2003-08-26 Digimarc Corporation Integrating digital watermarks in multimedia content
US6681029B1 (en) * 1993-11-18 2004-01-20 Digimarc Corporation Decoding steganographic messages embedded in media signals
USRE40919E1 (en) 1993-11-18 2009-09-22 Digimarc Corporation Methods for surveying dissemination of proprietary empirical data
US7171016B1 (en) 1993-11-18 2007-01-30 Digimarc Corporation Method for monitoring internet dissemination of image, video and/or audio files
US7044395B1 (en) * 1993-11-18 2006-05-16 Digimarc Corporation Embedding and reading imperceptible codes on objects
US6614914B1 (en) * 1995-05-08 2003-09-02 Digimarc Corporation Watermark embedder and reader
US5499294A (en) * 1993-11-24 1996-03-12 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Digital camera with apparatus for authentication of images produced from an image file
US5471515A (en) 1994-01-28 1995-11-28 California Institute Of Technology Active pixel sensor with intra-pixel charge transfer
US6021172A (en) * 1994-01-28 2000-02-01 California Institute Of Technology Active pixel sensor having intra-pixel charge transfer with analog-to-digital converter
JP2631952B2 (en) 1994-03-08 1997-07-16 伊沢 道雄 A map in which codeable information is arranged in an invisible state, and a method of coding the contents of the map
US6882738B2 (en) 1994-03-17 2005-04-19 Digimarc Corporation Methods and tangible objects employing textured machine readable data
US6947571B1 (en) * 1999-05-19 2005-09-20 Digimarc Corporation Cell phones with optical capabilities, and related applications
US6522770B1 (en) * 1999-05-19 2003-02-18 Digimarc Corporation Management of documents and other objects using optical devices
US6993152B2 (en) 1994-03-17 2006-01-31 Digimarc Corporation Hiding geo-location data through arrangement of objects
US5932863A (en) 1994-05-25 1999-08-03 Rathus; Spencer A. Method and apparatus for accessing electric data via a familiar printed medium
US5493677A (en) * 1994-06-08 1996-02-20 Systems Research & Applications Corporation Generation, archiving, and retrieval of digital images with evoked suggestion-set captions and natural language interface
US5848373A (en) 1994-06-24 1998-12-08 Delorme Publishing Company Computer aided map location system
US5640193A (en) 1994-08-15 1997-06-17 Lucent Technologies Inc. Multimedia service access by reading marks on an object
US5909673A (en) 1994-09-29 1999-06-01 Gregory; Edward M. Method and system for creating site specific coupons at a plurality of remote locations which are controlled by a central office
US6879701B1 (en) * 1994-10-21 2005-04-12 Digimarc Corporation Tile-based digital watermarking techniques
US6535618B1 (en) 1994-10-21 2003-03-18 Digimarc Corporation Image capture device with steganographic data embedding
EP0710022A3 (en) 1994-10-31 1998-08-26 AT&T Corp. System and method for encoding digital information in a television signal
US5576763A (en) 1994-11-22 1996-11-19 Lucent Technologies Inc. Single-polysilicon CMOS active pixel
FR2728697B1 (en) 1994-12-23 1997-01-24 Thomson Csf VERY HIGH EFFICIENCY FREQUENCY CONVERTER, IN GUIDED OPTICS
US5671267A (en) 1994-12-30 1997-09-23 Lucent Technologies Inc. Interactive system for communications between a cordless telephone and a remotely operated device
GB9502274D0 (en) 1995-02-06 1995-03-29 Central Research Lab Ltd Method and apparatus for coding information
US5943422A (en) 1996-08-12 1999-08-24 Intertrust Technologies Corp. Steganographic techniques for securely delivering electronic digital rights management control information over insecure communication channels
GB2299233A (en) 1995-03-21 1996-09-25 Ibm Video compression method involving conditional replenishment
US5964821A (en) 1995-04-07 1999-10-12 Delco Electronics Corporation Mapless GPS navigation system with sortable destinations and zone preference
US6763123B2 (en) 1995-05-08 2004-07-13 Digimarc Corporation Detection of out-of-phase low visibility watermarks
US6718046B2 (en) * 1995-05-08 2004-04-06 Digimarc Corporation Low visibility watermark using time decay fluorescence
US7805500B2 (en) 1995-05-08 2010-09-28 Digimarc Corporation Network linking methods and apparatus
US6988202B1 (en) * 1995-05-08 2006-01-17 Digimarc Corporation Pre-filteriing to increase watermark signal-to-noise ratio
US6760463B2 (en) 1995-05-08 2004-07-06 Digimarc Corporation Watermarking methods and media
US7486799B2 (en) * 1995-05-08 2009-02-03 Digimarc Corporation Methods for monitoring audio and images on the internet
US6813366B1 (en) 1995-05-08 2004-11-02 Digimarc Corporation Steganographic decoding with transform to spatial domain
US6721440B2 (en) * 1995-05-08 2004-04-13 Digimarc Corporation Low visibility watermarks using an out-of-phase color
US7224819B2 (en) 1995-05-08 2007-05-29 Digimarc Corporation Integrating digital watermarks in multimedia content
US6590996B1 (en) 2000-02-14 2003-07-08 Digimarc Corporation Color adaptive watermarking
DE19520232C1 (en) 1995-06-01 1996-08-14 Siemens Ag Sequence coding for ASCII text encryption
US6952801B2 (en) 1995-06-07 2005-10-04 R.R. Donnelley Book assembly process and apparatus for variable imaging system
US6332149B1 (en) 1995-06-07 2001-12-18 R. R. Donnelley & Sons Imposition process and apparatus for variable imaging system
US5978773A (en) 1995-06-20 1999-11-02 Neomedia Technologies, Inc. System and method for using an ordinary article of commerce to access a remote computer
US20030040957A1 (en) * 1995-07-27 2003-02-27 Willam Y. Conwell Advertising employing watermarking
US7095871B2 (en) 1995-07-27 2006-08-22 Digimarc Corporation Digital asset management and linking media signals with related data using watermarks
US7006661B2 (en) 1995-07-27 2006-02-28 Digimarc Corp Digital watermarking systems and methods
US7051086B2 (en) * 1995-07-27 2006-05-23 Digimarc Corporation Method of linking on-line data to printed documents
US6408331B1 (en) 1995-07-27 2002-06-18 Digimarc Corporation Computer linking methods using encoded graphics
US8379908B2 (en) * 1995-07-27 2013-02-19 Digimarc Corporation Embedding and reading codes on objects
US6411725B1 (en) 1995-07-27 2002-06-25 Digimarc Corporation Watermark enabled video objects
US8429205B2 (en) * 1995-07-27 2013-04-23 Digimarc Corporation Associating data with media signals in media signal systems through auxiliary data steganographically embedded in the media signals
US7003731B1 (en) * 1995-07-27 2006-02-21 Digimare Corporation User control and activation of watermark enabled objects
US6829368B2 (en) 2000-01-26 2004-12-07 Digimarc Corporation Establishing and interacting with on-line media collections using identifiers in media signals
US6311214B1 (en) 1995-07-27 2001-10-30 Digimarc Corporation Linking of computers based on optical sensing of digital data
US6505160B1 (en) 1995-07-27 2003-01-07 Digimarc Corporation Connected audio and other media objects
US6577746B1 (en) 1999-12-28 2003-06-10 Digimarc Corporation Watermark-based object linking and embedding
US6650761B1 (en) 1999-05-19 2003-11-18 Digimarc Corporation Watermarked business cards and methods
US6249588B1 (en) 1995-08-28 2001-06-19 ECOLE POLYTECHNIQUE FéDéRALE DE LAUSANNE Method and apparatus for authentication of documents by using the intensity profile of moire patterns
US5822360A (en) 1995-09-06 1998-10-13 Solana Technology Development Corporation Method and apparatus for transporting auxiliary data in audio signals
US5937000A (en) 1995-09-06 1999-08-10 Solana Technology Development Corporation Method and apparatus for embedding auxiliary data in a primary data signal
GB9518984D0 (en) * 1995-09-16 1995-11-15 Univ Montfort Storing and/or transmitting 3d images
US6580808B2 (en) 1995-09-25 2003-06-17 Digimarc Corporation Method and apparatus for discerning image distortion by reference to encoded marker signals
US5799082A (en) 1995-11-07 1998-08-25 Trimble Navigation Limited Secure authentication of images
US6282362B1 (en) 1995-11-07 2001-08-28 Trimble Navigation Limited Geographical position/image digital recording and display system
US5764770A (en) 1995-11-07 1998-06-09 Trimble Navigation Limited Image authentication patterning
GB2345542B (en) 1995-11-21 2000-08-23 Yeoman Marine Ltd Locating positions on maps
US5828751A (en) 1996-04-08 1998-10-27 Walker Asset Management Limited Partnership Method and apparatus for secure measurement certification
US5708263A (en) * 1995-12-27 1998-01-13 International Business Machines Corporation Photodetector array
US6205249B1 (en) 1998-04-02 2001-03-20 Scott A. Moskowitz Multiple transform utilization and applications for secure digital watermarking
US5919730A (en) 1996-02-08 1999-07-06 Eastman Kodak Company Copy restrictive documents
US5761606A (en) 1996-02-08 1998-06-02 Wolzien; Thomas R. Media online services access via address embedded in video or audio program
US5901178A (en) 1996-02-26 1999-05-04 Solana Technology Development Corporation Post-compression hidden data transport for video
US20010019611A1 (en) 1996-03-04 2001-09-06 David Hilton Method of and apparatus for manipulating digital data works
US5991737A (en) 1996-03-11 1999-11-23 Connexus Corporation Automated consumer response to publicly broadcast information
US5664018A (en) 1996-03-12 1997-09-02 Leighton; Frank Thomson Watermarking process resilient to collusion attacks
US5923763A (en) 1996-03-21 1999-07-13 Walker Asset Management Limited Partnership Method and apparatus for secure document timestamping
US20030040326A1 (en) 1996-04-25 2003-02-27 Levy Kenneth L. Wireless methods and devices employing steganography
US6307949B1 (en) 1996-05-07 2001-10-23 Digimarc Corporation Methods for optimizing watermark detection
US20020196272A1 (en) 1998-10-01 2002-12-26 Digimarc Corporation Smart images and image bookmarks for an internet browser
US7685426B2 (en) * 1996-05-07 2010-03-23 Digimarc Corporation Managing and indexing content on a network with image bookmarks and digital watermarks
US6421070B1 (en) 1996-11-12 2002-07-16 Digimarc Corporation Smart images and image bookmarking for an internet browser
US6381341B1 (en) 1996-05-16 2002-04-30 Digimarc Corporation Watermark encoding method exploiting biases inherent in original signal
US7024016B2 (en) * 1996-05-16 2006-04-04 Digimarc Corporation Digital watermarking apparatus and methods
US6229924B1 (en) 1996-05-16 2001-05-08 Digimarc Corporation Method and apparatus for watermarking video images
EP0852441B1 (en) 1996-06-20 2010-08-25 International Business Machines Corporation Data hiding method
US5889868A (en) 1996-07-02 1999-03-30 The Dice Company Optimization methods for the insertion, protection, and detection of digital watermarks in digitized data
US6463416B1 (en) 1996-07-15 2002-10-08 Intelli-Check, Inc. Authentication system for identification documents
US5864623A (en) 1996-07-15 1999-01-26 Intellicheck Inc. Authentication system for driver licenses
US6061793A (en) * 1996-08-30 2000-05-09 Regents Of The University Of Minnesota Method and apparatus for embedding data, including watermarks, in human perceptible sounds
US6031914A (en) 1996-08-30 2000-02-29 Regents Of The University Of Minnesota Method and apparatus for embedding data, including watermarks, in human perceptible images
US5940595A (en) 1996-09-23 1999-08-17 Motorola, Inc. Electronic network navigation device and method for linking to an electronic address therewith
US6081827A (en) 1996-09-23 2000-06-27 Motorola, Inc. Network navigation methods and systems using an article of mail
TW311999B (en) 1996-10-16 1997-08-01 Ibm Method of recording media data on recording media, accessing media data and system thereof
US5825892A (en) 1996-10-28 1998-10-20 International Business Machines Corporation Protecting images with an image watermark
US8005254B2 (en) * 1996-11-12 2011-08-23 Digimarc Corporation Background watermark processing
US7751596B2 (en) 1996-11-12 2010-07-06 Digimarc Corporation Methods and arrangements employing digital content items
US5958051A (en) 1996-11-27 1999-09-28 Sun Microsystems, Inc. Implementing digital signatures for data streams and data archives
JP3154325B2 (en) 1996-11-28 2001-04-09 日本アイ・ビー・エム株式会社 System for hiding authentication information in images and image authentication system
US5812962A (en) 1996-12-09 1998-09-22 White Oak Borough Authority Method and apparatus for organizing storing and retrieving information to administer a sewer system
US5875249A (en) 1997-01-08 1999-02-23 International Business Machines Corporation Invisible image watermark for image verification
US6185312B1 (en) 1997-01-28 2001-02-06 Nippon Telegraph And Telephone Corporation Method for embedding and reading watermark-information in digital form, and apparatus thereof
US6097361A (en) 1997-01-29 2000-08-01 Advanced Micro Devices, Inc. Photolithographic exposure system and method employing a liquid crystal display (LCD) panel as a configurable mask
US5875149A (en) * 1997-02-06 1999-02-23 Hyndai Electronics America Word line driver for semiconductor memories
EP0860997B1 (en) 1997-02-24 2008-12-10 Nec Corporation Digital data encode system
AU6759998A (en) 1997-03-06 1998-09-22 Skylight Software, Inc. Cryptographic digital identity method
US5772250A (en) 1997-04-11 1998-06-30 Eastman Kodak Company Copy restrictive color-reversal documents
US6002946A (en) 1997-04-14 1999-12-14 Motorola, Inc. Handheld device having an optical data reader
US6125172A (en) 1997-04-18 2000-09-26 Lucent Technologies, Inc. Apparatus and method for initiating a transaction having acoustic data receiver that filters human voice
KR19980086811A (en) * 1997-05-08 1998-12-05 니시무로 타이조 Apparatus, method and recording medium for embedding and reproducing additional information
US6208746B1 (en) 1997-05-09 2001-03-27 Gte Service Corporation Biometric watermarks
US5960081A (en) * 1997-06-05 1999-09-28 Cray Research, Inc. Embedding a digital signature in a video sequence
US5893093A (en) 1997-07-02 1999-04-06 The Sabre Group, Inc. Information search and retrieval with geographical coordinates
JPH1155201A (en) 1997-07-29 1999-02-26 Sony Corp Device, method and system for information processing and transmitting medium
US5987136A (en) 1997-08-04 1999-11-16 Trimble Navigation Ltd. Image authentication patterning
CN1160935C (en) 1997-09-02 2004-08-04 皇家菲利浦电子有限公司 Watermaking information signal
JP3696723B2 (en) 1997-09-02 2005-09-21 ソニー株式会社 Image data processing apparatus and method
US6148091A (en) 1997-09-05 2000-11-14 The Identiscan Company, Llc Apparatus for controlling the rental and sale of age-controlled merchandise and for controlling access to age-controlled services
US6611599B2 (en) 1997-09-29 2003-08-26 Hewlett-Packard Development Company, L.P. Watermarking of digital object
JPH11112782A (en) * 1997-09-30 1999-04-23 Canon Inc Picture processor, its method and computer readable storage medium
US5990826A (en) 1997-10-07 1999-11-23 Rockwell Science Center, Inc. Interbuilding and urban canyon extension solution for global positioning systems
US6529615B2 (en) 1997-10-10 2003-03-04 Case Corporation Method of determining and treating the health of a crop
US6021406A (en) 1997-11-14 2000-02-01 Etak, Inc. Method for storing map data in a database using space filling curves and a method of searching the database to find objects in a given area and to find objects nearest to a location
US6098057A (en) 1997-12-24 2000-08-01 Pitney Bowes Inc. Method and apparatus for batch mail processing with integrated scale and automatic manifest compilation
JP3597689B2 (en) 1998-01-21 2004-12-08 株式会社東芝 Information recording medium and information recording medium processing device
US6845453B2 (en) 1998-02-13 2005-01-18 Tecsec, Inc. Multiple factor-based user identification and authentication
FR2774882B1 (en) 1998-02-13 2000-04-07 Seb Sa ELECTRIC COFFEE MAKER OF THE EXPRESSO TYPE WITH THERMAL REGULATION
US6396539B1 (en) * 1998-02-27 2002-05-28 Intel Corporation CMOS imaging device with integrated defective pixel correction circuitry
DE69908226T2 (en) 1998-03-19 2004-03-25 Tomonari Sonoda Device and method for finding melodies
EP0944256A1 (en) 1998-03-19 1999-09-22 Hitachi Europe Limited Copy protection apparatus and method
US6697103B1 (en) 1998-03-19 2004-02-24 Dennis Sunga Fernandez Integrated network for monitoring remote objects
US6389055B1 (en) 1998-03-30 2002-05-14 Lucent Technologies, Inc. Integrating digital data with perceptible signals
US6064764A (en) 1998-03-30 2000-05-16 Seiko Epson Corporation Fragile watermarks for detecting tampering in images
US6557103B1 (en) * 1998-04-13 2003-04-29 The United States Of America As Represented By The Secretary Of The Army Spread spectrum image steganography
US6504941B2 (en) 1998-04-30 2003-01-07 Hewlett-Packard Company Method and apparatus for digital watermarking of images
US6243480B1 (en) 1998-04-30 2001-06-05 Jian Zhao Digital authentication with analog documents
US7084903B2 (en) 1998-05-18 2006-08-01 International Business Machines Corporation Image capturing system and method for automatically watermarking recorded parameters for providing digital image verification
US6504571B1 (en) 1998-05-18 2003-01-07 International Business Machines Corporation System and methods for querying digital image archives using recorded parameters
US6406062B1 (en) 1998-05-20 2002-06-18 Global Commerce Group, Llc Hidden image game piece
US6296900B1 (en) * 1998-05-20 2001-10-02 Thomas L. Barnhart Method of making hidden image game piece
US6665009B1 (en) 1998-05-20 2003-12-16 Omnivision Technologies, Inc. On-chip dead pixel correction in a CMOS imaging sensor
US6233347B1 (en) 1998-05-21 2001-05-15 Massachusetts Institute Of Technology System method, and product for information embedding using an ensemble of non-intersecting embedding generators
JP2000048478A (en) 1998-05-26 2000-02-18 Yamaha Corp Digital copy control method, and device using the method
JP2002517920A (en) 1998-06-01 2002-06-18 データマーク テクノロジーズ ピーティーイー リミテッド Method for embedding digital watermarks in images, audio, and video into digital data
US6001540A (en) 1998-06-03 1999-12-14 Taiwan Semiconductor Manufacturing Company, Ltd. Microlens process
KR100340052B1 (en) * 1998-06-30 2002-07-18 박종섭 Image sensor
US20030105730A1 (en) 1999-05-19 2003-06-05 Rhoads Geoffrey B. Postal meters and systems employing watermarking
US20030130954A1 (en) 1998-07-31 2003-07-10 Carr J. Scott Postal applications including digital watermarks
US7953824B2 (en) 1998-08-06 2011-05-31 Digimarc Corporation Image sensors worn or attached on humans for imagery identification
JP3592545B2 (en) 1998-08-07 2004-11-24 株式会社リコー Image processing apparatus, image processing method, and information recording medium
JP3563270B2 (en) 1998-08-28 2004-09-08 株式会社日立製作所 Authentication method of digital watermark image
JP3587433B2 (en) 1998-09-08 2004-11-10 シャープ株式会社 Pixel defect detection device for solid-state imaging device
US6249226B1 (en) 1998-09-10 2001-06-19 Xerox Corporation Network printer document interface using electronic tags
US6583813B1 (en) * 1998-10-09 2003-06-24 Diebold, Incorporated System and method for capturing and searching image data associated with transactions
JP2000194726A (en) 1998-10-19 2000-07-14 Sony Corp Device, method and system for processing information and providing medium
DE69923781T2 (en) 1998-11-19 2005-07-07 Digimarc Corp., Lake Oswego PRINTING AND VERIFICATION OF SELF-CHECKING SAFETY DOCUMENTS
JP3924967B2 (en) * 1998-11-25 2007-06-06 ソニー株式会社 Encoding apparatus and method, decoding apparatus and method, recording medium, and data processing system
US6639261B2 (en) 1998-12-08 2003-10-28 Micron Technology, Inc. Method for forming a low leakage contact in a CMOS imager
US6773953B1 (en) * 1998-12-23 2004-08-10 Intel Corporation Camera sensor identifier via etched flaw
GB2364513B (en) 1998-12-23 2003-04-09 Kent Ridge Digital Labs Method and apparatus for protecting the legitimacy of an article
US20020048224A1 (en) 1999-01-05 2002-04-25 Dygert Timothy W. Playback device having text display and communication with remote database of titles
US20010011233A1 (en) 1999-01-11 2001-08-02 Chandrasekhar Narayanaswami Coding system and method for linking physical items and corresponding electronic online information to the physical items
US6332193B1 (en) 1999-01-18 2001-12-18 Sensar, Inc. Method and apparatus for securely transmitting and authenticating biometric data over a network
US6532541B1 (en) 1999-01-22 2003-03-11 The Trustees Of Columbia University In The City Of New York Method and apparatus for image authentication
US6448979B1 (en) 1999-01-25 2002-09-10 Airclic, Inc. Printed medium activated interactive communication of multimedia information, including advertising
US6301368B1 (en) 1999-01-29 2001-10-09 International Business Machines Corporation System and method for data hiding in compressed fingerprint images
US6651053B1 (en) 1999-02-01 2003-11-18 Barpoint.Com, Inc. Interactive system for investigating products on a network
US6522766B1 (en) * 1999-03-15 2003-02-18 Seiko Epson Corporation Watermarking with random zero-mean patches for copyright protection
US6556688B1 (en) 1999-03-15 2003-04-29 Seiko Epson Corporation Watermarking with random zero-mean patches for printer tracking
US6246777B1 (en) 1999-03-19 2001-06-12 International Business Machines Corporation Compression-tolerant watermarking scheme for image authentication
US6396594B1 (en) 1999-03-31 2002-05-28 International Business Machines Corporation Method for providing flexible and secure administrator-controlled watermarks
JP4134435B2 (en) 1999-04-07 2008-08-20 株式会社ニコン Electronic photographing apparatus having electronic watermark function and electronic photographing apparatus having user registration function
US6674993B1 (en) 1999-04-30 2004-01-06 Microvision, Inc. Method and system for identifying data locations associated with real world observations
WO2000070525A1 (en) 1999-05-12 2000-11-23 Silicon Stemcell, Llc. Printed medium activated interactive communication
US20010034705A1 (en) 1999-05-19 2001-10-25 Rhoads Geoffrey B. Payment-based systems for internet music
US7760905B2 (en) 1999-06-29 2010-07-20 Digimarc Corporation Wireless mobile phone with content processing
US20070055884A1 (en) 1999-05-19 2007-03-08 Rhoads Geoffrey B User control and activation of watermark enabled objects
US20020032734A1 (en) 2000-07-26 2002-03-14 Rhoads Geoffrey B. Collateral data combined with user characteristics to select web site
US7261612B1 (en) 1999-08-30 2007-08-28 Digimarc Corporation Methods and systems for read-aloud books
US7111170B2 (en) 1999-05-19 2006-09-19 Digimarc Corporation Distributed system for responding to watermarked documents
US7406214B2 (en) * 1999-05-19 2008-07-29 Digimarc Corporation Methods and devices employing optical sensors and/or steganography
US20100045816A1 (en) * 1999-05-19 2010-02-25 Rhoads Geoffrey B User Feedback in Connection with Object Recognition
US7099019B2 (en) 1999-05-25 2006-08-29 Silverbrook Research Pty Ltd Interface surface printer using invisible ink
US6957768B1 (en) 1999-05-25 2005-10-25 Silverbrook Research Pty Ltd Computer system control via interface surface
AUPQ363299A0 (en) 1999-10-25 1999-11-18 Silverbrook Research Pty Ltd Paper based information inter face
US6341138B1 (en) * 1999-06-16 2002-01-22 Gore Enterprise Holdings, Inc. Constant temperature performance laser
US6654057B1 (en) 1999-06-17 2003-11-25 Micron Technology, Inc. Active pixel sensor with a diagonal active area
US6894794B1 (en) * 1999-06-24 2005-05-17 Eastman Kodak Company Method and apparatus for making a print having an invisible coordinate system
US20020131076A1 (en) 1999-06-29 2002-09-19 Davis Bruce L. Distribution and use of trusted photos
US6359837B1 (en) * 1999-06-30 2002-03-19 Casio Computer Co., Ltd. Camera, camera system, information recording system, timepiece, and link system for camera and timepiece
US7543148B1 (en) 1999-07-13 2009-06-02 Microsoft Corporation Audio watermarking with covert channel and permutations
US6993148B1 (en) * 1999-07-16 2006-01-31 Canon Kabushiki Kaisha Image processing apparatus and method, and storage medium
US6381418B1 (en) 1999-08-11 2002-04-30 Eastman Kodak Company Print having information associated with the print stored in a memory coupled to the print
US7502759B2 (en) * 1999-08-30 2009-03-10 Digimarc Corporation Digital watermarking methods and related toy and game applications
US6748362B1 (en) 1999-09-03 2004-06-08 Thomas W. Meyer Process, system, and apparatus for embedding data in compressed audio, image video and other media files and the like
US6573916B1 (en) 1999-09-07 2003-06-03 Xerox Corporation Navigation of rendered virtual environments using physical tags
US6130741A (en) 1999-09-27 2000-10-10 Eastman Kodak Company Embedding information in a digital image digitized from a developed photographic film
KR100740792B1 (en) 1999-09-27 2007-07-20 코닌클리케 필립스 일렉트로닉스 엔.브이. Watermark detection method and watermark detection system
US6941275B1 (en) 1999-10-07 2005-09-06 Remi Swierczek Music identification system
CN1218278C (en) 1999-11-23 2005-09-07 皇家菲利浦电子有限公司 Watermark embedding and detection
US6526155B1 (en) 1999-11-24 2003-02-25 Xerox Corporation Systems and methods for producing visible watermarks by halftoning
US6935562B2 (en) 1999-12-06 2005-08-30 Xerox Corporation Operations on images having glyph carpets
JP3546787B2 (en) 1999-12-16 2004-07-28 インターナショナル・ビジネス・マシーンズ・コーポレーション Access control system, access control method, and storage medium
DE19963765A1 (en) 1999-12-30 2001-07-05 Bosch Gmbh Robert Method for operating a navigation system
US20010040979A1 (en) 1999-12-31 2001-11-15 Clay Davidson Compensating for color response and transfer function of scanner and/or printer when reading a digital watermark
US6496802B1 (en) 2000-01-07 2002-12-17 Mp3.Com, Inc. System and method for providing access to electronic works
FR2803710B1 (en) 2000-01-11 2002-03-22 Canon Kk METHOD AND DEVICE FOR INSERTING A MARK SIGNAL INTO AN IMAGE
US7450734B2 (en) 2000-01-13 2008-11-11 Digimarc Corporation Digital asset management, targeted searching and desktop searching using digital watermarks
JP4785168B2 (en) 2000-01-13 2011-10-05 ディジマーク コーポレイション Metadata authentication and embedding metadata in watermarks in media signals
JP2001203874A (en) * 2000-01-19 2001-07-27 Canon Inc Image pickup device
JP2001218011A (en) 2000-01-31 2001-08-10 Canon Inc Picture processor, picture processing method and storage medium
US7142689B2 (en) 2000-01-31 2006-11-28 Canon Kabushiki Kaisha Image processing apparatus for determining specific images
US6625297B1 (en) 2000-02-10 2003-09-23 Digimarc Corporation Self-orienting watermarks
US6535617B1 (en) * 2000-02-14 2003-03-18 Digimarc Corporation Removal of fixed pattern noise and other fixed patterns from media signals
US6385329B1 (en) 2000-02-14 2002-05-07 Digimarc Corporation Wavelet domain watermarks
US8355525B2 (en) 2000-02-14 2013-01-15 Digimarc Corporation Parallel processing of digital watermarking operations
US7065559B1 (en) 2000-02-17 2006-06-20 Organon Wireless, Inc. Media bridge method and apparatus
US6675165B1 (en) 2000-02-28 2004-01-06 Barpoint.Com, Inc. Method for linking a billboard or signage to information on a global computer network through manual information input or a global positioning system
US6766363B1 (en) 2000-02-28 2004-07-20 Barpoint.Com, Inc. System and method of linking items in audio, visual, and printed media to related information stored on an electronic network using a mobile device
US20010034835A1 (en) 2000-02-29 2001-10-25 Smith Robert E. Applied digital and physical signatures over telecommunications media
JP4049966B2 (en) 2000-03-09 2008-02-20 富士フイルム株式会社 Image output method and apparatus, and recording medium
KR20020002499A (en) 2000-03-09 2002-01-09 롤페스 요하네스 게라투스 알베르투스 Solid state imaging sensor in a submicron technology and method of manufacturing and use of a solid state imaging sensor
JP4098455B2 (en) 2000-03-10 2008-06-11 株式会社日立製作所 Method and computer for referring to digital watermark information in mark image
US7142691B2 (en) * 2000-03-18 2006-11-28 Digimarc Corporation Watermark embedding functions in rendering description files
US7197694B2 (en) 2000-03-21 2007-03-27 Oki Electric Industry Co., Ltd. Image display system, image registration terminal device and image reading terminal device used in the image display system
JP2001275115A (en) 2000-03-23 2001-10-05 Nec Corp Electronic watermark data insertion device and detector
JP2001344545A (en) 2000-03-29 2001-12-14 Ibm Japan Ltd Processing system, server, processing terminal, communication terminal, processing method, data managing method, processing performing method and program
WO2001075629A1 (en) 2000-03-31 2001-10-11 Neomedia Technologies, Inc. System for accessing internet via wireless device using linkage url bar-code
EP1962511A3 (en) 2000-04-05 2010-10-27 Sony United Kingdom Limited Audio and/or video generation apparatus and method using a list of content items
GB0029855D0 (en) 2000-04-05 2001-01-24 Sony Uk Ltd Embedding data in material and removing the embedded data
JP4218920B2 (en) 2000-04-07 2009-02-04 キヤノン株式会社 Image processing apparatus, image processing method, and storage medium
AU2001255445A1 (en) * 2000-04-17 2001-10-30 Digimarc Corporation Authentication of physical and electronic media objects using digital watermarks
US7027614B2 (en) * 2000-04-19 2006-04-11 Digimarc Corporation Hiding information to reduce or offset perceptible artifacts
US6912295B2 (en) * 2000-04-19 2005-06-28 Digimarc Corporation Enhancing embedding of out-of-phase signals
US7738673B2 (en) 2000-04-19 2010-06-15 Digimarc Corporation Low visible digital watermarks
US6996252B2 (en) * 2000-04-19 2006-02-07 Digimarc Corporation Low visibility watermark using time decay fluorescence
US6763124B2 (en) * 2000-04-19 2004-07-13 Digimarc Corporation Embedding digital watermarks in spot colors
US7305104B2 (en) 2000-04-21 2007-12-04 Digimarc Corporation Authentication of identification documents using digital watermarks
US7111168B2 (en) 2000-05-01 2006-09-19 Digimarc Corporation Digital watermarking systems
AU2001259480A1 (en) 2000-05-05 2001-11-20 Megachips Corporation System and method for obtaining and storing information for deferred browsing
US6501397B1 (en) 2000-05-25 2002-12-31 Koninklijke Philips Electronics N.V. Bit-plane dependent signal compression
EP1164543B1 (en) 2000-06-14 2017-08-09 Panasonic Intellectual Property Corporation of America Digital information embedding/extracting
US20020019940A1 (en) 2000-06-16 2002-02-14 Matteson Craig S. Method and apparatus for assigning test and assessment instruments to users
US6633654B2 (en) * 2000-06-19 2003-10-14 Digimarc Corporation Perceptual modeling of media signals based on local contrast and directional edges
WO2002003328A1 (en) * 2000-07-06 2002-01-10 Meyer Thomas W Steganographic embedding of data in digital signals
US7657058B2 (en) * 2000-07-19 2010-02-02 Digimarc Corporation Watermark orientation signals conveying payload data
US6643386B1 (en) * 2000-08-10 2003-11-04 Omnivision Technologies, Inc. Method and apparatus for adding watermarks to images and/or video data streams
US6721439B1 (en) * 2000-08-18 2004-04-13 Hewlett-Packard Development Company, L.P. Method and system of watermarking digital data using scaled bin encoding and maximum likelihood decoding
US20020069370A1 (en) 2000-08-31 2002-06-06 Infoseer, Inc. System and method for tracking and preventing illegal distribution of proprietary material over computer networks
US6563936B2 (en) * 2000-09-07 2003-05-13 Sarnoff Corporation Spatio-temporal channel for images employing a watermark and its complement
US6760464B2 (en) 2000-10-11 2004-07-06 Digimarc Corporation Halftone watermarking and related applications
US6674876B1 (en) * 2000-09-14 2004-01-06 Digimarc Corporation Watermarking in the time-frequency domain
JP2002190945A (en) 2000-10-12 2002-07-05 Canon Inc Information processor, control method therefor and storage medium
AU2002225593A1 (en) 2000-10-17 2002-04-29 Digimarc Corporation User control and activation of watermark enabled objects
US6611608B1 (en) 2000-10-18 2003-08-26 Matsushita Electric Industrial Co., Ltd. Human visual model for data hiding
US6904160B2 (en) 2000-10-18 2005-06-07 Red Hen Systems, Inc. Method for matching geographic information with recorded images
US20020176003A1 (en) 2000-10-25 2002-11-28 Seder Phillip Andrew Watermark reading kiosks
BR0107375A (en) 2000-10-25 2002-09-24 Koninkl Philips Electronics Nv Process, device and arrangement for inserting extra information into an input signal in a first domain, and a computer program product
AU2002218279A1 (en) 2000-11-08 2002-05-21 Koninklijke Philips Electronics N.V. Method and device for communicating a command
WO2002039714A2 (en) * 2000-11-08 2002-05-16 Digimarc Corporation Content authentication and recovery using digital watermarks
US20020065844A1 (en) 2000-11-30 2002-05-30 Rich Robinson Metadata internet platform for enabling customization of tags in digital images
AU2211102A (en) 2000-11-30 2002-06-11 Scient Generics Ltd Acoustic communication system
EP1220152A3 (en) 2000-12-07 2004-11-24 Sony United Kingdom Limited Embedding data in material
US6690811B2 (en) 2000-12-08 2004-02-10 The Hong Kong University Of Science And Technology Methods and apparatus for hiding data in halftone images
US6483927B2 (en) * 2000-12-18 2002-11-19 Digimarc Corporation Synchronizing readers of hidden auxiliary data in quantization-based data hiding schemes
US7007243B2 (en) * 2000-12-20 2006-02-28 Eastman Kodak Company Method and apparatus for producing digital images with embedded image capture location icons
US6965683B2 (en) 2000-12-21 2005-11-15 Digimarc Corporation Routing networks for use with watermark systems
US8103877B2 (en) * 2000-12-21 2012-01-24 Digimarc Corporation Content identification and electronic tickets, coupons and credits
US6912294B2 (en) 2000-12-29 2005-06-28 Contentguard Holdings, Inc. Multi-stage watermarking process and system
US20030069693A1 (en) 2001-01-16 2003-04-10 Snapp Douglas N. Geographic pointing device
US20020095586A1 (en) 2001-01-17 2002-07-18 International Business Machines Corporation Technique for continuous user authentication
US6948066B2 (en) 2001-01-17 2005-09-20 International Business Machines Corporation Technique for establishing provable chain of evidence
US6868169B2 (en) * 2001-01-24 2005-03-15 Hewlett-Packard Development Company, L.P. System and method for geographical indexing of images
GB2371934A (en) 2001-01-26 2002-08-07 Sony Uk Ltd Embedding data in material using an embedding scale
US6697498B2 (en) * 2001-02-02 2004-02-24 Asa Systems, Inc. Method and computer program product for hiding information in an indexed color image
US7043019B2 (en) 2001-02-28 2006-05-09 Eastman Kodak Company Copy protection for digital motion picture image data
US7249257B2 (en) 2001-03-05 2007-07-24 Digimarc Corporation Digitally watermarked maps and signs and related navigational tools
US6664976B2 (en) 2001-04-18 2003-12-16 Digimarc Corporation Image management system and methods using digital watermarks
US9363409B2 (en) 2001-03-05 2016-06-07 Digimarc Corporation Image management system and methods using digital watermarks
US7098931B2 (en) 2001-03-05 2006-08-29 Digimarc Corporation Image management system and methods using digital watermarks
US7197160B2 (en) 2001-03-05 2007-03-27 Digimarc Corporation Geographic information systems using digital watermarks
US6950519B2 (en) 2001-03-05 2005-09-27 Digimarc Corporation Geographically watermarked imagery and methods
US7254249B2 (en) 2001-03-05 2007-08-07 Digimarc Corporation Embedding location data in video
US7061510B2 (en) 2001-03-05 2006-06-13 Digimarc Corporation Geo-referencing of aerial imagery using embedded image identifiers and cross-referenced data sets
US7042470B2 (en) 2001-03-05 2006-05-09 Digimarc Corporation Using embedded steganographic identifiers in segmented areas of geographic images and characteristics corresponding to imagery data derived from aerial platforms
US6531266B1 (en) * 2001-03-16 2003-03-11 Taiwan Semiconductor Manufacturing Company Rework procedure for the microlens element of a CMOS image sensor
US7248285B2 (en) 2001-03-30 2007-07-24 Intel Corporation Method and apparatus for automatic photograph annotation
US7053908B2 (en) * 2001-04-12 2006-05-30 Polaroid Corporation Method and apparatus for sensing and interpolating color image data
US7822969B2 (en) 2001-04-16 2010-10-26 Digimarc Corporation Watermark systems and methods
US8457346B2 (en) 2001-04-24 2013-06-04 Digimarc Corporation Digital watermarking image signals on-chip
US8543823B2 (en) * 2001-04-30 2013-09-24 Digimarc Corporation Digital watermarking for identification documents
US7340076B2 (en) 2001-05-10 2008-03-04 Digimarc Corporation Digital watermarks for unmanned vehicle navigation
ATE502383T1 (en) 2001-06-06 2011-04-15 Spectra Systems Corp MARKING AND AUTHENTICATION OF ITEMS
US6996248B2 (en) 2001-06-13 2006-02-07 Qualcomm, Incorporated Apparatus and method for watermarking a digital image
US7116826B2 (en) 2001-06-15 2006-10-03 Canon Kabushiki Kaisha Embedding with error-correction encoding
US8094869B2 (en) * 2001-07-02 2012-01-10 Digimarc Corporation Fragile and emerging digital watermarks
US6504196B1 (en) * 2001-08-30 2003-01-07 Micron Technology, Inc. CMOS imager and method of formation
AU2002331784A1 (en) 2001-08-31 2003-03-18 John W. Hamilton A non-algebraic cryptographic architecture
US7537170B2 (en) 2001-08-31 2009-05-26 Digimarc Corporation Machine-readable security features for printed objects
US7213757B2 (en) 2001-08-31 2007-05-08 Digimarc Corporation Emerging security features for identification documents
US6493514B1 (en) 2001-09-04 2002-12-10 Eastman Kodak Company Method and apparatus for magnetic communication via a photographic filmstrip
US6680748B1 (en) * 2001-09-27 2004-01-20 Pixim, Inc., Multi-mode camera and method therefor
JP4382314B2 (en) 2001-09-27 2009-12-09 富士フイルム株式会社 Image processing method, apparatus, and program
US7187476B2 (en) 2001-10-01 2007-03-06 Canon Kabushiki Kaisha Image processing apparatus and method, computer program, and recording medium
US20030070075A1 (en) * 2001-10-04 2003-04-10 Frederic Deguillaume Secure hybrid robust watermarking resistant against tampering and copy-attack
US7027612B2 (en) 2001-10-05 2006-04-11 Digimarc Corporation Marking physical objects and related systems and methods
US7006656B2 (en) * 2001-10-15 2006-02-28 The Research Foundation Of Suny Lossless embedding of data in digital objects
US6963973B2 (en) 2001-10-17 2005-11-08 Hewlett-Packard Development Company, L.P. Chain of custody system and method
JP3907439B2 (en) 2001-10-26 2007-04-18 キヤノン株式会社 Portable terminal system, portable terminal, image processing apparatus, and operation method thereof
US6968072B1 (en) * 2001-12-06 2005-11-22 Pixim, Inc. Image sensor with built-in steganographic and watermarking functions
US6533385B1 (en) 2001-12-14 2003-03-18 Pitney Bowes Inc. Method for determining a printer's signature and the number of dots per inch printed in a document to provide proof that the printer printed a particular document
US20030112996A1 (en) * 2001-12-19 2003-06-19 Holliman Matthew J. Automatic monitoring of host signal quality using embedded data
US7617542B2 (en) 2001-12-21 2009-11-10 Nokia Corporation Location-based content protection
US7260722B2 (en) 2001-12-28 2007-08-21 Itt Manufacturing Enterprises, Inc. Digital multimedia watermarking for source identification
US7321667B2 (en) 2002-01-18 2008-01-22 Digimarc Corporation Data hiding through arrangement of objects
US7054461B2 (en) 2002-02-15 2006-05-30 Pitney Bowes Inc. Authenticating printed objects using digital watermarks associated with multidimensional quality metrics
US6940493B2 (en) * 2002-03-29 2005-09-06 Massachusetts Institute Of Technology Socializing remote communication
US6885757B2 (en) 2002-04-18 2005-04-26 Sarnoff Corporation Method and apparatus for providing an asymmetric watermark carrier
AUPS206802A0 (en) * 2002-05-01 2002-06-06 Canon Kabushiki Kaisha Steganographic image encoding
KR20050005531A (en) * 2002-06-03 2005-01-13 코닌클리케 필립스 일렉트로닉스 엔.브이. Encoding and decoding of watermarks in independent channels
JP3958128B2 (en) * 2002-06-28 2007-08-15 キヤノン株式会社 Image processing apparatus and method, computer program, and computer-readable storage medium
US6769228B1 (en) 2002-07-26 2004-08-03 Express Scripts, Inc. Prescription order packaging system and method
US7023031B2 (en) * 2002-08-19 2006-04-04 Micron Technology, Inc. CMOS imager having on-chip ROM
JP4229714B2 (en) * 2002-09-19 2009-02-25 株式会社リコー Image processing apparatus, image processing method, image processing program, and storage medium for storing image processing program
US6818276B2 (en) 2002-10-24 2004-11-16 Eastman Kodak Company Light management film with colorant receiving layer
KR100522863B1 (en) 2002-12-30 2005-10-20 동부아남반도체 주식회사 Fabricating method of image sensor
JP2004221950A (en) * 2003-01-15 2004-08-05 Ricoh Co Ltd Image processor, program, and storage medium
US7979698B2 (en) 2003-02-19 2011-07-12 Hewlett-Packard Development Company, L.P. Apparatus and method for proving authenticity with personal characteristics
JP4356340B2 (en) * 2003-03-26 2009-11-04 ソニー株式会社 Solid-state image sensor
US20040223626A1 (en) 2003-05-09 2004-11-11 Eastman Kodak Company Method for embedding spatially variant metadata in imagery
US20050030588A1 (en) 2003-08-06 2005-02-10 Curtis Reese Methods and apparatus utilizing embedded data layers
US20050063562A1 (en) * 2003-08-07 2005-03-24 Brunk Hugh L. Conveying fingerprint minutiae with digital watermarks
US8181884B2 (en) * 2003-11-17 2012-05-22 Digimarc Corporation Machine-readable features for objects
US7528868B2 (en) * 2003-12-18 2009-05-05 Eastman Kodak Company Image metadata attachment
US7707039B2 (en) 2004-02-15 2010-04-27 Exbiblio B.V. Automatic modification of web pages
US9058388B2 (en) * 2004-06-22 2015-06-16 Digimarc Corporation Internet and database searching with handheld devices
US7656395B2 (en) * 2004-07-15 2010-02-02 Microsoft Corporation Methods and apparatuses for compound tracking systems

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030025805A1 (en) 2001-07-31 2003-02-06 Canon Kabushiki Kaisha Image sensing apparatus, image processing apparatus and method, and image processing system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1751690A4

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7616777B2 (en) 2004-02-04 2009-11-10 Digimarc Corporation Digital watermarking methods, systems and apparatus
US11386517B2 (en) 2015-05-29 2022-07-12 Digimarc Corporation Serialized digital watermarking for variable data printing
US10764492B2 (en) 2016-03-31 2020-09-01 Sony Corporation Image sensor, image pickup apparatus, image sensor-identifying method, image forgery-preventing method, and image alternation-limiting method
US11064115B2 (en) 2016-03-31 2021-07-13 Sony Corporation Image sensor, image pickup apparatus, image sensor-identifying method, image forgery-preventing method, and image alternation-limiting method
US11563891B2 (en) 2016-03-31 2023-01-24 Sony Group Corporation Image sensor, image pickup apparatus, image sensor-identifying method, image forgery-preventing method, and image alternation-limiting method
CN112184535A (en) * 2020-10-29 2021-01-05 维沃移动通信有限公司 Image anti-counterfeiting method, device and equipment
WO2022089482A1 (en) * 2020-10-29 2022-05-05 维沃移动通信有限公司 Image anti-counterfeiting method and apparatus, and device

Also Published As

Publication number Publication date
EP1751690A4 (en) 2012-08-08
US8457346B2 (en) 2013-06-04
US8023691B2 (en) 2011-09-20
EP1751690A2 (en) 2007-02-14
US8565473B2 (en) 2013-10-22
JP4981455B2 (en) 2012-07-18
JP2007528644A (en) 2007-10-11
US20070274611A1 (en) 2007-11-29
US20110299725A1 (en) 2011-12-08
WO2005076985A3 (en) 2007-07-12
US8976998B2 (en) 2015-03-10
US20160035059A1 (en) 2016-02-04
US20050169499A1 (en) 2005-08-04
US7616777B2 (en) 2009-11-10
US20100008538A1 (en) 2010-01-14
EP1751690B1 (en) 2018-10-03
US20070242853A1 (en) 2007-10-18
US9792661B2 (en) 2017-10-17

Similar Documents

Publication Publication Date Title
US9792661B2 (en) Methods involving maps, imagery, video and steganography
US7209571B2 (en) Authenticating metadata and embedding metadata in watermarks of media signals
Lukas et al. Determining digital image origin using sensor imperfections
US20180349491A1 (en) Distributed computing for portable computing devices
WO2002071685A1 (en) Digital watermarking and maps
US20080089554A1 (en) Device and method for digitally watermarking an image with data
US20100226526A1 (en) Mobile media, devices, and signaling
US6961441B1 (en) Method and apparatus for steganographic embedding of meta-data
US9521292B2 (en) Image sensor apparatus and method for embedding recoverable data on image sensor pixel arrays
US20040169892A1 (en) Device and method for generating a print, device and method for detecting information, and program for causing a computer to execute the information detecting method
Thongkor et al. Robust image watermarking for camera-captured image using image registration technique
JP4382747B2 (en) Digital watermark detection method, apparatus, and program
Bas Natural Steganography: cover-source switching for better steganography
US20050044482A1 (en) Device and method for attaching information, device and method for detecting information, and program for causing a computer to execute the information detecting method
He et al. A RST resilient object-based video watermarking scheme
JP2005123974A (en) System and method for watermark detection system and method for providing information
Kim et al. PVD Image Steganography with Locally-fixed Number of Embedding Bits
Dahal et al. Image processing pipeline model integrating steganographic algorithms for mobile cameras
CN115600166A (en) Web application leakage traceability evidence obtaining method and system based on neural network
Hirakawa et al. Application of digital watermark technology for movie data in streaming distribution service
JP2006148553A (en) Moving image photographing device
JP2005117406A (en) System and method for detecting electronic watermark, and system and method for providing information
Klubsuwan et al. Digital data security and hiding on virtual reality video 3D GIS
Shen et al. The First Robust Image Tamper Detection Scheme under Brightness

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

WWE Wipo information: entry into national phase

Ref document number: 2005722787

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2006552319

Country of ref document: JP

NENP Non-entry into the national phase in:

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

WWP Wipo information: published in national office

Ref document number: 2005722787

Country of ref document: EP