WO2006040722A2 - Display time control for moving images - Google Patents

Display time control for moving images Download PDF

Info

Publication number
WO2006040722A2
WO2006040722A2 PCT/IB2005/053312 IB2005053312W WO2006040722A2 WO 2006040722 A2 WO2006040722 A2 WO 2006040722A2 IB 2005053312 W IB2005053312 W IB 2005053312W WO 2006040722 A2 WO2006040722 A2 WO 2006040722A2
Authority
WO
WIPO (PCT)
Prior art keywords
image
spatial frequency
video signal
local
amount
Prior art date
Application number
PCT/IB2005/053312
Other languages
French (fr)
Other versions
WO2006040722A3 (en
Inventor
Gerard De Haan
Leo J. Velthoven
Michiel A. Klompenhouwer
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Priority to JP2007536311A priority Critical patent/JP2008516291A/en
Priority to US11/576,911 priority patent/US8063920B2/en
Priority to EP05789487A priority patent/EP1803112A2/en
Publication of WO2006040722A2 publication Critical patent/WO2006040722A2/en
Publication of WO2006040722A3 publication Critical patent/WO2006040722A3/en

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/22Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
    • G09G3/30Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/02Improving the quality of display appearance
    • G09G2320/0247Flicker reduction other than flicker reduction circuits used for single beam cathode-ray tubes
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/02Improving the quality of display appearance
    • G09G2320/0261Improving the quality of display appearance in the context of movement of objects on the screen or movement of the observer relative to the screen
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/04Maintaining the quality of display appearance
    • G09G2320/043Preventing or counteracting the effects of ageing
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/10Special adaptations of display systems for operation with variable images
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00Aspects of the architecture of display systems
    • G09G2360/16Calculation or use of calculated indices related to luminance levels in display data

Definitions

  • This invention relates to a method for reducing motion blur of images shown on non-stroboscopic display devices.
  • Non-stroboscopic non-emissive displays such as Liquid Crystal Displays (LCD), active-matrix LCDs (amLCD), Plasma Panel Displays (PDP), Thin Film Transistor (TFT) displays, Liquid Crystal on Silicon (LCOS) displays or Colour Sequential Displays, consist of a display panel having a row and column array of image elements (pixels) for modulating light, means for illuminating the display panel from the front or back side, and drive means for driving the pixels in accordance with an applied input video signal.
  • LCD Liquid Crystal Displays
  • amLCD Active-matrix LCDs
  • PDP Plasma Panel Displays
  • TFT Thin Film Transistor
  • LCOS Liquid Crystal on Silicon
  • Colour Sequential Displays consist of a display panel having a row and column array of image elements (pixels) for modulating light, means for illuminating the display panel from the front or back side, and drive means for driving the pixels in accordance with an applied input video signal.
  • non-stroboscopic emissive displays such as Organic Light Emitting Diodes (O-LED) displays, Polymer Light Emitting Diodes (PLED) displays, active-matrix PLEDs (amPLED) displays or Plasma Display Panels (PDP), consist of a display panel having a row and column array of pixels (LEDs) and drive means for driving the pixels (LEDs) in accordance with an applied input video signal.
  • O-LED Organic Light Emitting Diodes
  • PLED Polymer Light Emitting Diodes
  • amPLED active-matrix PLEDs
  • PDP Plasma Display Panels
  • the pixels (LEDs) emit and modulate light by themselves without requiring illumination from the front or back side.
  • each pixel of a displayed image is generated as a pulse, which is very short compared to the image period T.
  • each pixel is displayed during most of the image period.
  • this non- stroboscopic behaviour also holds for types of CRTs whose pixels, e.g. slow phospor atoms, are active for a time not negligible to the image period.
  • the motion vector D vT is the product of the object velocity v and the image period T.
  • the integration is the same as a convolution of F(x,n) and a sample-and-hold function h(cc) :
  • the effect of the motion tracking / temporal sample-and-hold characteristic is a spatial frequency low-pass filtering in the direction of the motion with a sine- frequency response, with a cut-off- frequency being inversely proportional to the quantity j ' D , where j ' is denoted as the duty cycle of the display.
  • the non-stroboscopic light generation combined with the eye tracking of the viewer trying to follow moving objects from one image to the next, thus leads to the perception of motion-dependent blur in the images.
  • the cut-off- frequency of the spatial low pass filter and thus the degree of perceived motion blur can be kept constant by reducing the display time t, (or the duty cycle j - ) with the drawback of loss of brightness and increased flicker.
  • prior art document WO 03/101086 A2 proposes to measure the motion and the characteristics of motion in the images of the input video signal and to continuously adjust the display time t, depending on this measured motion and the characteristics of motion.
  • additionally anti-motion blur filtering based on the measured motion vectors is performed, and the display time and the sort and amount of anti- motion blur filtering are jointly controlled based on the measured motion and the characteristics of motion.
  • local image characteristics that determine high spatial frequencies are considered in the filtering process and in the joint control of display time and sort and amount of anti- motion blur filtering, because these characteristics contain information on how reliable anti- motion blur filtering can be performed.
  • WO 03/101086 A2 proposes to control the light output of the display inversely proportional to the display time, and, to reduce flicker, it is targeted to keep the display time as large as possible and to suppress motion blur with anti-motion blur filtering instead of reducing the display time.
  • an object of the present invention to provide a low-complexity method, computer program, computer program product and device for reducing motion blur of images shown on non-stroboscopic display devices.
  • a method for reducing motion blur of images shown on non- stroboscopic display devices in which local areas p t of an image of a video signal are displayed during respective local display times /, that are less than or equal to an image period T , comprising determining an amount X 1 of high spatial frequency content related to a local area P 1 of said image of said video signal, and adjusting a local display time /, in dependence on said determined amount X 1 of high spatial frequency content, wherein said local display time I 1 is decreased with increasing determined amount X 1 of high spatial frequency content.
  • Said display device is a non-stroboscopic display device in the sense that when displaying images of said video signal, it generates, transmits or reflects light during display times I 1 that are not negligible with respect to the image period T .
  • Said display device may be an emissive or a non-emissive display, and said local display times I 1 during which images of said video signal are displayed on said display then may refer to the times in which LEDs of said emissive display emit light or in which portions of the back-lights of said non- emissive displays are illuminated, respectively.
  • Said display device may be integrated in all kinds of electronic devices that require a visual human-machine interface, for instance a television, a computer, a hand-held mobile device, a head-up system, an instrument or similar.
  • Said video signal is composed of images that are displayed sequentially on said display device, wherein each image is spatially composed of a plurality of local areas P 1 , and wherein each local area P 1 is displayed during an associated local display time t t either in said emissive or non-emissive manner.
  • Said local areas p t may for instance represent a group of adjacent pixels of an image, or all pixels of an image, so that the image is only composed of one local area p t that equals the image and only one associated local display time t t .
  • An amount X 1 of high spatial frequency content related to a respective local area p t of said image of said video signal is determined, wherein said amount X 1 of high spatial frequency content characterises the high spatial frequency range of the spatial frequency domain spectrum of said local area p, of said image of said video signal, for instance, the sum of the magnitude of the spectrum coefficients for a certain high spatial frequency range, or a maximum spectrum coefficient in a certain high spatial frequency range, or the at least partial integration of the high- pass filtered local area p t of said image of said image signal, or similar.
  • Content in the high spatial frequency region of the spectrum of an image may for instance be caused by pronounced differences between pixels of an image, such as edges, abrupt colour or brightness transitions, textures etc.
  • said local display time / that is related to the same local area p, of said image is adjusted, wherein said local display time t t is decreased with increasing determined amount X 1 of high spatial frequency content.
  • said display time t t may be assigned continuous or discrete values between 0 and
  • the present invention recognises that the occurrence of motion blur caused by the sample-and-hold characteristic of the non-stroboscopic display device is not only linked to motion in the images, but also to the presence of high spatial frequency content in the images, such as for instance textures or edges.
  • the present invention thus proposes to check on the presence of high spatial frequency content in the areas p t of said image of said video signal and to adjust the display time /, in dependence on the amount X 1 of this high spatial frequency content. This allows for a simplified implementation of the display system, because the amount X 1 of high spatial frequency content is easily determined, for instance, by means of a spatial frequency high-pass filter and does not require the deployment of computationally expensive motion estimation algorithms.
  • said adjusting of said local display time I 1 may depend on only one image-related characteristic of said video signal, and said only one image-related characteristic of said video signal may be said amount X 1 of high spatial frequency content related to said local area p t of said image of said video signal.
  • said adjusting of said display time then does not depend on the motion in said image of said video signal, so that no computationally expensive motion estimation and no frame memories are required.
  • said determining of said amount X 1 of high spatial frequency content related to said local area p t of said image of said video signal comprises at least partially filtering said local area P 1 with a spatial frequency domain high-pass filter.
  • an output of said spatial frequency domain high-pass filter may at least partially be combined to obtain said amount X 1 of high spatial frequency content related to said local area p t of said image of said video signal.
  • the samples or the magnitude of the samples output by said high-pass filter may at least partially be summed to obtain said amount X 1 of high spatial frequency content.
  • said local display time / is set to a maximum value if said amount X 1 of high spatial frequency content is below a first threshold k ⁇
  • said local display time t is set to a minimum value if said amount X 1 of high spatial frequency content is above a second threshold k 2 .
  • said local display time I 1 decreases from said maximum value to said minimum value when said amount X 1 of high spatial frequency content increases from said first threshold &, to said second threshold k 2 .
  • said local display time decreases linearly from said maximum value to said minimum value.
  • a further preferred embodiment of the present invention further comprises adjusting the light intensity, with which said local area p t of said image of said video signal is displayed on said non-stroboscopic display, in dependence on said adjusted local display time t t .
  • said local display time stems from a limited set of discrete local display times. This may further reduce the complexity of the display system.
  • said determining of said amount X 1 of high spatial frequency content related to said local area p t of said image of said video signal is based on a area of said image of said video signal that is larger than said local area p t .
  • Said area may for instance comprise adjacent pixels or areas around said local area p t . This may contribute to avoiding abrupt changes in the determined amounts X 1 of high spatial frequency content related to respective adjacent local areas p, and thus to avoiding abrupt changes in the corresponding adjusted local display times I 1 , which may cause inconsistencies in the spatio-temporal light emission pattern. Such inconsistencies may cause unwanted effects depending on the eye tracking of the viewer, like e.g. flashes as the edges of moving components.
  • a further preferred embodiment of the present invention further comprises determining an amount of temporal differences in said local area p t of said image of said video signal, wherein said local display time /, is only decreased with increasing determined amount X 1 of high spatial frequency content in dependence on said determined amount of temporal differences.
  • the present invention recognises that motion blur in non-stroboscopic display devices occurs only in areas with high spatial frequency content and motion.
  • the amount of spatial frequency content of a local area p t may be determined and used as a basis for the adjustment of the local display time I 1 .
  • an additional determination of the amount of temporal differences in said local area p is integrated according to this embodiment of the present invention, wherein said temporal differences serve as a coarse measure for the amount of motion in said local area p t , but are much simpler to be determined, for instance by subtracting corresponding pixels of corresponding local areas p t in two subsequent images of said video signal, or by temporal low-pass filtering.
  • the optimum local display time t t is adjusted.
  • the adjustment of the local display time then may for instance comprise an enquiry if the determined amount of temporal differences exceeds a threshold, which may be pre-determined or adaptively determined, e.g. based on the overall amount of temporal differences in the images of the video signal.
  • a threshold which may be pre-determined or adaptively determined, e.g. based on the overall amount of temporal differences in the images of the video signal.
  • the local display time I 1 is only reduced with increasing amount of high spatial frequency content if there is sufficient motion, so that otherwise motion blur would result.
  • a computer program is further proposed with instructions operable to cause a processor to perform the above-mentioned method steps.
  • Said computer program may for instance be processed by a central processing unit of said display device.
  • a computer program product comprising a computer program with instructions operable to cause a processor to perform the above-mentioned method steps.
  • Said computer program product may for instance be a removable storage medium such as a disc, a CD-ROM, DVD, a memory stick or memory card.
  • a device for reducing motion blur of images shown on non-stroboscopic display devices, in which local areas p t of an image of a video signal are displayed during respective local display times I 1 that are less than or equal to a image period T , comprising means arranged for determining an amount X 1 of high spatial frequency content related to a local area p t of said image of said video signal, and means arranged for adjusting a local display time I 1 in dependence on said determined amount X 1 of high spatial frequency content, wherein said local display time /, is decreased with increasing determined amount X 1 of high spatial frequency content.
  • Said device may for instance be integrated in or attached to a display device, or may represent an external module.
  • a preferred embodiment of the present invention further comprises means arranged for adjusting the light intensity, with which said local area p t of said image of said video signal is displayed on said non-stroboscopic display, in dependence on said adjusted local display time /, .
  • a further preferred embodiment of the present invention further comprises means arranged for determining an amount of temporal differences in said local area p t of said image of said video signal, wherein said local display time I 1 is only decreased with increasing determined amount X 1 of high spatial frequency content in dependence on said determined amount of temporal differences.
  • Fig. Ia A schematic illustration of the spatial frequency transfer function of the display + eye combination as a function of motion and spatial frequency for a duty cycle of 100%;
  • Fig. Ib a schematic illustration of the spatial frequency transfer function of the display + eye combination as a function of motion and spatial frequency for a duty cycle of 30%;
  • Fig. 2 a schematic illustration of the trade-off between driving current for the backlights of a non-emissive display or the light emitting diodes of an emissive display and duty cycle when displaying images on a non-stroboscopic display device with equal luminance;
  • Fig. 3 a schematic illustration of the trade-off between life-time and motion portrayal quality when increasing the duty cycle for images displayed on a non-stroboscopic display device
  • Fig. 4 a first embodiment of a system for reducing motion blur according to the present invention, based on adjusting a display time (duty cycle) in dependence on the amount of high spatial frequency content in local areas of images of a video signal; and
  • Fig. 5 a second embodiment of a system for reducing motion blur according to the present invention based on adjusting a display time (duty cycle) in dependence on the amount of high spatial frequency content and the amount of temporal differences in local areas of images of a video signal.
  • the present invention proposes to control the display time I 1 , which is related to a local area p t of an image of a video signal that is displayed on a non-stroboscopic display device, in dependence on a determined amount X 1 of High Spatial Frequency Content (HSFC) in said local area p t and optionally also in dependence on a determined amount of temporal differences in said local area p t .
  • HSFC High Spatial Frequency Content
  • Figs. Ia and Ib schematically depict the spatial frequency transfer function of the display + eye combination as a function of the motion (in pixels per frame) and the spatial frequency for duty cycles of 100% (Fig. Ia), i.e. continuous light generation during the complete picture period such as in a regular active matrix LED or OLED display, and 30% (Fig. Ib), i.e. the display generates light for 30% of the image period and is switched off for 70% of the image period.
  • the duty cycle denotes the ratio between display time I 1 and image period T
  • the shaded regions represent spatial frequency transfer function magnitudes between 0 and 0.5 (large attenuation of the associated frequencies)
  • the white regions represent spatial frequency transfer function magnitudes between 0.5 and 1 (low attenuation).
  • a spatial frequency of 0.5 equals the nyquist frequency for the display: a pixclwise on-off pattern.
  • Table 1 lists the possibilities where motion blur might occur.
  • the first condition for motion blur is the availability of HSFC in local areas p t of an image (No. 3 and 4 in Table 1).
  • the second condition is that there has to be motion (No. 2 and 4 in Table 1 ). Both conditions must be true to result in motion blur.
  • the present invention proposes to test the first condition to be true (No. 3 and 4 in Table 1) when adapting the duty cycle.
  • the duty cycle is then also adjusted in situations where it would not have been necessary (No. 3 in Table 1), but this case is by far outweighed by the possibility of a low-complexity implementation of the present invention when only testing for the amount of HSFC.
  • large area flicker is most visible in flat areas (no HSFC), so decreasing the duty cycle in No. 3 is not as bad as in cases No. 1 and No. 2.
  • Motion portrayal thus can be improved by decreasing the duty cycle (or display time /, ).
  • flicker has to be taken into account. Flicker increases with decreasing duty cycle and then may be perceived as annoying by a viewer.
  • the adaptation to the HSFC can also be don locally, which allows a more accurate choice from the cases in table 1.
  • the intensity of the pixels should be inversely proportional to the duty cycle, as illustrated in Fig. 2, which depicts the trade-off between duty cycle and current fed to the LEDs or an emissive display or to the back-lights of a non-emissive display in order to achieve a constant luminance 20.
  • Fig. 4 depicts an according first embodiment 4 of the present invention that performs an adjustment of the display time/duty cycle in dependence on the determined amount of HSFC in local areas of an image of a video signal.
  • an input video signal is first fed into a high-pass filter 40.
  • a local area P 1 of an image of said input video signal for instance comprising several adjacent pixels of said image, is filtered with a spatial frequency domain low-pass filter and may be further processed to obtain a measure for the amount of HSFC in said local area p t .
  • the absolute of the filter outputs are summed to obtain a measure for the amount X 1 of HSFC in said local area p t .
  • the determined amount X 1 of HSFC is then fed to a duty cycle adjustment instance 41, which is composed of a limiting function instance 42 and a duty cycle modulator 43.
  • a duty cycle adjustment instance 41 which is composed of a limiting function instance 42 and a duty cycle modulator 43.
  • the determined amount X 1 of HSFC is processed by clipping, coring and normalizing to obtain a drive value D 1 for the duty cycle modulator 43, which is defined as:
  • &, and k 2 are thresholds that allow the minimum and maximum duty cycle to be used for a range of 'HSFC levels', and that allows a transition region to be defined where the switch from short to long duty cycles takes place, a is a parameter for adjusting the slope of this transition.
  • limiting function instance 42 can also be seen as part of the spatial high pass-filter 40, or as part of the duty cycle modulator 43; this does not influence the overall functionality.
  • the luminance control instance 44 adjusts the input video signal in response to the adjusted duty cycle such that the instantaneous light output of the display segment associated with the local area p t , for which the duty cycle is currently adjusted, results in the correct luminance. This may be necessary in case the duty cycle control of the display itself does not correct for luminance, or in case of an OLED display (or other emissive displays), where the intensity is directly determined by the video (drive values) and not also by a backlight. In the most flexible form, the duty cycle is varied continuously between a minimum (e.g. 20%), and a maximum (likely 100%), depending on the image characteristics. In some cases, a limited set of duty cycles to choose from can be used.
  • the modulation of the duty cycle is not the only way to influence the motion blur - lifetime (and flicker) trade-off. Any other method can also be used to modulate the temporal light emission, for example the addition of a bias to the DC value. This gives more or less the same trade-off as with a varying duty cycle (both regarding flicker and lifetime), and therefore the present invention also works with this type of duty cycle modulation (the bias method can also be seen as a form of duty cycle modulation, by creating a mixture of two duty cycles, 100% and e.g. 30%, resulting in an effective duty cycle somewhere in between).
  • the amount of temporal differences in the local areas p t is additionally determined and considered in the adjustment of the display time /, / duty cycle. This may for instance be accomplished by adding a frame memory to the first embodiment 4 of Fig. 4.
  • temporal image characteristics can be determined, which represent a coarse indication of motion.
  • the determination of said temporal differences may be embodied as a temporal high-pass, which gives per pixel of a local area p t only the a value indicative of motion, but not of the direction of the motion.
  • the adjustment of the duty cycle can be influenced more reliably.
  • the duty cycle can still be large without causing motion blur.
  • Table 2 lists the possible cases where motion blur occurs. The second column indicates the test for HSFC, and the fourth column indicates test for a large amount of temporal differences.
  • the addition of a simple estimation technique to determine the amount of temporal differences in local areas p t helps to avoid a reduction of the duty cycle in case No. 2 of Table 2 (corresponding to case 3 of Table 1) and otherwise, apart from rare or noisy cases, identifies the correct cases where a reduction of the duty cycle to combat motion blur is required.
  • the duty cycle is only reduced when it is actually required, which reduces flicker and increases the lifetime of the display device.
  • Fig. 5 depicts the basic set-up of the second embodiment 5 of the present invention.
  • the input video signal is analyzed in a spatio-temporal image characteristics instance 50, where the local areas p t of images of said input video signal are for instance filtered in the spatial frequency and temporal frequency domain to determine the amount of HSFC and the amount of temporal differences, and, based on these results, a drive value D 1 (corresponding to the local area /?,) for the duty cycle modulator 51 is determined.
  • the duty cycle as determined by the duty cycle modulator 51 is then forwarded to the emissive or non-emissive non-stroboscopic display, and also to a luminance control instance 52, which adjusts the input video signal in response to the duty cycle such that the instantaneous light output of the display segment associated with the local area p t , for which the duty cycle is currently adjusted, results in the correct luminance.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Liquid Crystal Display Device Control (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

This invention relates to a method, a computer program, a computer program product and a device for reducing motion blur of images shown on non-stroboscopic display devices, in which local areas p, of an image of a video signal are displayed during respective local display times t; that are less than or equal to a image period T, comprising determining (40) an amount X; of high spatial frequency content related to a local area p, of said image of said video signal, and adjusting (41) a local display time t, in dependence on said determined amount X; of high spatial frequency content, wherein said local display time t; is decreased with increasing determined amount X; of high spatial frequency content.

Description

Display time control for images
FIELD OF THE INVENTION
This invention relates to a method for reducing motion blur of images shown on non-stroboscopic display devices.
BACKGROUND OF THE INVENTION
Non-stroboscopic non-emissive displays, such as Liquid Crystal Displays (LCD), active-matrix LCDs (amLCD), Plasma Panel Displays (PDP), Thin Film Transistor (TFT) displays, Liquid Crystal on Silicon (LCOS) displays or Colour Sequential Displays, consist of a display panel having a row and column array of image elements (pixels) for modulating light, means for illuminating the display panel from the front or back side, and drive means for driving the pixels in accordance with an applied input video signal. Quite similar, non-stroboscopic emissive displays, such as Organic Light Emitting Diodes (O-LED) displays, Polymer Light Emitting Diodes (PLED) displays, active-matrix PLEDs (amPLED) displays or Plasma Display Panels (PDP), consist of a display panel having a row and column array of pixels (LEDs) and drive means for driving the pixels (LEDs) in accordance with an applied input video signal. However, the pixels (LEDs) emit and modulate light by themselves without requiring illumination from the front or back side.
In state-of-the-art Cathode Ray Tubes (CRTs), each pixel of a displayed image is generated as a pulse, which is very short compared to the image period T. Different to these state-of-the-art CRTs, in new flat, high quality, low cost non-stroboscopic display devices, each pixel is displayed during most of the image period. Of course, this non- stroboscopic behaviour also holds for types of CRTs whose pixels, e.g. slow phospor atoms, are active for a time not negligible to the image period. In the sequel of this description, we thus will only differentiate between stroboscopic and non-stroboscopic displays, and in case of a non-stroboscopic display, we will use the term "pixel" for both the elements of a light modulation/generation array and the activated (slow) atoms of a CRT-type display.
In case any area of the image displayed on a non-stroboscopic display contains motion, the viewer will track this motion. As each pixel is displayed substantially the whole image period, the intensity of pixels showing the motion is integrated along the motion trajectory as follows:
Figure imgf000004_0001
with t, as display time of each image, F as input video signal, F00, as output video signal, and
Tas image period. The motion vector D = vT is the product of the object velocity v and the image period T. In case t, is constant, the integration is the same as a convolution of F(x,n) and a sample-and-hold function h(cc) :
F01,, (* ', n) = - }F(X + a D, n) da '» o (2)
Figure imgf000004_0002
where
Figure imgf000004_0003
is a ID block function, oriented along the motion vector D . It is therefore actually a 2D function h(x) , which has zero value outside the line segment x = IcD , Q ≤ k < tt IT , while the 2D integral area is normalised to 1. The 2D spatial Fourier transform (leading to a representation of h(x) in the spatial frequency domain) of Eq. (2) yields:
Figure imgf000004_0004
with F(f,n) denoting the 2D spatial Fourier transform of the input video signal F(x,n) , and H(/) denoting the 2D spatial Fourier transform of h(x) :
Figure imgf000005_0001
Apparently the effect of the motion tracking / temporal sample-and-hold characteristic is a spatial frequency low-pass filtering in the direction of the motion with a sine- frequency response, with a cut-off- frequency being inversely proportional to the quantity j ' D , where j ' is denoted as the duty cycle of the display. The non-stroboscopic light generation, combined with the eye tracking of the viewer trying to follow moving objects from one image to the next, thus leads to the perception of motion-dependent blur in the images. When the motion D in the image increases, the cut-off- frequency of the spatial low pass filter and thus the degree of perceived motion blur can be kept constant by reducing the display time t, (or the duty cycle j- ) with the drawback of loss of brightness and increased flicker.
To reduce motion blur, loss of brightness and flicker, prior art document WO 03/101086 A2 proposes to measure the motion and the characteristics of motion in the images of the input video signal and to continuously adjust the display time t, depending on this measured motion and the characteristics of motion. In a preferred embodiment, additionally anti-motion blur filtering based on the measured motion vectors is performed, and the display time and the sort and amount of anti- motion blur filtering are jointly controlled based on the measured motion and the characteristics of motion. In a further preferred embodiment, local image characteristics that determine high spatial frequencies are considered in the filtering process and in the joint control of display time and sort and amount of anti- motion blur filtering, because these characteristics contain information on how reliable anti- motion blur filtering can be performed. To reduce loss of brightness, WO 03/101086 A2 proposes to control the light output of the display inversely proportional to the display time, and, to reduce flicker, it is targeted to keep the display time as large as possible and to suppress motion blur with anti-motion blur filtering instead of reducing the display time.
All embodiments of WO 03/101086 A2 require the estimation of both the amount and the direction of motion vectors and thus require frame memories and computationally expensive real-time motion estimation algorithms. This proposed display system is thus complex and expensive when being implemented.
SUMMARY OF THE INVENTION In view of the above-mentioned problem, it is thus, inter alia, an object of the present invention to provide a low-complexity method, computer program, computer program product and device for reducing motion blur of images shown on non-stroboscopic display devices.
A method is proposed for reducing motion blur of images shown on non- stroboscopic display devices, in which local areas pt of an image of a video signal are displayed during respective local display times /, that are less than or equal to an image period T , comprising determining an amount X1 of high spatial frequency content related to a local area P1 of said image of said video signal, and adjusting a local display time /, in dependence on said determined amount X1 of high spatial frequency content, wherein said local display time I1 is decreased with increasing determined amount X1 of high spatial frequency content.
Said display device is a non-stroboscopic display device in the sense that when displaying images of said video signal, it generates, transmits or reflects light during display times I1 that are not negligible with respect to the image period T . Said display device may be an emissive or a non-emissive display, and said local display times I1 during which images of said video signal are displayed on said display then may refer to the times in which LEDs of said emissive display emit light or in which portions of the back-lights of said non- emissive displays are illuminated, respectively. Said display device may be integrated in all kinds of electronic devices that require a visual human-machine interface, for instance a television, a computer, a hand-held mobile device, a head-up system, an instrument or similar.
Said video signal is composed of images that are displayed sequentially on said display device, wherein each image is spatially composed of a plurality of local areas P1 , and wherein each local area P1 is displayed during an associated local display time tt either in said emissive or non-emissive manner. Said local areas pt may for instance represent a group of adjacent pixels of an image, or all pixels of an image, so that the image is only composed of one local area pt that equals the image and only one associated local display time tt .
An amount X1 of high spatial frequency content related to a respective local area pt of said image of said video signal is determined, wherein said amount X1 of high spatial frequency content characterises the high spatial frequency range of the spatial frequency domain spectrum of said local area p, of said image of said video signal, for instance, the sum of the magnitude of the spectrum coefficients for a certain high spatial frequency range, or a maximum spectrum coefficient in a certain high spatial frequency range, or the at least partial integration of the high- pass filtered local area pt of said image of said image signal, or similar. Content in the high spatial frequency region of the spectrum of an image may for instance be caused by pronounced differences between pixels of an image, such as edges, abrupt colour or brightness transitions, textures etc.
In dependence on said determined amount X1 of high spatial frequency content related to a respective local area pt of said image, said local display time /, that is related to the same local area p, of said image is adjusted, wherein said local display time tt is decreased with increasing determined amount X1 of high spatial frequency content. In said adjustment, said display time tt may be assigned continuous or discrete values between 0 and
T .
The present invention recognises that the occurrence of motion blur caused by the sample-and-hold characteristic of the non-stroboscopic display device is not only linked to motion in the images, but also to the presence of high spatial frequency content in the images, such as for instance textures or edges. The present invention thus proposes to check on the presence of high spatial frequency content in the areas pt of said image of said video signal and to adjust the display time /, in dependence on the amount X1 of this high spatial frequency content. This allows for a simplified implementation of the display system, because the amount X1 of high spatial frequency content is easily determined, for instance, by means of a spatial frequency high-pass filter and does not require the deployment of computationally expensive motion estimation algorithms.
According to the present invention, said adjusting of said local display time I1 may depend on only one image-related characteristic of said video signal, and said only one image-related characteristic of said video signal may be said amount X1 of high spatial frequency content related to said local area pt of said image of said video signal. In particular, said adjusting of said display time then does not depend on the motion in said image of said video signal, so that no computationally expensive motion estimation and no frame memories are required. According to a preferred embodiment of the present invention, said determining of said amount X1 of high spatial frequency content related to said local area pt of said image of said video signal comprises at least partially filtering said local area P1 with a spatial frequency domain high-pass filter.
According to this preferred embodiment of the present invention, an output of said spatial frequency domain high-pass filter may at least partially be combined to obtain said amount X1 of high spatial frequency content related to said local area pt of said image of said video signal. For instance, the samples or the magnitude of the samples output by said high-pass filter may at least partially be summed to obtain said amount X1 of high spatial frequency content. According to this preferred embodiment of the present invention, said local display time /, is set to a maximum value if said amount X1 of high spatial frequency content is below a first threshold kλ , and said local display time t, is set to a minimum value if said amount X1 of high spatial frequency content is above a second threshold k2 .
According to this preferred embodiment of the present invention, said local display time I1 decreases from said maximum value to said minimum value when said amount X1 of high spatial frequency content increases from said first threshold &, to said second threshold k2.
According to this preferred embodiment of the present invention, said local display time decreases linearly from said maximum value to said minimum value. A further preferred embodiment of the present invention further comprises adjusting the light intensity, with which said local area pt of said image of said video signal is displayed on said non-stroboscopic display, in dependence on said adjusted local display time tt . To avoid loss of brightness when reducing the local display time tt , it is advantageous to increase the light intensity with which said local area pt is illuminated inversely proportional to the reduction of the local display time I1 . In a non-emissive display, this may be accomplished by controlling the back-lights, and in an emissive display, this may be achieved by controlling the LEDs themselves.
According to a further preferred embodiment of the present invention, said local display time stems from a limited set of discrete local display times. This may further reduce the complexity of the display system.
According to this preferred embodiment of the present invention, said determining of said amount X1 of high spatial frequency content related to said local area pt of said image of said video signal is based on a area of said image of said video signal that is larger than said local area pt . Said area may for instance comprise adjacent pixels or areas around said local area pt . This may contribute to avoiding abrupt changes in the determined amounts X1 of high spatial frequency content related to respective adjacent local areas p, and thus to avoiding abrupt changes in the corresponding adjusted local display times I1 , which may cause inconsistencies in the spatio-temporal light emission pattern. Such inconsistencies may cause unwanted effects depending on the eye tracking of the viewer, like e.g. flashes as the edges of moving components.
A further preferred embodiment of the present invention further comprises determining an amount of temporal differences in said local area pt of said image of said video signal, wherein said local display time /, is only decreased with increasing determined amount X1 of high spatial frequency content in dependence on said determined amount of temporal differences.
The present invention recognises that motion blur in non-stroboscopic display devices occurs only in areas with high spatial frequency content and motion. For the lowest complexity of the display system, the amount of spatial frequency content of a local area pt may be determined and used as a basis for the adjustment of the local display time I1 . To avoid a reduction of the display times I1 for local areas that have high spatial frequency content but no motion, which causes either a loss of brightness, flicker, or, if the light intensity of the display is controlled inversely proportional to the local display times /, , a reduction of the life time of the display elements, an additional determination of the amount of temporal differences in said local area p, is integrated according to this embodiment of the present invention, wherein said temporal differences serve as a coarse measure for the amount of motion in said local area pt , but are much simpler to be determined, for instance by subtracting corresponding pixels of corresponding local areas pt in two subsequent images of said video signal, or by temporal low-pass filtering. Based on the determined amount of spatial frequency content and the determined amount of temporal differences, both related to a local area pt , the optimum local display time tt is adjusted. With only the temporal differences, and not the 2D motion vectors being required for the adjustment, the resulting display system is still of low complexity, in the simplest case only a temporal low- pass filter is required to estimate the amount of temporal differences. The adjustment of the local display time then may for instance comprise an enquiry if the determined amount of temporal differences exceeds a threshold, which may be pre-determined or adaptively determined, e.g. based on the overall amount of temporal differences in the images of the video signal. In effect, then the local display time I1 is only reduced with increasing amount of high spatial frequency content if there is sufficient motion, so that otherwise motion blur would result.
A computer program is further proposed with instructions operable to cause a processor to perform the above-mentioned method steps. Said computer program may for instance be processed by a central processing unit of said display device.
A computer program product is further proposed comprising a computer program with instructions operable to cause a processor to perform the above-mentioned method steps. Said computer program product may for instance be a removable storage medium such as a disc, a CD-ROM, DVD, a memory stick or memory card.
A device is further proposed for reducing motion blur of images shown on non-stroboscopic display devices, in which local areas pt of an image of a video signal are displayed during respective local display times I1 that are less than or equal to a image period T , comprising means arranged for determining an amount X1 of high spatial frequency content related to a local area pt of said image of said video signal, and means arranged for adjusting a local display time I1 in dependence on said determined amount X1 of high spatial frequency content, wherein said local display time /, is decreased with increasing determined amount X1 of high spatial frequency content. Said device may for instance be integrated in or attached to a display device, or may represent an external module. A preferred embodiment of the present invention further comprises means arranged for adjusting the light intensity, with which said local area pt of said image of said video signal is displayed on said non-stroboscopic display, in dependence on said adjusted local display time /, .
A further preferred embodiment of the present invention further comprises means arranged for determining an amount of temporal differences in said local area pt of said image of said video signal, wherein said local display time I1 is only decreased with increasing determined amount X1 of high spatial frequency content in dependence on said determined amount of temporal differences.
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
BRIEF DESCRIPTION OF THE FIGURES
In the figures shows:
Fig. Ia: A schematic illustration of the spatial frequency transfer function of the display + eye combination as a function of motion and spatial frequency for a duty cycle of 100%;
Fig. Ib: a schematic illustration of the spatial frequency transfer function of the display + eye combination as a function of motion and spatial frequency for a duty cycle of 30%;
Fig. 2: a schematic illustration of the trade-off between driving current for the backlights of a non-emissive display or the light emitting diodes of an emissive display and duty cycle when displaying images on a non-stroboscopic display device with equal luminance;
Fig. 3: a schematic illustration of the trade-off between life-time and motion portrayal quality when increasing the duty cycle for images displayed on a non-stroboscopic display device;
Fig. 4: a first embodiment of a system for reducing motion blur according to the present invention, based on adjusting a display time (duty cycle) in dependence on the amount of high spatial frequency content in local areas of images of a video signal; and
Fig. 5: a second embodiment of a system for reducing motion blur according to the present invention based on adjusting a display time (duty cycle) in dependence on the amount of high spatial frequency content and the amount of temporal differences in local areas of images of a video signal. DETAILED DESCRIPTION OF THE INVENTION
The present invention proposes to control the display time I1 , which is related to a local area pt of an image of a video signal that is displayed on a non-stroboscopic display device, in dependence on a determined amount X1 of High Spatial Frequency Content (HSFC) in said local area pt and optionally also in dependence on a determined amount of temporal differences in said local area pt . With increasing amount X1 of HSFC in local areas P1 of said image, the display time I1 is reduced to avoid motion blur.
The rationale behind this approach is depicted in Figs. Ia and Ib, which schematically depict the spatial frequency transfer function of the display + eye combination as a function of the motion (in pixels per frame) and the spatial frequency for duty cycles of 100% (Fig. Ia), i.e. continuous light generation during the complete picture period such as in a regular active matrix LED or OLED display, and 30% (Fig. Ib), i.e. the display generates light for 30% of the image period and is switched off for 70% of the image period. Therein, the duty cycle denotes the ratio between display time I1 and image period T , the shaded regions represent spatial frequency transfer function magnitudes between 0 and 0.5 (large attenuation of the associated frequencies), and the white regions represent spatial frequency transfer function magnitudes between 0.5 and 1 (low attenuation). A spatial frequency of 0.5 equals the nyquist frequency for the display: a pixclwise on-off pattern.
As can be readily seen from Fig. Ia, below spatial frequencies of 0.15, basically no attenuation occurs irrespective of the motion. However, higher spatial frequencies are attenuated, and the higher the spatial frequency, the lower the motion that is required to cause substantial attenuation (larger than 0.5) in the display + eye combination. The attenuation of these high spatial frequencies is perceived as motion blur by a viewer. With respect to Fig. Ib, it is obvious that by reducing the duty cycle (display time), the threshold for which no attenuation irrespective of the motion occurs is increased to a spatial frequency of 0.35. The observation that with increasing spatial frequencies, lower motion is required to already cause substantial attenuation still holds, however, as compared to Fig. Ia, for the same spatial frequency, now a much larger motion is required to cause the same attenuation. This effect, i.e. the shifting of the spatial frequency from which attenuation starts to higher spatial frequencies when decreasing the duty cycle (display time), is due to the s/rtc-characteristic of the display + eye combination as already derived in Eq. (5).
Figure imgf000013_0001
Table 1 : Occurrences of motion blur
Table 1 lists the possibilities where motion blur might occur. The first condition for motion blur is the availability of HSFC in local areas pt of an image (No. 3 and 4 in Table 1). The second condition is that there has to be motion (No. 2 and 4 in Table 1 ). Both conditions must be true to result in motion blur.
The present invention proposes to test the first condition to be true (No. 3 and 4 in Table 1) when adapting the duty cycle. The duty cycle is then also adjusted in situations where it would not have been necessary (No. 3 in Table 1), but this case is by far outweighed by the possibility of a low-complexity implementation of the present invention when only testing for the amount of HSFC. Also, large area flicker is most visible in flat areas (no HSFC), so decreasing the duty cycle in No. 3 is not as bad as in cases No. 1 and No. 2.
Motion portrayal thus can be improved by decreasing the duty cycle (or display time /, ). However, when decreasing the duty cycle to a large extent, flicker has to be taken into account. Flicker increases with decreasing duty cycle and then may be perceived as annoying by a viewer. With a display that allows variation of the duty cycle per area pt , the adaptation to the HSFC can also be don locally, which allows a more accurate choice from the cases in table 1. Furthermore, to keep the total light output of the pixels of an image constant when reducing the duty cycle, and thus to avoid a reduction of overall brightness of the image, the intensity of the pixels should be inversely proportional to the duty cycle, as illustrated in Fig. 2, which depicts the trade-off between duty cycle and current fed to the LEDs or an emissive display or to the back-lights of a non-emissive display in order to achieve a constant luminance 20.
In particular at low duty cycles, high peak intensities may be required to achieve a constant luminance. For an LCD display this causes problems with the limited backlight intensity. A (polymer) organic LED display (OLED) in principle does not have a limited peak intensity, but with this type of display, the lifetime decreases when high peak currents are used (even when the total light output remains constant). Therefore, although OLEDs allow driving at much lower duty cycles than LCDs, in practice the lifetime will be an extra reason to drive the display at the highest possible duty cycle.
The relation between duty cycle and motion blur, at equal light output, thus results in a trade-off between motion picture quality 30, flicker (not depicted), and lifetime 31, as illustrated in Fig. 3. Controlling the duty cycle according to the present invention thus represents a dynamic adjusting of this trade-off. Note also that other displays, such as LCDs might also profit from increased lifetime, since the backlights also tend to degrade faster with higher peak luminance.
Fig. 4 depicts an according first embodiment 4 of the present invention that performs an adjustment of the display time/duty cycle in dependence on the determined amount of HSFC in local areas of an image of a video signal. To this end, an input video signal is first fed into a high-pass filter 40. Therein, a local area P1 of an image of said input video signal, for instance comprising several adjacent pixels of said image, is filtered with a spatial frequency domain low-pass filter and may be further processed to obtain a measure for the amount of HSFC in said local area pt . In the most simple case, the absolute of the filter outputs are summed to obtain a measure for the amount X1 of HSFC in said local area pt . The determined amount X1 of HSFC is then fed to a duty cycle adjustment instance 41, which is composed of a limiting function instance 42 and a duty cycle modulator 43. In the limiting function instance 42, the determined amount X1 of HSFC is processed by clipping, coring and normalizing to obtain a drive value D1 for the duty cycle modulator 43, which is defined as:
o vμr,|<*, D = a{X, -k,) V Jt1 < |_Y,| < Jt2 (6) 1 y \x\ > k2
Therein, &, and k2 are thresholds that allow the minimum and maximum duty cycle to be used for a range of 'HSFC levels', and that allows a transition region to be defined where the switch from short to long duty cycles takes place, a is a parameter for adjusting the slope of this transition. The duty cycle modulator 43 calculates the duty cycle I1 based on the drive value D1 : Duty Cycle = ty^ = b(l - Dι) , (7)
wherein b is an accordingly selected parameter.
Note that the limiting function instance 42 can also be seen as part of the spatial high pass-filter 40, or as part of the duty cycle modulator 43; this does not influence the overall functionality.
The luminance control instance 44 adjusts the input video signal in response to the adjusted duty cycle such that the instantaneous light output of the display segment associated with the local area pt , for which the duty cycle is currently adjusted, results in the correct luminance. This may be necessary in case the duty cycle control of the display itself does not correct for luminance, or in case of an OLED display (or other emissive displays), where the intensity is directly determined by the video (drive values) and not also by a backlight. In the most flexible form, the duty cycle is varied continuously between a minimum (e.g. 20%), and a maximum (likely 100%), depending on the image characteristics. In some cases, a limited set of duty cycles to choose from can be used. However, with a display that allows the duty cycle to be varied per pixel (an OLED can in principle do this), it is not advisable to actually create large differences between the duty cycles of neighboring pixels. This will cause inconsistencies in the spatio-temporal light emission pattern, that can cause unwanted effects depending on the eye tracking of the viewer.
The modulation of the duty cycle is not the only way to influence the motion blur - lifetime (and flicker) trade-off. Any other method can also be used to modulate the temporal light emission, for example the addition of a bias to the DC value. This gives more or less the same trade-off as with a varying duty cycle (both regarding flicker and lifetime), and therefore the present invention also works with this type of duty cycle modulation (the bias method can also be seen as a form of duty cycle modulation, by creating a mixture of two duty cycles, 100% and e.g. 30%, resulting in an effective duty cycle somewhere in between).
As already discussed for the first embodiment of the present invention, adjusting the display time tt I the duty cycle only in dependence on the determined amount of HSFC may lead to a reduction of the duty cycle even in cases when no actual motion blur is to be combated (case No. 3 in Table 1). Thus according to a second embodiment of the present invention, the amount of temporal differences in the local areas pt is additionally determined and considered in the adjustment of the display time /, / duty cycle. This may for instance be accomplished by adding a frame memory to the first embodiment 4 of Fig. 4. Now besides spatial frequency characteristics, temporal image characteristics can be determined, which represent a coarse indication of motion. In the simplest form, the determination of said temporal differences may be embodied as a temporal high-pass, which gives per pixel of a local area pt only the a value indicative of motion, but not of the direction of the motion.
Having such coarse information about motion in the image, the adjustment of the duty cycle can be influenced more reliably. In case of HSFC, but no motion in the image, the duty cycle can still be large without causing motion blur. Table 2 lists the possible cases where motion blur occurs. The second column indicates the test for HSFC, and the fourth column indicates test for a large amount of temporal differences.
From the eight listed cases, only in two cases a large amount of HSFC and a large amount of temporal differences is indicated (No. 1 and 4), and according to the second embodiment of the present invention, the duty cycle is only reduced in these two cases. This may for instance be implemented by introducing a threshold for the amount of temporal differences, and demanding that the duty cycle is only reduced due to a determined large amount of HFSC if the determined amount of temporal differences is above this threshold. This approach of the present invention correctly detects case No. 3 of Table 2, where motion blur actually occurs, and also correctly detects case No. 2, where no motion blur occurs , but does not correctly detect case No. 4, and causes a false alarm in case No. 1. However, case No. 4 describes a rare case, wherein the speed (amount of motion) is equal to the spatial frequencies of the image area, and case 1 describes a noisy image area, wherein any algorithm is most likely to fail.
Thus when compared to the first embodiment of the present invention, the addition of a simple estimation technique to determine the amount of temporal differences in local areas pt according to the second embodiment helps to avoid a reduction of the duty cycle in case No. 2 of Table 2 (corresponding to case 3 of Table 1) and otherwise, apart from rare or noisy cases, identifies the correct cases where a reduction of the duty cycle to combat motion blur is required. Thus the duty cycle is only reduced when it is actually required, which reduces flicker and increases the lifetime of the display device.
Figure imgf000017_0001
Table 2: Occurrences of motion blur (refined)
Fig. 5 depicts the basic set-up of the second embodiment 5 of the present invention. Therein, the input video signal is analyzed in a spatio-temporal image characteristics instance 50, where the local areas pt of images of said input video signal are for instance filtered in the spatial frequency and temporal frequency domain to determine the amount of HSFC and the amount of temporal differences, and, based on these results, a drive value D1 (corresponding to the local area /?,) for the duty cycle modulator 51 is determined. The duty cycle as determined by the duty cycle modulator 51 is then forwarded to the emissive or non-emissive non-stroboscopic display, and also to a luminance control instance 52, which adjusts the input video signal in response to the duty cycle such that the instantaneous light output of the display segment associated with the local area pt , for which the duty cycle is currently adjusted, results in the correct luminance.
The invention has been described above by means of preferred embodiments. It should be noted that there are alternative ways and variations which are obvious to a skilled person in the art and can be implemented without deviating from the scope and spirit of the appended claims.

Claims

CLAIMS:
1. A method for reducing motion blur of images shown on non-stroboscopic display devices, in which local areas pt of an image of a video signal are displayed during respective local display times I1 that are less than or equal to a image period T , comprising: determining (40) an amount X1 of high spatial frequency content related to a local area pt of said image of said video signal; and adjusting (41) a local display time /, in dependence on said determined amount X1 of high spatial frequency content, wherein said local display time I1 is decreased with increasing determined amount X1 of high spatial frequency content.
2. The method according to claim 1, wherein said adjusting (41) of said local display time tt depends on only one image-related characteristic of said video signal, and wherein said only one image-related characteristic of said video signal is said amount X1 of high spatial frequency content related to said local area pt of said image of said video signal.
3. The method according to claim 1, wherein said determining (40) of said amount X1 of high spatial frequency content related to said local area P1 of said image of said video signal comprises at least partially filtering said local area pt with a spatial frequency domain high-pass filter (40).
4. The method according to claim 3, wherein an output of said spatial frequency domain high-pass filter (40) is at least partially combined to obtain said amount X1 of high spatial frequency content related to said local area pt of said image of said video signal.
5. The method according to the claim 1, wherein said local display time I1 is set (42) to a maximum value if said amount X1 of high spatial frequency content is below a first threshold £, , and wherein said local display time I1 is set (42) to a minimum value if said amount X1 of high spatial frequency content is above a second threshold k2 .
6. The method according to claim 5, wherein said local display time I1 decreases from said maximum value to said minimum value when said amount X1 of high spatial frequency content increases from said first threshold kx to said second threshold k2 .
7. The method according to claim 6, wherein said local display time decreases linearly from said maximum value to said minimum value.
8. The method according to claim 1, further comprising: adjusting (44) the light intensity, with which said local area pt of said image of said video signal is displayed on said non-stroboscopic display, in dependence on said adjusted local display time tt .
9. The method according to claim 1, wherein said local display time stems from a limited set of discrete local display times.
10. The method according to claim 1 , wherein said determining of said amount X1 of high spatial frequency content related to said local area p, of said image of said video signal is based on a area of said image of said video signal that is larger than said local area P, -
1 1. The method according to claim 1 , further comprising: - determining (50) an amount of temporal differences in said local area pt of said image of said video signal, wherein said local display time t, is only decreased with increasing determined amount X1 of high spatial frequency content in dependence on said determined amount of temporal differences.
12. A computer program with instructions operable to cause a processor to perform the method steps of claim 1.
13. A computer program product comprising a computer program with instructions operable to cause a processor to perform the method steps of claim 1.
14. A device (4) for reducing motion blur of images shown on non-stroboscopic display devices, in which local areas pt of an image of a video signal are displayed during respective local display times tt that arc less than or equal to a image period T , comprising: - means (40) arranged for determining an amount X1 of high spatial frequency content related to a local area pt of said image of said video signal; and means (41) arranged for adjusting a local display time I1 in dependence on said determined amount X1 of high spatial frequency content, wherein said local display time Z1 is decreased with increasing determined amount X1 of high spatial frequency content.
15. The device according to claim 14, further comprising: means (44) arranged for adjusting the light intensity, with which said local area pt of said image of said video signal is displayed on said non-stroboscopic display, in dependence on said adjusted local display time /; .
16. The device according to claim 15, further comprising: means (50) arranged for determining an amount of temporal differences in said local area pt of said image of said video signal, wherein said local display time I1 is only decreased with increasing determined amount X1 of high spatial frequency content in dependence on said determined amount of temporal differences.
PCT/IB2005/053312 2004-10-13 2005-10-10 Display time control for moving images WO2006040722A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2007536311A JP2008516291A (en) 2004-10-13 2005-10-10 Image display time control
US11/576,911 US8063920B2 (en) 2004-10-13 2005-10-10 Display time control for images
EP05789487A EP1803112A2 (en) 2004-10-13 2005-10-10 Display time control for moving images

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP04105020.4 2004-10-13
EP04105020 2004-10-13

Publications (2)

Publication Number Publication Date
WO2006040722A2 true WO2006040722A2 (en) 2006-04-20
WO2006040722A3 WO2006040722A3 (en) 2006-06-22

Family

ID=35976532

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2005/053312 WO2006040722A2 (en) 2004-10-13 2005-10-10 Display time control for moving images

Country Status (6)

Country Link
US (1) US8063920B2 (en)
EP (1) EP1803112A2 (en)
JP (1) JP2008516291A (en)
KR (1) KR20070074618A (en)
CN (1) CN100504981C (en)
WO (1) WO2006040722A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2061020A2 (en) 2007-11-16 2009-05-20 Sony Corporation Display device, image signal processing method, and program

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060088461A (en) * 2005-02-01 2006-08-04 엘지전자 주식회사 Method and apparatus for deriving motion vectors of macro blocks from motion vectors of pictures of base layer when encoding/decoding video signal
CN101409043B (en) * 2007-10-09 2012-02-01 奇美电子股份有限公司 LCD device and image control method thereof
US20100149163A1 (en) * 2008-08-08 2010-06-17 Oqo, Inc. Use of spatial high-pass filtering of images to increase perceived brightness of emissive display
JP2010145664A (en) * 2008-12-17 2010-07-01 Sony Corp Self-emission type display device, semiconductor device, electronic device, and power supply line driving method
WO2010073341A1 (en) * 2008-12-25 2010-07-01 Necディスプレイソリューションズ株式会社 Video display device and method of correcting afterimage
JP4764487B2 (en) * 2009-03-02 2011-09-07 株式会社日立製作所 Video surveillance system
KR101476858B1 (en) * 2009-10-08 2014-12-26 엘지디스플레이 주식회사 liquid crystal display
KR101623595B1 (en) * 2009-12-17 2016-05-23 엘지디스플레이 주식회사 3d image display device
TWI422269B (en) * 2010-07-14 2014-01-01 Richtek Technology Corp Led controller with de-flicker function and led de-flicker circuit and method thereof
KR101289651B1 (en) * 2010-12-08 2013-07-25 엘지디스플레이 주식회사 Liquid crystal display and scanning back light driving method thereof
WO2012142478A1 (en) * 2011-04-15 2012-10-18 Prysm, Inc. Displays having built-in moiré reduction structures
JP6161262B2 (en) * 2012-11-19 2017-07-12 株式会社ミツトヨ LED lighting method and apparatus for image measuring machine
US9265458B2 (en) 2012-12-04 2016-02-23 Sync-Think, Inc. Application of smooth pursuit cognitive testing paradigms to clinical drug development
US9380976B2 (en) 2013-03-11 2016-07-05 Sync-Think, Inc. Optical neuroinformatics
US9230473B2 (en) * 2013-06-24 2016-01-05 Microsoft Technology Licensing, Llc Dual duty cycle OLED to enable dynamic control for reduced motion blur control with constant brightness in augmented reality experiences
US10657867B1 (en) * 2014-06-12 2020-05-19 Rockwell Collins, Inc. Image control system and method for translucent and non-translucent displays
JP7300985B2 (en) * 2017-04-17 2023-06-30 ソニーグループ株式会社 Information processing device and information processing method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0657860A2 (en) * 1993-12-10 1995-06-14 Philips Electronics Uk Limited Matrix video display systems and methods of operating such systems
US20020015104A1 (en) * 2000-06-23 2002-02-07 Kabushiki Kaisha Toshiba Image processing system and method, and image display system
WO2003101086A2 (en) * 2002-05-28 2003-12-04 Koninklijke Philips Electronics N.V. Motion blur decrease in varying duty cycle

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3064795B2 (en) * 1994-03-30 2000-07-12 日本電気株式会社 Back lighting device
US9167073B2 (en) * 1999-08-12 2015-10-20 Hewlett-Packard Development Company, L.P. Method and apparatus for accessing a contacts database and telephone services
US6516202B1 (en) * 1999-08-12 2003-02-04 Handspring, Inc. Mobile computer system designed for wireless communication expansion
JP2001235729A (en) * 2000-02-21 2001-08-31 Victor Co Of Japan Ltd Liquid crystal display device
US7106350B2 (en) * 2000-07-07 2006-09-12 Kabushiki Kaisha Toshiba Display method for liquid crystal display device
US6987530B2 (en) * 2001-05-29 2006-01-17 Hewlett-Packard Development Company, L.P. Method for reducing motion blur in a digital image
CA2469692C (en) * 2001-12-19 2012-04-17 Sanyo Electric Co., Ltd. Folding communication terminal apparatus
US7046262B2 (en) * 2003-03-31 2006-05-16 Sharp Laboratories Of America, Inc. System for displaying images on a display
US7295852B1 (en) * 2003-05-01 2007-11-13 Palm, Inc. Automated telephone conferencing method and system
JP4337673B2 (en) * 2004-07-21 2009-09-30 ソニー株式会社 Display device and method, recording medium, and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0657860A2 (en) * 1993-12-10 1995-06-14 Philips Electronics Uk Limited Matrix video display systems and methods of operating such systems
US20020015104A1 (en) * 2000-06-23 2002-02-07 Kabushiki Kaisha Toshiba Image processing system and method, and image display system
WO2003101086A2 (en) * 2002-05-28 2003-12-04 Koninklijke Philips Electronics N.V. Motion blur decrease in varying duty cycle

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2061020A2 (en) 2007-11-16 2009-05-20 Sony Corporation Display device, image signal processing method, and program
EP2061020A3 (en) * 2007-11-16 2010-03-24 Sony Corporation Display device, image signal processing method, and program
US8199171B2 (en) 2007-11-16 2012-06-12 Sony Corporation Display device, image signal processing method, and program

Also Published As

Publication number Publication date
WO2006040722A3 (en) 2006-06-22
CN101040307A (en) 2007-09-19
CN100504981C (en) 2009-06-24
JP2008516291A (en) 2008-05-15
KR20070074618A (en) 2007-07-12
US20080042953A1 (en) 2008-02-21
EP1803112A2 (en) 2007-07-04
US8063920B2 (en) 2011-11-22

Similar Documents

Publication Publication Date Title
US8063920B2 (en) Display time control for images
KR100985026B1 (en) Method for reducing motion blur, flicker and loss of brightness of images, non-stroboscopic display device
US8115728B2 (en) Image display device with reduced flickering and blur
US8648780B2 (en) Motion adaptive black data insertion
US7330172B2 (en) Image display device and image display method
KR101333680B1 (en) Display apparatus and method of adjusting brightness for the same
US6970148B2 (en) Image display method
KR100794412B1 (en) Image display device and method of displaying image
EP1927974B1 (en) Liquid crystal display with area adaptive backlight
US8624824B2 (en) Area adaptive backlight with reduced color crosstalk
CN109584796B (en) Display driving method and device of display panel and display device
US20100225574A1 (en) Image display device and image display method
JP5734580B2 (en) Pixel data correction method and display device for performing the same
MXPA06002982A (en) Display device and method, recording medium, and program.
JP3816505B2 (en) Video display device and video display method
KR101336870B1 (en) Method and apparatus to improve the visual perception of an image displayed on a screen
US20110063203A1 (en) Displaying Enhanced Video By Controlling Backlight
JP2008176111A (en) Image display device and image display method
JP4038204B2 (en) Video display device
WO2010020949A1 (en) Video processing with spatially-based backlight control
de Haan et al. Display time control for images.

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV LY MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2005789487

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2007536311

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 11576911

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 200580035033.9

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 1020077010659

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2005789487

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 2005789487

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 11576911

Country of ref document: US