Publication number | US20080309669 A1 |

Publication type | Application |

Application number | US 12/029,651 |

Publication date | Dec 18, 2008 |

Filing date | Feb 12, 2008 |

Priority date | Jun 18, 2007 |

Also published as | US8643645 |

Publication number | 029651, 12029651, US 2008/0309669 A1, US 2008/309669 A1, US 20080309669 A1, US 20080309669A1, US 2008309669 A1, US 2008309669A1, US-A1-20080309669, US-A1-2008309669, US2008/0309669A1, US2008/309669A1, US20080309669 A1, US20080309669A1, US2008309669 A1, US2008309669A1 |

Inventors | Yoon-sun Choi, Moon-gyu Lee, Byoung-Ho Lee, Joon-ku HAN, Yun-Hee Kim, Gil-bae PARK |

Original Assignee | Samsung Electronics Co., Ltd., Seoul National University Industry Foundation |

Export Citation | BiBTeX, EndNote, RefMan |

Patent Citations (1), Non-Patent Citations (3), Referenced by (4), Classifications (3), Legal Events (1) | |

External Links: USPTO, USPTO Assignment, Espacenet | |

US 20080309669 A1

Abstract

A method and apparatus for generating an elemental image by an integral image technique are provided. The method includes normalizing coordinates of dots in a frustum formed in perspective projection by mapping the dots in the frustum into a cube; reversing a grade of depth of the cube viewed from a particular viewpoint; and generating a two-dimensional (2D) elemental image necessary for three-dimensional (3D) display from dots in the cube whose grade of depth is reversed.

Claims(11)

normalizing coordinates of dots in a frustum formed in perspective projection by mapping the dots in the frustum into a cube;

reversing a grade of depth of the cube viewed from a particular viewpoint; and

generating a two-dimensional (2D) elemental image necessary for three-dimensional (3D) display from dots in the cube whose grade of depth is reversed.

the generating a 2D elemental image comprises generating a 2D elemental image necessary for 3D display from the dots rotated by 180°.

determining whether a lens by which an elemental image has not been generated exists among all lenses used in the perspective projection; and

if it is determined that a lens by which an elemental image has not been generated exists, acquiring coordinates of dots in the frustum for which an elemental image has not been generated, and returning to the normalizing coordinates of dots in a frustum formed in perspective projection.

a normalizer which normalizes coordinates of dots in a frustum formed in perspective projection by mapping the dots in the frustum into a cube;

a depth reversing unit which receives the dots mapped into the cube and reverses a grade of depth of the cube viewed from a particular viewpoint; and

an elemental image generator which generates a 2D elemental image necessary for 3D display from dots whose grade of depth is reversed by the depth reversing unit.

wherein the elemental image generator generates a 2D elemental image necessary for 3D display from the dots rotated by 180° by the rotating unit.

Description

- [0001]This application claims priority from Korean Patent Application No. 10-2007-0059519, filed on Jun. 18, 2007, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference.
- [0002]1. Field of the Invention
- [0003]Methods and apparatuses consistent with the present invention relate to generating an elemental image, and more particularly, to generating an elemental image used to display a three-dimensional (3D) image in Integral Photography (IP) or Integral Imaging.
- [0004]2. Description of the Related Art
- [0005]
FIG. 1 is a conceptual diagram of a three-dimensional (3D) image being displayed by using an elemental image in Integral photography (IP) according to the related art. - [0006]A related art apparatus for displaying a 3D image using an elemental image in IP includes an elemental image generator
**110**and a display unit**120**. The elemental image generator**110**includes a photographing device**111**and a lens array**112**. The display unit**120**includes a display device**121**and a lens array**122**. - [0007]The related art apparatus for displaying a 3D image using an elemental image in IP acquires elemental images of an apple
**130**using the elemental image generator**110**and displays the elemental images in the display unit**120**in order for a user**150**to view a 3D object**140**. An elemental image is a two-dimensional (2D) fundamental image which is located in the back of the lens array**122**as illustrated inFIG. 1 and allows a user to view a 3D object. The elemental image may be generated by using an actual camera and an actual lens array or by using computer graphics. - [0008]The elemental image generator
**110**generates and stores elemental images that are 2D images obtained by viewing the apple**130**from various directions. The lens array**112**forms the elemental images of the apple**130**using unit lenses composing the lens array**112**. The lens array**112**is achieved by two-dimensionally arranging a plurality of unit lenses. The photographing device**111**stores elemental images of an object, which are formed by the lens array**112**. - [0009]The display unit
**120**performs an inverse process of the process performed by the elemental image generator**110**. That is, the display unit**120**displays the elemental images generated by the elemental image generator**110**and reproduces a 3D image**140**using the displayed elemental images. The display device**121**displays the elemental images stored in the photographing device**111**. The lens array**122**generates the 3D image**140**by integrating the elemental images displayed by the display device**121**. The lens array**122**is achieved by two-dimensionally arranging a plurality of unit lenses. - [0010]The related art apparatus for displaying a 3D image using an elemental image in IP generates an elemental image by capturing an actual object using a camera or in a Computer-Generated Integral Photography (CGIP) method and displays the generated elemental image on a film or monitor. However, since an object generated by the elemental image generator
**110**is shown in an opposite direction of an object displayed by the display unit**120**, when the object is displayed, a pseudoscopic effect occurs. The pseudoscopic effect means that since capturing and reproduction are achieved in an opposite direction to each other, the depth of a reproduced 3D image is shown in reverse. Since depth information of an image captured by a camera is reversed compared to that of a three-dimensionally displayed image due to the pseudoscopic effect, when a user views the displayed image, a convex object is viewed as if concave, a concave object is viewed as if convex, and a closer object is viewed as if smaller than a farther object. A convex portion of the right part of the apple**130**, which is closer to the lens array**112**and captured through a side part of the lens array**112**, is farther from the lens array**112**. When images captured through the lens array**112**of the elemental image generator**110**are displayed through the lens array**122**of the display unit**120**, since an apple**140**as a displayed 3D image has only a partial image of a convex part of the right of the apple**130**, the apple**140**looks concave on one side thereof from a viewpoint of a person viewing from the other side of the lens array**122**. This phenomenon is a kind of pseudoscopic effect and is an inevitable phenomenon occurring due to a basic optical principle when a real image of an actual object in front of a lens array is formed on a film. - [0011]
FIG. 2 is a conceptual diagram for explaining perspective projection according to the related art. - [0012]In 3D computer graphics, perspective projection is used to two-dimensionally represent 3D data. The perspective projection is a method of displaying a frustum
**205**on a projection plane**202**at a larger size, as the frustum**205**viewed from a viewpoint**201**is closer to the viewpoint**201**. Thus, the size of an object closer to the viewpoint**201**and the size of an object farther from the viewpoint**201**are differently displayed on the projection plane**202**. In this case, a volume of an object to which the perspective projection is applied is called the frustum**205**, the closest plane from the viewpoint**201**to the frustum**205**is defined as a front-end plane**203**, and the farthest plane is defined as a rear-end plane**204**. - [0013]However, when a 3D image is displayed as a real image by using an elemental image obtained by the perspective projection, the pseudoscopic effect occurs, and even if the pseudoscopic effect is solved, it requires a large amount of time.
- [0014]Exemplary embodiments of the present invention address at least the above problems and/or disadvantages and other disadvantages not described above. Also, the present invention is not required to overcome the disadvantages described above, and an exemplary embodiment of the present invention may not overcome any of the problems described above.
- [0015]The present invention provides a method and apparatus for generating an elemental image, whereby a pseudoscopic effect, occurring when a three-dimensional (3D) image is displayed by an integral image technique, is solved and an elemental image necessary to display a 3D image can be generated at high speed.
- [0016]According to an aspect of the present invention, there is provided a method of generating an elemental image, the method comprising: normalizing coordinates of dots in a frustum formed in perspective projection by mapping the dots in the frustum into a cube; reversing a grade of depth of the cube viewed from a particular viewpoint; and generating a two-dimensional (2D) elemental image necessary for three-dimensional (3D) display from dots in the cube whose grade of depth is reversed.
- [0017]According to another aspect of the present invention, there is provided an apparatus for generating an elemental image, the apparatus comprising: a normalizer which normalizes coordinates of dots in a frustum formed in perspective projection by mapping the dots in the frustum into a cube; a depth reversing unit which receives the dots mapped into the cube and reverses a grade of depth of the cube viewed from a particular viewpoint; and an elemental image generator which generates a 2D elemental image necessary for 3D display from dots whose grade of depth is reversed by the depth reversing unit.
- [0018]The above and other aspects of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings in which:
- [0019]
FIG. 1 is a conceptual diagram of a three dimensional (3D) image being displayed by using an elemental image in integral photography (IP) according to the related art; - [0020]
FIG. 2 is a conceptual diagram for explaining perspective projection according to the related art; - [0021]
FIG. 3 is a flowchart of a method of generating an elemental image according to an exemplary embodiment of the present invention; - [0022]
FIG. 4 is a block diagram of an apparatus for generating an elemental image according to an exemplary embodiment of the present invention; - [0023]
FIG. 5 is a conceptual diagram of operations of normalizing coordinates of dots in a frustum and reversing a grade of depth of the normalized dots, of the method illustrated inFIG. 3 , according to an exemplary embodiment of the present invention; - [0024]
FIGS. 6A and 6B illustrate a comparison of related art perspective projection to the method of generating an elemental image according to an exemplary embodiment of the present invention; and - [0025]
FIGS. 7A and 7B illustrate coordinate information of dots, which are normalized and of which a grade of depth information is reversed, rotated by 180° based on an optical axis of each of a plurality of unit lenses, according to an exemplary embodiment of the present invention. - [0026]The present invention will be described in detail by explaining exemplary embodiments of the invention with reference to the attached drawings.
- [0027]
FIG. 3 is a flowchart of a method of generating an elemental image according to an exemplary embodiment of the present invention. - [0028]In operation
**310**, an apparatus for performing the method of generating an elemental image normalizes coordinates of dots in a frustum illustrated inFIG. 5 by mapping coordinate information of the dots in the frustum to coordinate information of dots in a cube. - [0029]The normalization is performed using Equation 1.
- [0000]
$\begin{array}{cc}\left(\begin{array}{c}{x}^{\prime}\\ {y}^{\prime}\\ {z}^{\prime}\\ {w}^{\prime}\end{array}\right)=\left(\begin{array}{cccc}\frac{f}{r}& 0& 0& 0\\ 0& \frac{f}{r}& 0& 0\\ 0& 0& 1& 0\\ 0& 0& 0& 1\end{array}\right)\ue89e\left(\begin{array}{c}x\\ y\\ z\\ w\end{array}\right)\ue89e\begin{array}{c}{x}^{\prime}=\frac{f}{r}\ue89ex\\ {y}^{\prime}=\frac{f}{r}\ue89ey\\ {z}^{\prime}=z\end{array}& \left(\mathrm{Equation}\ue89e\phantom{\rule{1.1em}{1.1ex}}\ue89e1\right)\end{array}$ - [0030]Here, referring to
FIG. 5 , −f denotes z-axis boundary coordinates of a rear-end plane of a frustum, r denotes x-axis boundary coordinates in the right of the rear-end plane of the frustum, and t denotes y-axis boundary coordinates in the top of the rear-end plane of the frustum. - [0031]In operation
**320**, the apparatus for performing the method of generating an elemental image reverses a grade of depth of the dots normalized into the cube in operation**310**. A method of reversing the grade of depth reverses a grade of depth of the cube viewed from a particular viewpoint. As a result of reversing the grade of depth, a grade of depth of a dot close to the viewpoint is exchanged with a grade of depth of a dot far from the viewpoint, and thus, dots close to the viewpoint look far, and dots far from the viewpoint look close. Depth information can be reversed using Equation 2. The grade of depth can be represented using x-axis coordinates by referring toFIG. 5 . - [0000]
$\begin{array}{cc}\left(\begin{array}{c}{x}^{\prime}\\ {y}^{\prime}\\ {z}^{\prime}\\ {w}^{\prime}\end{array}\right)=\left(\begin{array}{cccc}1& 0& 0& 0\\ 0& 1& 0& 0\\ 0& 0& \frac{f+n}{f-n}& \frac{2\ue89e\mathrm{fn}}{f-n}\\ 0& 0& -1& 0\end{array}\right)\ue89e\left(\begin{array}{c}x\\ y\\ z\\ w\end{array}\right)\ue89e\text{}\ue89e{z}^{\prime}=\frac{\begin{array}{c}{x}^{\prime}=\frac{x}{-z}\\ {y}^{\prime}=\frac{y}{-z}\\ \left(y\ue8a0\left(\frac{f+n}{f-n}\right)+x\ue8a0\left(\frac{2\ue89e\mathrm{fn}}{f-n}\right)\right)\end{array}}{-z}& \left(\mathrm{Equation}\ue89e\phantom{\rule{1.1em}{1.1ex}}\ue89e2\right)\end{array}$ - [0032]Here, referring to
FIG. 5 , −f denotes z-axis boundary coordinates of a rear-end plane of a frustum, and −n denotes z-axis boundary coordinates of a front-end plane of the frustum. Thus, after the coordinate information of the dots in the frustum is normalized, a matrix for reversing a grade of depth of the normalized dots can be obtained using Equation 3. - [0000]
$\begin{array}{cc}\begin{array}{c}{T}_{r}^{\prime}=\ue89eT\xb7S\\ =\ue89e\left(\begin{array}{cccc}1& 0& 0& 0\\ 0& 1& 0& 0\\ 0& 0& \frac{f+n}{f-n}& \frac{2\ue89e\mathrm{fn}}{f-n}\\ 0& 0& -1& 0\end{array}\right)\ue89e\left(\begin{array}{cccc}\frac{f}{r}& 0& 0& 0\\ 0& \frac{f}{r}& 0& 0\\ 0& 0& 1& 0\\ 0& 0& 0& 1\end{array}\right)\\ =\ue89e\left(\begin{array}{cccc}\frac{f}{r}& 0& 0& 0\\ 0& \frac{f}{r}& 0& 0\\ 0& 0& \frac{f+n}{f-n}& \frac{2\ue89e\mathrm{fn}}{f-n}\\ 0& 0& -1& 0\end{array}\right)\end{array}& \left(\mathrm{Equation}\ue89e\phantom{\rule{1.1em}{1.1ex}}\ue89e3\right)\end{array}$ - [0033]Here, T denotes a matrix for reversing a grade of depth, and S denotes a matrix for normalizing coordinate information of dots in a frustum. Thus, T
_{r }becomes a matrix for normalizing coordinate information of dots in a frustum and reversing a grade of depth of the normalized coordinate information. If coordinates of a dot P in a frustum are (x, y, z), the dot P is transformed to a dot P′ (x′, y′, z′) whose grade of depth is reversed by Equation 4. - [0000]
$\begin{array}{cc}\left(\begin{array}{c}{x}^{\prime}\\ {y}^{\prime}\\ {z}^{\prime}\\ {w}^{\prime}\end{array}\right)=\left(\begin{array}{cccc}\frac{f}{r}& 0& 0& 0\\ 0& \frac{f}{r}& 0& 0\\ 0& 0& \frac{f+n}{f-n}& \frac{2\ue89e\mathrm{fn}}{f-n}\\ 0& 0& -1& 0\end{array}\right)\ue89e\left(\begin{array}{c}x\\ y\\ z\\ w\end{array}\right)& \left(\mathrm{Equation}\ue89e\phantom{\rule{1.1em}{1.1ex}}\ue89e4\right)\end{array}$ - [0034]Here, referring to
FIG. 5 , −f denotes z-axis boundary coordinates of a rear-end plane of a frustum, −n denotes z-axis boundary coordinates of a front-end plane of the frustum, r denotes x-axis boundary coordinates in the right of the rear-end plane of the frustum, t denotes y-axis boundary coordinates in the top of the rear-end plane of the frustum, and w denotes a value for normalizing x, y, and z coordinates, and w′ denotes a value for normalizing x′, y′, and z′ coordinates. - [0035]In operation
**330**, the apparatus for performing the method of generating an elemental image rotates the dots in the cube whose grade of depth was reversed in operation**320**by 180° on an axis of the center of an image acquired from a unit lens constituting a lens array, by using Equation 5. If the dot P′ (x′, y′, z′) transformed in operation**320**is transformed by using Equation 5, a dot P″ (x″, y″, z″) rotated by 180° on the axis is obtained. The axis matches an optical axis of the unit lens. - [0000]
$\begin{array}{cc}{x}^{\u2033}=-{x}^{\prime},{y}^{\u2033}=-{y}^{\prime},{z}^{\u2033}={z}^{\prime}\ue89e\text{}\ue89e\begin{array}{c}\left(\begin{array}{c}{x}^{\u2033}\\ {y}^{\u2033}\\ {z}^{\u2033}\\ {w}^{\u2033}\end{array}\right)=\ue89e\left(\begin{array}{cccc}-1& 0& 0& 0\\ 0& -1& 0& 0\\ 0& 0& 1& 0\\ 0& 0& 0& 1\end{array}\right)\ue89e\left(\begin{array}{c}{x}^{\prime}\\ {y}^{\prime}\\ {z}^{\prime}\\ {w}^{\prime}\end{array}\right)\\ =\ue89e\left(\begin{array}{cccc}-1& 0& 0& 0\\ 0& -1& 0& 0\\ 0& 0& 1& 0\\ 0& 0& 0& 1\end{array}\right)\ue89e\left(\begin{array}{cccc}\frac{f}{r}& 0& 0& 0\\ 0& \frac{f}{r}& 0& 0\\ 0& 0& \frac{f+n}{f-n}& \frac{2\ue89e\mathrm{fn}}{f-n}\\ 0& 0& -1& 0\end{array}\right)\ue89e\left(\begin{array}{c}x\\ y\\ z\\ w\end{array}\right)\\ =\ue89e\left(\begin{array}{cccc}-\frac{f}{r}& 0& 0& 0\\ 0& -\frac{f}{r}& 0& 0\\ 0& 0& \frac{f+n}{f-n}& \frac{2\ue89e\mathrm{fn}}{f-n}\\ 0& 0& -1& 0\end{array}\right)\ue89e\left(\begin{array}{c}x\\ y\\ z\\ w\end{array}\right)\end{array}& \left(\mathrm{Equation}\ue89e\phantom{\rule{1.1em}{1.1ex}}\ue89e5\right)\end{array}$ - [0036]In operation
**340**, the apparatus for performing the method of generating an elemental image generates a two-dimensional (2D) elemental image necessary for three-dimensional (3D) display from the dots rotated by 180° in operation**330**. In operation**340**, viewport transformation for transforming the generated elemental image to a desired size of a screen can be further performed. The generated single elemental image corresponds to a portion among elemental images corresponding to unit lenses constituting a lens array. - [0037]In operation
**350**, the apparatus for performing the method of generating an elemental image determines whether elemental images for 3D display in terms of all unit lenses constituting the lens array have been generated. As a result of the determination, if a unit lens of which a corresponding elemental image has not been generated exists, the process proceeds to operation**360**, or if a unit lens of which a corresponding elemental image has not been generated does not exist, the process ends. - [0038]In operation
**360**, the apparatus for performing the method of generating an elemental image acquires coordinate information of dots in a frustum from the unit lens of which a corresponding elemental image has not been generated. - [0039]Meanwhile, when a 3D image is displayed, a different method of generating an elemental image must be used according to whether a real image or a virtual image is displayed. When an elemental image used to display a real image is generated using related art perspective projection, a 3D image whose depth is reversed is displayed, and thus, when the real image is displayed, the method of generating an elemental image according to an exemplary embodiment of the present invention may be used. A real image is an image displayed in front of a display unit when a 3D object is displayed.
- [0040]
FIG. 4 is a block diagram of an apparatus for generating an elemental image according to an exemplary embodiment of the present invention. - [0041]Referring to
FIG. 4 , the apparatus for generating an elemental image according to the current exemplary embodiment includes a normalizer**410**, a depth reversing unit**420**, a rotating unit**430**, and an elemental image generator**440**. - [0042]The normalizer
**410**normalizes coordinates of dots in a frustum formed in perspective projection by mapping the dots in the frustum into a cube and outputs coordinate information of dots in the cube to the depth reversing unit**420**. - [0043]The depth reversing unit
**420**receives the coordinate information of dots in the cube and reverses a grade of depth of the cube as viewed from a particular viewpoint. In order to reverse the depth, by transforming a grade of depth located in the front of the cube to depth information of a dot located in the back of the cube, the grade of depth of the dots in the cube can be reversed. As a result of reversing the grade of depth, a grade of depth of a dot close to the viewpoint is exchanged with a grade of depth of a dot far from the viewpoint, and thus, dots close to the viewpoint appear far, and dots far from the viewpoint appear close. - [0044]The rotating unit
**430**receives from the depth reversing unit**420**coordinate information of dots in the cube whose grade of depth has been reversed and rotates the received coordinate information by 180° on an axis of the center of an image acquired from a unit lens constituting a lens array used in perspective projection. The axis matches an optical axis of the unit lens. - [0045]The elemental image generator
**440**receives coordinate information of dots in the cube rotated by 180° from the rotating unit**430**and generates a 2D elemental image from the received coordinate information. The elemental image generator**440**may also perform viewport transformation for transforming the generated elemental image into image displayed on a specified size of a screen. A single elemental image generated by performing the viewport transformation may constitute a portion of elemental images corresponding to unit lenses forming the lens array. - [0046]
FIG. 5 is a conceptual diagram of operations**310**and**320**of the method illustrated inFIG. 3 , according to an exemplary embodiment of the present invention. - [0047]The transformation illustrated in
FIG. 5 can be performed by using Equation 4. Referring to Equation 4, the matrix T_{r }moves a dot P having 3D coordinates (x, y, z) to a dot P′ (x′, y′, z′). In this case, the calculation is performed by - [0000]
${x}^{\prime}=-\frac{\mathrm{fx}}{\mathrm{rz}},{y}^{\prime}=-\frac{\mathrm{fy}}{\mathrm{tz}},{z}^{\prime}=-\frac{f+n}{f-n}-\frac{2\ue89e\mathrm{fn}}{z\ue8a0\left(f-n\right)}.$ - [0048]Referring to
FIG. 5 , the matrix T_{r }transforms each apex of a frustum to each apex of a cube of which the length of one side is 2 and an origin is the center. The difference compared to the related art perspective projection is that depth is reversed by transforming dots close to a viewpoint to dots far from the viewpoint. Position information of an object normalized as in a cube in the right side of the drawing illustrated inFIG. 5 can be obtained by generating a 2D elemental image in a specific display area in a direction looking from a plane of which z=1 to a plane of which z=−1. - [0049]
FIGS. 6A and 6B illustrate a comparison of related art perspective projection to the method of generating an elemental image according to an exemplary embodiment of the present invention. The method of generating an elemental image according to an exemplary embodiment of the present invention is called reverse projection. Reverse projection is a method of normalizing coordinate information of dots in a frustum and reversing a grade of depth of the dots. Unlike the perspective projection, in reverse projection, as a frustum viewed from a viewpoint is closer to the viewpoint, the frustum appears smaller on a projection plane. Referring toFIG. 3 , operations**310**and**320**correspond to the reverse projection. - [0050]
FIG. 6A illustrates the related art perspective projection. If the perspective projection**613**is used, a frustum**611**viewed from a viewpoint**612**appears larger as it is closer to the viewpoint**612**as shown from a viewpoint**614**to which the perspective projection**613**is applied. - [0051]
FIG. 6B illustrates reverse projection that is the method of generating an elemental image according to an exemplary embodiment of the present invention. If the reverse projection**623**is used, a frustum**621**viewed from a viewpoint**622**appears smaller as it is closer to the viewpoint**622**as shown from a viewpoint**624**to which the perspective projection**623**is applied. By using the reverse projection**623**, the frustum**621**before the perspective projection**623**is applied is displayed by oppositely applying depth information of the front and the back to the frustum**621**. That is, an elemental image is displayed in such a manner that dots close to the viewpoint**622**look far and dots far from the viewpoint**622**look close. However, when the elemental image whose depth information has been reversed is three-dimensionally displayed through an actual lens array, the pseudoscopic effect disappears. - [0052]
FIGS. 7A and 7B illustrate coordinate information of dots, which are normalized and of which a grade of depth information is reversed, rotated by 180° based on an optical axis of each of a plurality of unit lenses, according to an exemplary embodiment of the present invention. Referring toFIG. 3 ,FIG. 7A illustrates elemental images after operation**320**is performed, andFIG. 7B illustrates elemental images after operation**330**is performed. The elemental images are acquired from a lens array constituted of a plurality of unit lenses, and an optical axis of each unit lens matches a center axis of an elemental image acquired from the unit lens. - [0053]The method and apparatus for generating an elemental image according to an exemplary embodiment of the present invention can be used when an elemental image is generated using a Personal Computer (PC), and by simply performing the method of generating an elemental image according to an exemplary embodiment of the present invention using matrix calculation, the pseudoscopic effect can be prevented, and an elemental image of a real image can be simultaneously generated at high speed. In addition, since the method of generating an elemental image according to an exemplary embodiment of the present invention is used when an elemental image necessary to display 3D object information as a 3D image is generated, the method can be used as part of a transforming process for displaying existing content as a 3D image. The method of generating an elemental image according to an exemplary embodiment of the present invention can be used by being implemented in a single software module in terms of general application software, a logic module of a Field Programmable Gate Array (FPGA) in terms of hardware, or a hardware signal processing module in a Graphic Processing Unit (GPU). In addition, the method and apparatus for generating an elemental image according to an exemplary embodiment of the present invention can be applied to an integral image technique and other 3D display systems.
- [0054]As described above, according to the present invention, by reversing the depth of an elemental image used when a 3D image is displayed using an integral image technique, a 3D image viewed by a user when the 3D image is displayed can look like an actual object without a pseudoscopic effect. In addition, by performing normalization of a frustum and reversing the depth of the normalized frustum through matrix calculation, an elemental image for 3D display without the pseudoscopic effect can be generated at high speed.
- [0055]While this invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. The exemplary embodiments should be considered in a descriptive sense only and not for purposes of limitation. Therefore, the scope of the invention is defined not by the detailed description of the invention but by the appended claims, and all differences within the scope will be construed as being included in the present invention.

Patent Citations

Cited Patent | Filing date | Publication date | Applicant | Title |
---|---|---|---|---|

US3671122 * | Oct 2, 1970 | Jun 20, 1972 | Dudley Optical Lab Inc | Methods of printing stereoscopic integral photograph from pseudoscopic original |

Non-Patent Citations

Reference | ||
---|---|---|

1 | * | Foley et al., Computer Graphics: Principles and Practice, July 1997, Addison-Wesley, 2nd Edition, pages 229, 268, and 278 |

2 | * | Gilbae Park, Seong-Woo Cho, Joohwan Kim, Yunhee Kim, Heejin Choi, Joonku Hahn, Byoungho Lee, "Pickup Method from OpenGL by Reverse Projection Matrix for Real-Orthoscopic Integral Imaging", June 18, 2007, Digital Holography and Three-Dimensional Imaging |

3 | * | Shin et al., "Three-Dimensional Integral Imaging For Orthoscopic Real Image Reconstruction", February 28, 2005, Proc. SPIE 5636, Holography, Diffractive Optics, and Applications II, 379 - 385 |

Referenced by

Citing Patent | Filing date | Publication date | Applicant | Title |
---|---|---|---|---|

US8169433 * | Jul 18, 2008 | May 1, 2012 | Fujitsu Limited | Apparatus and method for three-dimensional model retrieval |

US9047680 * | Jun 8, 2010 | Jun 2, 2015 | Sony Corporation | Information processing apparatus, information processing method, and data structure of content files |

US20090040225 * | Jul 18, 2008 | Feb 12, 2009 | Fujitsu Limited | Apparatus and method for three-dimensional model retrieval |

US20120206491 * | Jun 8, 2010 | Aug 16, 2012 | Sony Computer Entertainment Inc. | Information processing apparatus, information processing method, and data structure of content files |

Classifications

U.S. Classification | 345/427 |

International Classification | G06T15/20 |

Cooperative Classification | G06T15/10 |

Legal Events

Date | Code | Event | Description |
---|---|---|---|

Feb 12, 2008 | AS | Assignment | Owner name: SAMSUNG ELECTRONICS CO., LTD.,, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHOI, YOON-SUN;LEE, MOON-GYU;LEE, BYOUNG-HO;AND OTHERS;REEL/FRAME:020496/0412 Effective date: 20080131 Owner name: SEOUL NATIONAL UNIVERSITY INDUSTRY FOUNDATION, KOR Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHOI, YOON-SUN;LEE, MOON-GYU;LEE, BYOUNG-HO;AND OTHERS;REEL/FRAME:020496/0412 Effective date: 20080131 |

Rotate