|Publication number||USRE35029 E|
|Application number||US 08/237,591|
|Publication date||Aug 29, 1995|
|Filing date||May 3, 1994|
|Priority date||Jan 13, 1989|
|Also published as||US5113213, WO1990008343A1|
|Publication number||08237591, 237591, US RE35029 E, US RE35029E, US-E-RE35029, USRE35029 E, USRE35029E|
|Inventors||Ellen R. Sandor, Daniel J. Sandin, William T. Cunnally, Stephan B. Meyers|
|Original Assignee||The Phscologram Venture, Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (49), Non-Patent Citations (22), Referenced by (32), Classifications (27), Legal Events (1)|
|External Links: USPTO, USPTO Assignment, Espacenet|
The present invention relates to three-dimensional imaging and more particularly to autostereoscopic imaging.
Three-dimensional (3D) imaging relies on the human ability to receive two dissimilar images of the same object simultaneously and thus perceive depth. The image projections for stereo or binocular viewing have not changed since Euclid's description in 280 A.D.; however, technologic and photographic advances have made it easier to produce the two images that stimulate the eye's binocular parallax and convergence cues. The power and flexibility of computer graphic tools and techniques facilitates the creation of stereoscopic images.
The stereoscope was developed in the 1800's by Niepce, Wheatstone, Brewster and Holmes, but major achievements in and public awareness of 3D imaging did not occur until the 1900's. Stereocameras that produced binocular picture information were developed, some of which are still available today, and related technologies evolved from Kennedy, Kanolt, Lippmann and Ives. The technologies explored were the parallax barrier, chromolinoscope, panoramagram, and integral fly's-eye and lenticular photography. By the mid 1900's anoglyphic and polarized 3D movies had been developed. Cinerama and holography retained public interest, with work being done throughout the world in autostereographic television and lenticular-sheet 3D pictures. Advancements to lenticular-sheet imaging were made by scientists Vanbenschoeten, Bonnet and Winnek, and by industries, including Eastman Kodak and Japan's Toppan and Dai-Nippon printing companies.
One form of stereography, based on parallax barriers, is carried out in the chromolinoscope and panoramagram that are described in U.S. Pat. Nos. 666,424 and 725,567, and in H. E. Ives, "The Chromolinoscope Revived," J. Oct. Soc. Amer. 20, pp. 343-353 (June 1930) and H. E. Ives, "A Camera for Making Parallax Panoramagrams," J. Opt. Soc. Amer. 17, pp. 435-439 (Dec. 1928). Other forms of stereography are described in B. Jequier, "Some Simple Means of Realizing 3D Images with Standard Material in Diverse Fields of Medicine, Industry and Research," Proceedings of the SPIE No. 402/37, Geneva (1983), S. H. Kaplan, "Theory of Parallax Barriers," J.SMPTE 59, No. 7, pp. 11-21 (July 1952), and T. Okoshi, Three-Dimensional Imaging Techniques, Academic Press, New York (1976).
As illustrated in FIG. 1, the parallax barrier or barrier strip method cuts a predetermined number of different views of an object into vertical columns (oriented perpendicular to the plane of the Figure), interleaves the columns on a film or transparency 11, and positions them behind the slits of a barrier strip or line screen 12 that is fixed at a predetermined position with respect to the film 11, for example by a transparent spacer 13. Strips 11-1 thru 11-5 of five different 2D or planar views are interleaved in FIG. 1. The position of the eye 14 determines what view the observer sees, five eye positions 14-1 thru 14-5 being shown, and in this way a truly spatial image, i.e., one which gradually shows its right side when the observer moves leftward and its left side when the observer moves rightward, can be perceived. Such a spatial image is sometimes called an autostereogram when more than two different views of the object are interleaved to distinguish it from a binocular or stereoscopic image.
Many 3D photographers today use Bonnet-style cameras which include barrier strips. In these devices it is the camera which interleaves or combines the several views. In a one-step dedicated process, they photograph a scene, and the barrier strip is immediately imposed on the film during processing in the camera. The images produced have a predetermined spatial frequency (also referred to as pitch, in lines per inch) and can only be magnified proportionally. As a result, images that are reduced or magnified may appear too fine or too coarse. Using a two-step combining process expands the photographer's flexibility to magnify or crop images. For example, a Jequier-type projection system uses a given number of different negatives of an object scene, previously photographed on negative film from that number of different positions. Each negative is inserted, in sequence, in a movable stage that slides left and right; the recording film and barrier strip move accordingly. The system thus splits an image into vertical columns, interleaves them and records them on film.
Another camera-combining process is the Cunnally projection system which uses a movable barrier strip with the rest of the system remaining stationary. The barrier strip moves 1/n-th the distance between barrier strip lines for each of the n slides to be interleaved. The film recording the interleaved images is placed on a vacuum-backed table; the barrier strip is mounted in a frame which is attached to the table with spring-loaded pins. A micrometer is used to control the movement of the barrier strip with a precision up to 1/000-th of an inch.
Yet another image combining process in which a camera combines the images is the Illusion projection system which photographs n different scenes off a CRT screen. The lens and the CRT monitor move n proportional distances left and right; the film and barrier strip remain fixed. This process splits each image into vertical columns, interleaves them, and records them on film.
Other camera-based methods and apparatus for making 3D images are disclosed in U.S. Pat. Nos. 1,600,297; 4,596,458; 4,557,954; 4,481,050; 4,158,501 and 1,260,682, and in R. P. Guzik, "Current Technology in 3-D Electronic Displays," Electronic Imaging '88, Anaheim, Calif. (Mar. 30, 1988), A. Ortony, "A System for Stereo Viewing," The Computer Journal vol. 14, no. 2, pp. 140-144 (May 1971).
The inaccuracies and inflexibilities associated with the camera-combining techniques have, however, been a constant source of problems. Cameras are subject to geometric changes with temperature and humidity, exposure problems and color balance problems. The process itself is expensive and slow because of many processing steps, requires a large physical facility for camera, darkroom, and so on, and depends upon outside assistance for photoprocessing. Furthermore, camera-combining autostereography equipment is generally not very portable, and requires image subjects to be brought to a studio and to be motionless for long periods because of the large formats and small lens apertures they require. Because much of the imaging effort involved is already computer-based, using a computer to do the combining, thereby eliminating the photographic process altogether, has important advantages for stereography.
In accordance with the present invention, a method of making autostereographic images of an object, comprises the steps of inputting to a computer a predetermined number of planar images of the object, each of the planar images being a view of the object from one of the predetermined number of different viewpoints; interleaving the predetermined number of planar images in the computer; and
printing the interleaved images with a high-resolution output imaging device on a spacer, a selected edge of each interleaved image being aligned with a predetermined direction on the spacer.
In another aspect of the present invention, an apparatus for making autostereographic images of an object, comprises means for generating a predetermined number of planar images of the object, each planar image being a view of the object from one of the predetermined number of different viewpoints; a computer, the computer interleaving the predetermined number of planar images; and a high-resolution output imaging device, the output imaging device being in communication with the computer, for printing the interleaved images on a transparent spacer with selected edges of the images being aligned with a predetermined direction.
In another aspect of the present invention, an autostereograph, comprises a transparent spacer; a predetermined number of planar images, the planar images being views of an object from the predetermined number of different viewpoints and being interleaved in strips and printed on a side of the spacer; and means for viewing predetermined ones of the strips according to an observation position, the viewing means being disposed on the opposite side of the spacer.
The several features and advantages of the present invention will be better understood from a reading of the following detailed description in conjunction with the drawings in which:
FIG. 1 illustrates the geometry of barrier-strip 3D imaging;
FIG. 2 illustrates off-axis projection geometry for computer-combining barrier-strip autostereography;
FIGS. 3a and 3b illustrate projection geometries for planar image points in computer-combining and camera-combining barrier-strip autostereography;
FIG. 4 shows an apparatus in accordance with the present invention;
FIG. 5 shows an autostereograph in accordance with the present invention; and
FIG. 6 shows a dot output by a preferred output device.
Since the camera-combining process interleaves columns of different 2D or planar views or images, it has been found advantageous to generate barrier-strip autostereographs by using a computer to sort the different planar images and record them directly to film. In this way, the problems attendant to the camera-combining method are eliminated. Interleaving the planar images with a computer greatly increases the versatility of 3D imaging because the planar images may be obtained in any manner that can subsequently produce data manipulable by computer. Such planar images may be frames of real-time or recorded television, positive or negative transparencies or prints, or even the electronic data outputs of commercial compute graphics software.
Such a computer graphics environment that can be used to produce the planar images for autostereography would typically create graphical representations of mathematical equations. Once a graphical model, i.e., a simulated object which exists only in the computer, is developed, the model is rendered, i.e., color, lighting, textures, and so on are mathematically added, and an appropriate viewing angle and depth information are determined by observing the model on a CRT. To determine the viewing angle, the scene is rotated and observed on a CRT monitor until an angle is found that is aesthetically pleasing; then the resulting image is stored for subsequent processing. Ordinarily, that image would be the one the observer would see when standing directly in front of an autostereograph, i.e., it would be the center image of the interleaved images.
To give the illusion of depth, an off-axis perspective projection of the image, both left and right about a selected center of depth, is then mathematically determined, and the different offset images are stored in image data files in the computer. The center of depth is a point or detail of the object that is perceived as being on the image plane. Other object points and objects will then be perceived as being behind or before the center of depth, the selection of which is a matter of aesthetic choice. It will be understood that the degree of off-axis projection determines the amount of depth an observer sees when viewing the output.
The off-axis projection is developed as follow's. Referring to FIG. 1, if a point of the image is to be viewed at position (x,y,z) in front of the autostereograph, a position (x', y', z') on the film 11 that will make that projection must be determined. In the Figure, the x-axis is parallel to the film 11 and in the plane of the Figure, the y-axis is also parallel to the film 11 but perpendicular to the Figure, and the z-axis is perpendicular to the film 11 and in the plane of the Figure.
First, a shear of z by x by a factor of D/T, where T is the thickness of the spacer 13 and D is the distance between the film position x' and the appropriate slit in the barrier strip 11, is done, thus:
Shear operations are well-known but not used often in imaging processing, being one of the four transformations (translation, rotation, scaling and shear) that are usually applied to image data. It will be understood that by the phrase, "appropriate slit" is meant that slit through which the position (x', y', z') in the interleaved images will be seen by the observer at x, y, z. This equation is similar to the projection needed for camera-combining computer-generated images, except that no perspective projection factors are included because the barrier strip itself does a perspective projection for the viewer at viewing distance VD in the horizontal (x) direction. In the vertical (y) direction, a standard perspective projection from viewing distance VD normal to the film 11 is performed: ##EQU1## and finally:
It will be understood that the number of computations for combining n different images of an object into a single autostereograph are dependent on the size, i.e., the height and width, of the output film 11, the image resolution of the output device, e.g., in dots per inch, and the number n of planar images to be interleaved. Once properly projected, the data representing the planar images are easily sorted by the computer and written to an output device, with image 1, strip 1 being placed next to image 2, strip 1, followed by image 3, strip 1, etc. on film 11 as illustrated in FIG. 1.
It will be understood that images of simulated objects from computer graphics environments can also be used in camera-combining methods of autostereography by displaying each image, one by one, on a CRT that is then photographed. However, an additional perspective projection must be added to the off-axis projection described above.
In accordance with the present invention, the barrier strip may also be written by the computer to the output device in a similar way. The barrier strip, which is similar to a Ronchi grating, typically comprises 1 or 2 clear strips followed by n-1 or n-2, respectively, black or blocking strips, followed by 1 or 2 clear strips, etc. Ordinarily, the duty cycle of the barrier strip 12, i.e., the ratio of its transparent to blocking sections, is approximately 1/n or 2/n and the distance of the strip 12 from the film 11, i.e., the thickness of spacer 13, is partially set, together with the width of the slits, by well-known diffraction considerations. Pitches of 40 and 60 lines per inch are commonly used for barrier strip autostereographs. Selecting the duty cycle of the barrier strip involves a subjective tradeoff; lower duty cycle, blacker barrier strips generally produce sharper 3D images at the expense of reduced image brightness, while higher duty cycle strips produce brighter 3D images with less perceived jumpiness or stepping of the image as the observer moves at the expense of reduced sharpness of the image objects perceived as being closer to the observer. By using the same imaging device and method to produce both the barrier strip and the interleaved images, problems in synchronization of the barrier strip and images are avoided, minimizing moire and ensuring a good fit between the barrier strip and the interleaved images.
Furthermore, autostereographs produced by the computer-combining method of the present invention include barrier strips that typically have the same pitch as the interleaved image strips. Referring to FIG. 3a, the sum, a, of the widths of one image strip from each of the predetermined number of planar images interleaved on film 11, that is also just the width of each planar image, is identical to the sum, a, of the widths of one clear slit and one blocking segment of the barrier strip 12. In contrast, autostereographs produced by camera-combining methods use barrier strips having pitches finer than the pitches of the planar images, as illustrated in FIG. 3b. It will be appreciated, however, that the present method and apparatus can also produce autostereographs having barrier strips that have pitches finer than those of the interleaved images, e.g., to compensate for film contraction during processing.
A preferred embodiment of the present invention is illustrated in FIG. 4 and uses a high-resolution output imaging device that may produce color separation transparencies comprising dot screens for large-scale, high-quality offset printing. In this way, barrier-strip autostereographs can be economically and rapidly mass produced.
Referring to FIG. 4, there is shown a block diagram of an apparatus 100 in accordance with the present invention. A suitable computer 102 accepts digital inputs from any or all of a keyboard, trackball or other manual input device 104, hard or floppy disks, tape or other memory 106, a video frame digitizer or other suitable device 108 for converting television or other video signals into digital information, and a suitable image scanner 110 for converting hardcopy, such as positive or negative film transparencies or prints or other images, into digital information for manipulation by the computer 102. It will be understood that any suitable means for inputting data into the computer 102 may be employed in the apparatus 100. For example, a suitable video digitizer is the model JORGA 32, manufactured by Truvision, Inc., Indiana, and a suitable image scanner is the model 6461E Analyzer Unit, manufactured by Crosfield Electronics, Inc., Glen Rock, N.J.
As already described, the computer 102, which may be a model VAX 780 made by Digital Equipment Corporation or another other suitable computer, manipulates the input data to produce an output corresponding to a predetermined number of suitably interleaved planar images and a barrier strip. The output of the computer 102 is then directed to a suitable high-resolution image printer 112 such as a model 6461E Expose Unit laser scanner also manufactured by Crosfield Electronics, Inc. The computer 102 may also output information to a suitable CRT monitor 114 that enables the interactive manipulation of data input to the computer 102.
The Crosfield scanner is particularly suited for a high-resolution output imaging device 112 in a preferred embodiment of the present invention because, while it is much like a conventional, high-quality, full-color laser printer, it generates pixels having no visible steps with high resolution and position precision. A laser in the scanner selectively exposes monochromatic lithographic film with a fixed resolution of 1,000 lines per inch. Nevertheless, the images in the output of the scanner, comprising four monochromatic positive film transparencies for each of cyan, magenta, yellow and black, can consist of square, round or elliptic dots of selectable resolution. For example, each pixel in an output selected to have round dots with 250 dots per inch resolution is generated by four passes of the laser. To help obviate any annoying moire interferences which might arise during the production of autostereographs by the present method, it has been found that use of the Crosfield scanner in its M1R8 and half-line mode, described in more detail below, is desirable. In the M1R8 mode, the scanner's resolution is approximately 403×300 dots per inch, horizontal by vertical, and in the half-line mode, each "dot" has the form of a line segment whose width is determined by the grey value of the "dot".
As an additional measure to avoid moire, the image and barrier strip, which have been described as vertically oriented strips and slits, are printed vertically by the scanner 112. In this way, the vertical laser scan lines of the scanner 112 are more accurately aligned with the long edges of the interleaved image strips and transparent portions of the barrier strip. Furthermore, those edges are purposefully aligned with the long direction of the yellow dot or line segment output of the scanner, and the barrier strip, although black, is printed by the scanner with its yellow output channel. In this way, any observed moire occurs in the yellow portion of the image that is less perceptible to a human observer;-therefore, the visual quality of the autostereograph is improved. The yellow dots may be said to define a preferred direction for autostereographic printing.
It will be appreciated that the above-described selective alignment of the interleaved images and barrier strip with the yellow dots of the output printer 112 has been described in terms of a Crosfield scanner for illustration. Such equipment is used by several commercial printers, such as I.P.P. Lithocolor, Inc., Chicago, Ill. Other types of output printers may be employed in an apparatus in accordance with the present invention. For example other printers may be internally arranged so that colors other than yellow define preferred directions that can be used in the manner described above to avoid moire. The selective alignment and the control of the dot directions enhances the visual quality of the autostereographs produced by the present method, and such other printers may also have preferred directions so as to benefit from suitable alignment of the images and barrier strip.
Autostereographs may be produced in accordance with the present invention using various high-resolution output imaging devices besides the full-color Crosfield scanner. Indeed, acceptable results are obtained using desk-top publishing equipment such as that compatible with the POSTSCRIPT computer language format. POSTSCRIPT is a registered trademark of Adobe Systems, Inc., Palo Alto, Calif., and one item of such compatible publishing equipment is the Linotronic L300 typesetter. The L300 typesetter is a monochrome laser printer which has a maximum resolution of 2540 dots per inch; autostereographs have been produced operating the typesetter at 1270 dots per inch and printing output on transparency material.
Images of real and simulated objects that are resident as data in computer 102 can be interleaved and combined with a POSTSCRIPT header that specifies how the data is to be processed, e.g., the size of the image, the number of pixels, etc. In order to produce output pixels having a range of grey values, a POSTSCRIFT program converts each image pixel to a 4×4 array of dots with the number of dots printed yielding the desired variation.
The registration accuracy of small-scale, lower resolution printing equipment such as the Linotronic L300 can permit the interleaved images to be printed on one side of a transparency material and the barrier strip, which is produced in the same way as the interleaved images, on the other side. Increased moire is typically shown by the monochromatic autostereographs produced on such equipment, however, because of the spatial sampling effects arising from the discontinuous (dot-matrix) formation of the output pixels.
Returning to FIG. 4, the four color separation transparencies of the interleaved images and the barrier strip transparency or other output of the output device 112 may then be used in conventional four-color offset printing equipment 116 or a proofing process 118 such as the CROMOLIN process from E.I. duPont. The output 120 of equipment 116 and the output 122 of process 118 are both autostereographs, however, the equipment 116 enables inexpensive mass production of full color 3D images because the manual operation of registering the barrier strip and the interleaved images can be eliminated. As illustrated in FIG. 5, conventional offset printing equipment can automatically print the interleaved images 11 on one side of a thin, e.g., 0.02 inch thick, transparent film 13 such as polyvinyl or mylar (in essence any material than can be run through the offset printer) and print the barrier strip 12 on the other side of the same film with a very high registration accuracy in a manner that is well known. Registration of the barrier strip 12 and images 11 involves the careful alignment of the long or vertical edges of the images with the long or vertical edges of the transparent portions of the barrier strip 12. Conventional proofing processes, such as the CROMOLIN process, produce interleaved planar images on a full-color transparency on diffusion material that would be manually laminated to a spacer and the barrier strip transparency from the printer 112, for example by use of a light box and a frame. Lighting panels for backlighting autostereographs are available from Ferro Marketing, Milwaukee, Wis.
The Crosfield scanner circumvents several problems that were found with most common computer output devices; notably, the latter do not have the necessary resolution and precision needed to produce high-quality autostereographs. The computer-combining method typically can project a few hundred or a few thousand image pixels per inch, needing output position accuracies between 0.0001 to 0.0001 of an inch that are currently at or beyond the limit of present inexpensive desk-top publishing equipment. The spatial quantization of the output image imposed by the limited pixels per inch provided by inexpensive computer output devices, i.e., fewer pixels printed than available from the computer, causes even more moire patterns (sampling errors) when the barrier strip and the film are aligned.
To produce an output image using a Crosfield scanner, a predetermined number, n, of different views of a subject are rendered and combined with the computer 102, and the image data files and corresponding barrier strip data file are written to a 9-track magnetic tape. The data on the tape is input to the Crosfield scanner. The data format used on the tape should be compatible, of course, with the Crosfield archiving procedure. Detailed information on the Crosfield Magnetic Tape Format (A 109) is available from Crosfield Electronics, Inc. In general, an image tape is recorded at 6250 bits per inch, Group Code Recording method, and is organized in four blocks of different length. The image block records such things as the tape number; the master directory keeps a record of all archives on the tape; the archive directory keeps a record of one image; the image data block contains the image pixel data.
It should be understood that it is possible to manipulate directly the scanner's line-screen dot generator, however, a large quantity of data is needed; therefore, it is somewhat more efficient that tapes are written in the scanner's standard format using standard procedures. The accuracy is good enough in this mode, but the spatial frequency of the dots generated by the scanner still has the potential to create moires from interference of the resulting barrier strip with the interleaved planar images; that is, the number of dots per inch in the output of the scanner is not necessarily coincident with the number of pixels per inch in the image and barrier strip data files. However, in producing barrier strip autostereographs, coincidence between two images (a barrier strip and an interleaved image) is just what is desired which is effectively a spatial sampling of the dot pattern in addition to the samplings done by the mere production of the interleaved image and the barrier strip. This has the potential of causing very disturbing moving dot and line patterns in the final 3D image.
Also, as described above, dots are laid down by the scanner at different angles and varying sizes for different colors, the intersections of which form a rosette pattern. It should be understood that the angles and spacing of the dots have been carefully chosen by the scanner manufacturers to minimize moires with one another..As illustrated in FIG. 6, a typical four color scanner such as the Crosfield device in its elliptic dot mode forms images comprising overlapping dots corresponding to yellow 30, magenta 32, cyan 34 and black 36. Although illustrated for clarity as being disposed at mutual angles of 45°, the angles between the magenta 32 and cyan 34 dots and the yellow dot 30 are actually 15°, and the black dot 36 is at an angle of 30° with respect to the magenta or cyan dots. In the half-line mode, the line segments are drawn at the same relative angles as the elliptic dots.
In accordance with the present invention, this moire problem is ameliorated (1) by using the half-line mode (instead of the dot generator) of the scanner and (2) by aligning The columns of images and the barrier strip parallel with the lines produced in a preferred direction, e.g., the yellow channel of a Crosfield scanner, of the high-resolution output imaging device 112. Half-line mode draws single lines of varying width at the same angle the dot generator puts dots; hence, sampling or quantizing occurs in only one dimension instead of two. Nevertheless, test autostereographs produced with the CROMOLIN proofing process and with an offset printer showed very little moire using transparencies produced by the Crosfield scanner in its elliptic dot mode.
As described above, the apparatus 100 illustrated in FIG. 4 produces barrier-strip autostereographs, each comprising a selectable number, n, of interleaved planar images and a barrier strip. Besides generating images in a computer graphics environment and their proper projections, the computer 102, can advantageously format the input image data. For example, when 13 planar images are interleaved to form an 11×14-inch (horizontal×vertical) autostereograph using the Crosfield output scanner in its M1R8 mode, each planar image should have a resolution of about 338 pixels×4200 pixels. In the M1R8 mode, the scanner produces transparencies having about 400 dots per inch resolution in a horizontal direction and about 300 dots per inch resolution in a vertical direction, Since electronic image frame buffers having resolutions of 1024×1280 pixels are readily commercially available, images in such a buffer are optimally formatted as 1050×338 pixels. The computer 102 would then quadruple the 1050-pixel horizontal and interchange the horizontal and vertical directions since it will be recalled that the vertical direction in the autostereograph is selected to be parallel to the scan direction, which is usually horizontal, of the output device 112. In this way, the image's pixels are replicated vertically with the resolution in that direction as large as possible. The resolutions just discussed are great enough so that pixel-pixel interpolation calculations, for example using a conventional interpolation on each image with computer 102, are not necessary.
The planar images can be produced by any suitable apparatus such as a video, movie or still camera moved in an "off-axis perspective project" motion. Such motion is equivalent to a "truck" in the motion picture industry and involves, in essence, aiming the camera at the center of the image subject to generate the central interleaved image, (e.g., the image producing strips 11-3 in FIG. 1), then moving the camera horizontally, i.e., left and right, without re-centering the image subject, to generate the other planar images to be interleaved. Once the planar images are captured and input to the computer 102 or other suitable image processing device, the images are easily registered by shifting their pixels such that a particular subject point common to each image is in the same place, e.g., the center, in the frame. This form of camera motion is needed to obtain proper optical perspective in the autostereograph. Although it may be easier to move the camera so as to keep it aimed at the center of the image subject, thus avoiding a need to do image registration in computer 102, such motion is a rotation of the subject that only approximates the planar images needed for true perspective in the autostereograph. The approximation can be quite acceptable, however it will be understood that the few-pixels difference between the perspective images and rotation images is often sufficient to give an observer a feeling that the autostereographic image is subtly "wrong".
When the input planar images are produced in a computer graphics environment, or otherwise mathematically generated, a mathematical shear operation, as described above, can be used. A shear of the images along the x-axis (horizontal in the autostereograph), including both the image objects and light sources, produces an autostereograph without unrealistic behavior of shadows or highlights.
Good 3D results have been obtained in a 13-strip autostereograph comprising a 1/4-inch thick plexiglass spacer and a barrier strip having a pitch of 403/13 lines per inch for an image subject positioned at a viewing distance of 500 arbitrary units from the camera or point of view and a horizontal camera motion of ±66 units from the center interleaved image position or viewpoint. Thus, 13 planar images of the subject were generated at horizontal positions of -66, -55, -44, -33, -22, -11, 0, 11, 22, 33, 44, 55 and 66 units. These values are dependent on the thickness of the spacer between the barrier and the film, the pitch of the barrier strip and the number of images interleaved. For example, the values are doubled for an autostereograph having a thickness of 1/8-inch and otherwise as just described. When mass producing autostereographs, it has been found desirable to use 9 interleaved images, a spacer of 0.02 inch thickness and a barrier strip having a 403/9 pitch. The viewpoints needed may of course be determined from the above-described off-axis projection calculations.
In general it has been found that the total horizontal motion of the camera or viewpoint should be approximately 1/3 of the viewing distance to the subject. It will be understood that the distance between frames or images will largely determine the amount of depth that will be perceived when viewing the autostereograph, and the spacing of separate viewpoints is to be adjusted for the optimum perception of depth. This could possibly be defined by the traditional variables used by the Polaroid Inter Occular Calculator, for example, for determining the parallax for shooting standard stereoscopic pictures with the additional consideration that this optimum determination is usually assigned to the image viewed by each eye from the average, typical, or desired distance from the final display. This would normally define the distance between average exposures, for example, images 11-2 and 11-4 in FIG. 1. See S. Kitrosser, "Polaroid Interocular Calculator", Photographic Science and Technique Section B of the Photographic Society of America Journal, Volume 19B, Number 2, Pages 74-76, May 1953.
The total parallax should not exceed comfortable hyperstereoscopic viewing for the normal interpupilary viewing distance, and the images should be produced from viewpoints equally spaced within that range. Even though this optimization is sought, there is enough flexibility in the systems described herein to compensate for non-optimal spacing while still rendering-acceptable images. It will be understood that interleaving a greater number of images produces a greater depth of field for the subject of the autostereograph.
Furthermore, it has been found that about 1/2 of the total horizontal motion, i.e., 0.132 of the viewing distance, is a shear value that gives good results for the outermost images. Thus, for 13 planar images and a 1/4-inch spacer, shear values of -0.132, -0.11, -0.088, -0.066, -0.044, -0.022, 0.0, 0.022, 0.044, 0.066, 0.088, 0.11 and 0.132 are suitable. Using the 1/4-inch spacer, the full-color interleaved image transparency produced, for example, by the CROMOLIN process was manually attached to the spacer with a suitable adhesive. The barrier strip transparency was similarly attached in registration to the opposite side of the spacer.
In addition, it has been found that the viewing distance may normally be roughly 2-3 times the width of the autostereograph, although this is not critical.
In producing the images for autostereographs, it will be appreciated that the images may advantageously include approximately 2-4 pixels of motion in the far foreground of adjacent planar images, depending on the number of interleaved images and their pixel resolution, so that the discontinuities between the images in adjacent image strips will be less perceptible as jumpiness in the autostereograph. If the image subject has high-frequency information in the far foreground, i.e., abrupt surface depth changes, less pixel motion is desirable. Subjects having low-frequency information in the far foreground, i.e., smooth surfaces, give better results with more pixel motion.
It will also be appreciated that the usual image processing aspect ratio considerations should be applied in light of the horizontal and vertical pixel densities of the output imaging device, the interleaving of images, the pixel shape of the CRT used, the pixel shape of any graphics software used, etc.
Although the foregoing description of mass production of autostereographs using conventional offset printing equipment is cast in terms of barrier-strip type images, it will be appreciated that the advantages of the present method and apparatus can also be used in producing lenticular-sheet autostereographs. Lenticular-sheet autostereographs replace the barrier strip with a linear array of suitably sized cylindrical lenses. Rather, than feeding flat material to the offset equipment and printing the interleaved images on one side and the barrier strip on the other, the material could easily be pre-lenticulated on one side and the interleaved images would be printed on the other side with the good registration available from offset printing equipment. The surface contour for such a lenticulated spacer is well-known and is described, for example, in U.S. Pat. No. 4,600,297.
It will be understood that the present invention includes all those output imaging techniques that produce transparency or other output suitable for making high-quality autostereographs. For example, new devices are being developed that draw images "continuously", i.e., without forming the images in a dot-matrix format such as the Linotrinic typesetter or in a rosette-like format such as the Crosfield scanner. The outputs of such devices, corresponding to the four color separation transparencies produced by the Crosfield imaging device, would be presented to an offset printer and scanned into that industry just as positive prints and images are today.
In addition, other techniques for forming full-color images as well as printing techniques such as web printing, gravure printing, intaglio and continuous-tone printing may also be used with the present invention. U.S. Pat. No. 3,306,974, herein incorporated by reference, describes a method for making color images with a monochromatic film illuminated by color-separated light sources. To reduce moire effects it should be necessary only to align the barrier strip or lenticulation in the direction perpendicular to the color lines described in the incorporated patent produced from the interleaved image strips. Such colored lines formed on a monochromatic transparency film, which would give the appearance of a conventional shadow mask, can also be produced by a Crosfield scanner or other high-resolution output imaging device.
The present description and drawings are intended only to be illustrative, and one of ordinary skill in the art will recognize that various modifications could be made without departing from the spirit or scope of the present invention that is to be limited only by the following claims.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US666424 *||Nov 27, 1899||Jan 22, 1901||Frederic Eugene Ives||Color photography.|
|US725567 *||Sep 25, 1902||Apr 14, 1903||Frederic E Ives||Parallax stereogram and process of making same.|
|US1260682 *||Jan 16, 1915||Mar 26, 1918||Clarence W Kanolt||Photographic method and apparatus.|
|US3241429 *||May 14, 1962||Mar 22, 1966||Pid Corp||Pictorial parallax panoramagram units|
|US3250173 *||Oct 23, 1962||May 10, 1966||Eastman Kodak Co||Abrasion resistent lenticular element integral with an image on a paper base|
|US3259499 *||Jan 18, 1965||Jul 5, 1966||Du Pont||Polymerizable elements|
|US3306974 *||Mar 8, 1963||Feb 28, 1967||Gilbert R Johnson||Color reproduction with a monochromatic gradient line image|
|US3772465 *||Jun 9, 1971||Nov 13, 1973||Ass Of Motion Picture Televisi||Image modification of motion pictures|
|US3895867 *||Jul 16, 1973||Jul 22, 1975||Dimensional Dev Corp||Three dimensional pictures and method of composing them|
|US3937565 *||Jun 3, 1974||Feb 10, 1976||Alasia Alfred Victor||Process of coding indicia and product produced thereby|
|US3953869 *||Sep 24, 1974||Apr 27, 1976||Dimensional Development Corporation||Stereoscopic photography apparatus|
|US3980476 *||Jan 27, 1975||Sep 14, 1976||Xerox Corporation||Imaging system|
|US4037533 *||Jun 2, 1976||Jul 26, 1977||Rapoport Printing Corporation||Color lithography using a random pattern screen|
|US4120562 *||Apr 12, 1976||Oct 17, 1978||Dimensional Development Corporation||Stereoscopic picture|
|US4132468 *||Dec 8, 1977||Jan 2, 1979||Dimensional Development Corp.||Projection apparatus for stereoscopic pictures|
|US4158501 *||Dec 27, 1977||Jun 19, 1979||The Three Dimensional Photography Corporation||Projection printing method and apparatus|
|US4259905 *||Jun 12, 1979||Apr 7, 1981||Toray Industries, Inc.||Waterless planographic printing plate with polysiloxane coating|
|US4468115 *||May 26, 1982||Aug 28, 1984||Nimslo International Limited||Travelling lamp house for 3-D photographic printer|
|US4478639 *||Dec 27, 1977||Oct 23, 1984||Three Dimensional Photography Corporation||Method for stereoscopic photography|
|US4481050 *||Sep 14, 1982||Nov 6, 1984||Gundlach Gregory E||Method of making a three-dimensional photograph|
|US4557954 *||May 17, 1984||Dec 10, 1985||Gundlach Gregory E||Three-dimensional photograph|
|US4596458 *||Jan 13, 1984||Jun 24, 1986||Gregory Barrington, Ltd.||Method and apparatus for making a free vision three-dimensional image employing portable equipment and providing increased speed and with enhanced versatility|
|US4600297 *||Jun 1, 1983||Jul 15, 1986||Winnek Douglas Fredwill||Apparatus and method of projection printing of three-dimensional photographs|
|US4650282 *||Dec 16, 1985||Mar 17, 1987||Lo Allen K W||Visual parallax compensation 3-D image structure|
|US4717949 *||Mar 7, 1986||Jan 5, 1988||Dimension Technologies, Inc.||Autostereoscopic display with illuminating lines and light valve|
|US4719615 *||Mar 4, 1986||Jan 12, 1988||Optical Data, Inc.||Erasable optical data storage medium|
|US4780867 *||Oct 2, 1986||Oct 25, 1988||Optical Data, Inc.||Method for erasably recording data by viscoelastic shear deformation|
|US4800407 *||Feb 1, 1988||Jan 24, 1989||Wah Lo Allen K||Total focus 3-D camera and 3-D image structure|
|US4814826 *||Feb 10, 1988||Mar 21, 1989||Fototechniek Elite B.V.||Printer for three dimensional lenticular print material|
|US4825430 *||Dec 19, 1986||Apr 25, 1989||Optical Data, Inc.||Erasable optical data storage medium having an embedded servo track and a subsurface recording interface|
|US4836874 *||Jan 30, 1987||Jun 6, 1989||Foster Michael S||Method of mass producing damage-resistant compact discs|
|US4852075 *||Apr 4, 1986||Jul 25, 1989||Optical Data, Inc.||Erasable optical data storage medium and method and apparatus for recording data on the medium|
|US4853769 *||Jun 16, 1987||Aug 1, 1989||Massachusetts Institute Of Technology||Time multiplexed auto-stereoscopic three-dimensional imaging system|
|US4896314 *||Apr 19, 1988||Jan 23, 1990||Optical Data, Inc.||Bump-forming media including thin intermediate reflective layer and methods for writing, reading, and erasing same|
|US4901304 *||Oct 8, 1986||Feb 13, 1990||Optical Data, Inc.||Erasable optical data storage medium having a zoned integral recording layer|
|US4903069 *||Feb 24, 1989||Feb 20, 1990||Image Technology, Inc.||Automatic three-dimensional photo printer to align the key subject image|
|US4912696 *||Dec 20, 1988||Mar 27, 1990||Optical Data, Inc.||Erasable optical data storage medium and method and apparatus for recording data on the medium|
|US5003915 *||Aug 23, 1989||Apr 2, 1991||American Bank Note Holographics, Inc.||Apparatus for printing and for forming a hologram on sheet material|
|US5024521 *||Nov 19, 1990||Jun 18, 1991||Larry Zuchowski||Autostereoscopic presentation system|
|US5113213 *||Jan 13, 1989||May 12, 1992||Sandor Ellen R||Computer-generated autostereography method and apparatus|
|US5121343 *||Jul 19, 1990||Jun 9, 1992||Faris Sadeg M||3-D stereo computer output printer|
|US5266995 *||Aug 12, 1992||Nov 30, 1993||Quad/Tech, Inc.||Method for forming a graphic image web|
|US5276478 *||May 19, 1992||Jan 4, 1994||Eastman Kodak Company||Method and apparatus for optimizing depth images by adjusting print spacing|
|US5278608 *||May 19, 1992||Jan 11, 1994||Eastman Kodak Company||Electronically printed depth photography system with improved viewing range|
|US5279912 *||May 11, 1992||Jan 18, 1994||Polaroid Corporation||Three-dimensional image, and methods for the production thereof|
|US5285238 *||May 10, 1993||Feb 8, 1994||Quad/Tech, Inc.||Method for forming a graphic image web|
|US5302989 *||Oct 1, 1992||Apr 12, 1994||Fuji Photo Film Co., Ltd.||Method of projecting stereoscopic image and apparatus for printing stereoscopic photograph|
|JPS5198026A *||Title not available|
|SE1699815A *||Title not available|
|1||"Exhibition of Computer Art," ACM/SIGGRAPH Traveling Art Show 1985, p. 52 (1985).|
|2||"Phsolograms by (Art)n ", catalog relating to an art exhibition conducted at Fermilab, Batavia, Illinois between Nov. 11, 1987 and Jan. 6, 1988.|
|3||A. Appel et al., "Computer Generation of 3D Pictures," IBM Technical Disclosure Bulletin, vol. 15, No. 3, pp. 834-839.|
|4||*||A. Appel et al., Computer Generation of 3D Pictures, IBM Technical Disclosure Bulletin, vol. 15, No. 3, pp. 834 839.|
|5||A. Marraud et al., "Lenticular Sheet 3-D Pictures and 3-d Projections," SPIE vol. 212 Optics and Photonics Applied to Three-Dimensional Imagery, pp. 48-51 (1979).|
|6||*||A. Marraud et al., Lenticular Sheet 3 D Pictures and 3 d Projections, SPIE vol. 212 Optics and Photonics Applied to Three Dimensional Imagery, pp. 48 51 (1979).|
|7||A. Ortony, "A System for Stereo Viewing," The Computer Journal, vol. 14, No. 2, pp. 140-144 (May 1971).|
|8||*||A. Ortony, A System for Stereo Viewing, The Computer Journal, vol. 14, No. 2, pp. 140 144 (May 1971).|
|9||B. Saunders, "Stereoscopic Drawing by Computer-Is It Orthoscopic?", Appl. Opt. vol. 7, No. 8, pp. 1499-1504 (Aug. 1968).|
|10||*||B. Saunders, Stereoscopic Drawing by Computer Is It Orthoscopic , Appl. Opt. vol. 7, No. 8, pp. 1499 1504 (Aug. 1968).|
|11||*||Exhibition of Computer Art, ACM/SIGGRAPH Traveling Art Show 1985, p. 52 (1985).|
|12||H. Ives, "A Camera for Making Parallax Panoramograms," J. Opt. Sci. Amer. 17, pp. 435-439 (Dec. 1928).|
|13||H. Ives, "The Chromolinoscope Revised," J. Opt. Soc. Amer. 20, pp. 343-333 (Jun. 1930).|
|14||*||H. Ives, A Camera for Making Parallax Panoramograms, J. Opt. Sci. Amer. 17, pp. 435 439 (Dec. 1928).|
|15||*||H. Ives, The Chromolinoscope Revised, J. Opt. Soc. Amer. 20, pp. 343 333 (Jun. 1930).|
|16||M. Neal, "More Than Science, More Than Art," IEEE Computer Graphics and Applications, pp. 3-5 (Nov. 1988).|
|17||*||M. Neal, More Than Science, More Than Art, IEEE Computer Graphics and Applications, pp. 3 5 (Nov. 1988).|
|18||*||Phsolograms by (Art) n , catalog relating to an art exhibition conducted at Fermilab, Batavia, Illinois between Nov. 11, 1987 and Jan. 6, 1988.|
|19||R. Guzik, "Current Technology in 3-D Electronic Displays," Electronic Imaging '88 Anaheim, California, (Mar. 30, 1988).|
|20||*||R. Guzik, Current Technology in 3 D Electronic Displays, Electronic Imaging 88 Anaheim, California, (Mar. 30, 1988).|
|21||T. Okoshi, "Three Dimensional Imaging Techniques," Academic Press, NY (1976).|
|22||*||T. Okoshi, Three Dimensional Imaging Techniques, Academic Press, NY (1976).|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US5600402 *||May 4, 1995||Feb 4, 1997||Kainen; Daniel B.||Method and apparatus for producing three-dimensional graphic images using a lenticular sheet|
|US5617178 *||Jan 29, 1996||Apr 1, 1997||National Graphics, Inc.||Method of producing multidimensional lithographic separations free of moire interference|
|US5712732 *||Mar 2, 1994||Jan 27, 1998||Street; Graham Stewart Brandon||Autostereoscopic image display adjustable for observer location and distance|
|US5745665 *||Sep 25, 1996||Apr 28, 1998||Douglas F. Winnek||Method for processing a three-dimensional data set into a composite two-dimensional image viewable as a three-dimensional image|
|US5764231 *||May 15, 1992||Jun 9, 1998||Eastman Kodak Company||Method and apparatus for creating geometric depth images using computer graphics|
|US5802410 *||Feb 18, 1997||Sep 1, 1998||Wah Lo; Allen Kwok||Method and apparatus for producing composite images with a masked imaging device|
|US5936774 *||Jun 4, 1998||Aug 10, 1999||Street; Graham S. B.||Autostereoscopic display|
|US6269403||Jun 30, 1997||Jul 31, 2001||Microsoft Corporation||Browser and publisher for multimedia object storage, retrieval and transfer|
|US6329963 *||Aug 27, 1998||Dec 11, 2001||Cyberlogic, Inc.||Three-dimensional display system: apparatus and method|
|US6329987||Dec 2, 1998||Dec 11, 2001||Phil Gottfried||Lenticular image and method|
|US6377371 *||Jul 26, 1999||Apr 23, 2002||Sony Corporation||Method and apparatus for formulating image data, method and apparatus for converting image data, method and apparatus for formulating holographic stereogram, recording medium and data transmitting method|
|US6424467||Mar 23, 2001||Jul 23, 2002||National Graphics, Inc.||High definition lenticular lens|
|US6465077||Jan 25, 2000||Oct 15, 2002||3M Innovative Properties Company||Black line screens and methods of making same|
|US6483644 *||Aug 5, 1999||Nov 19, 2002||Phil Gottfried||Integral image, method and device|
|US6490092||Mar 27, 2000||Dec 3, 2002||National Graphics, Inc.||Multidimensional imaging on a curved surface using lenticular lenses|
|US6549295||Dec 14, 1998||Apr 15, 2003||Insight, Inc.||Method for making products having merged images|
|US6710903 *||Feb 28, 2002||Mar 23, 2004||Sony Corporation||Method and apparatus for formulating image data, method and apparatus for converting image data, method and apparatus for formulating holographic stereogram, recording medium and data transmitting method|
|US6740846 *||Mar 27, 2003||May 25, 2004||Igor Troitski||Method for production of 3D laser-induced head image inside transparent material by using several 2D portraits|
|US7136185||Jul 12, 2002||Nov 14, 2006||National Graphics, Inc.||Corresponding lenticular imaging|
|US7239420||Sep 18, 2006||Jul 3, 2007||National Graphics, Inc.||Corresponding lenticular imaging|
|US7545565||Dec 7, 2005||Jun 9, 2009||Travel Tags, Inc.||Lenticular card and processes for making|
|US7545566||Oct 31, 2007||Jun 9, 2009||Travel Tags, Inc.||Lenticular card and process for making|
|US7545567||Oct 31, 2007||Jun 9, 2009||Travel Tags, Inc.||Lenticular card and process for making|
|US7573491 *||Jul 7, 2005||Aug 11, 2009||David Hartkop||Method for formatting images for angle-specific viewing in a scanning aperture display device|
|US8068283||Jun 8, 2009||Nov 29, 2011||Travel Tags, Inc.||Lenticular card and process for making|
|US20030016370 *||Jul 12, 2002||Jan 23, 2003||Goggins Timothy P.||Corresponding lenticular imaging|
|US20050083400 *||Sep 3, 2004||Apr 21, 2005||Yuzo Hirayama||Three-dimensional image display device, three-dimensional image display method and three-dimensional display image data generating method|
|US20050264560 *||Jul 7, 2005||Dec 1, 2005||David Hartkop||Method for formating images for angle-specific viewing in a scanning aperture display device|
|US20070013923 *||Sep 18, 2006||Jan 18, 2007||Goggins Timothy P||Corresponding Lenticular Imaging|
|US20090251787 *||Jun 8, 2009||Oct 8, 2009||John Tomczyk||Lenticular card and process for making|
|USRE38065 *||Apr 6, 2001||Apr 8, 2003||Lenticular Technologies, Llc||Printing process using thin sheet lenticular lens material|
|USRE44370||Jul 10, 2008||Jul 16, 2013||Travel Tags, Inc.||Lenticular card and processes for making|
|U.S. Classification||355/22, 355/77|
|International Classification||G02B27/22, H04N1/00, G03B35/00, G06T15/10, G03B35/14, H04N13/00|
|Cooperative Classification||H04N13/0285, H04N13/0055, G02B27/2214, G06T15/10, H04N13/0404, H04N13/0409, H04N13/0275, G03B35/00, H04N1/00795, H04N13/0445, G03B35/14|
|European Classification||G06T15/10, H04N13/04L, H04N1/00H, G03B35/00, H04N13/02E, H04N13/04A1, G02B27/22L, G03B35/14|