|Publication number||US4751570 A|
|Application number||US 06/806,523|
|Publication date||Jun 14, 1988|
|Filing date||Dec 9, 1985|
|Priority date||Dec 7, 1984|
|Publication number||06806523, 806523, US 4751570 A, US 4751570A, US-A-4751570, US4751570 A, US4751570A|
|Original Assignee||Max Robinson|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (7), Referenced by (163), Classifications (14), Legal Events (3)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This invention relates to the generation of apparently three-dimensional images. While the invention will be described in the context of television displays, it is to be understood that the techniques of the invention are not limited to this but can also be applied to imaging systems employing other forms of wave energy such as infra-red radiation and X-rays.
In the generation of 3-D television images a considerable amount of prior work has been done in regard to stereoscopic viewers but little attention has been paid to the cameras that observe the object or scene of interest and of which an image is to be created. It is therefore an aim of the present invention to provide an improved arrangement, the use of which produces a more versatile three-dimensional viewing system and a better and more acceptable display to the user.
According to the present invention, there is provided a stereo-camera head in which some or all of the parameters involved in stereoscopic viewing are remotely or automatically adjustable while the camera is in use.
In one arrangement twin cameras are employed with a fixed camera base, and small electric motor drives are provided to control focus and zoom of each lens system and also to adjust the convergence angle of the cameras. More sophisticated embodiments provide for variation of the camera separation distance and automatic adjustment of the principal stereoscopic vision parameters by a preprogrammed electronic control system. If desired, provision can be made for individual users of the equipment to test and set in their own personal limits in regard to tolerance of fusion of images. A further embodiment employs a common lens system serving two CCD chips, together with intelligent optics at the front end of the lens.
Arrangements according to the invention will now be described by way of example and with reference to the accompanying drawings, wherein:
FIG. 1 is a perspective view from above of a twin stereo-camera head embodying the invention;
FIG. 2 is an elevational block diagram of a twin stereo-camera head according to a second embodiment;
FIG. 3 is a block diagram of one of a number of servo motor systems employed in the embodiment of FIG. 2;
FIG. 4 is a circuit block diagram of vision control electronics used in the embodiment of FIG. 2;
FIG. 5 is a diagrammatic plan of a further embodiment, and
FIG. 6 is a circuit block diagram of control electronics used in the embodiment of FIG. 5.
Three-dimensional television displays for use in situations where the distance to the object of principal interest is variable (e.g. when the cameras are mounted on a remotely controlled vehicle) are very demanding on system hardware. They require the ability to mimic the human optical system's functions of convergence and accommodation, although for robotic applications the adjustments need not necessarily be made simultaneously.
Referring now to FIG. 1 of the drawings, this shows, in perspective view from above, a twin camera head with facilities for zoom and for varying the convergence of the cameras, as well as focussing. Each of the two television cameras 11 is clamped securely in a respective support cradle 12 mounted on a common bedplate 10, one of the cradles providing for geometrical alignment of its camera by means of three spring-loaded adjusting screws 13. This enables the left and right camera images to be accurately registered when overlayed on the television monitor screen. A standard television test-card can be used for the alignment procedure.
Parallel tracking of the zoom control, and focus control of the two camera lenses 14, is achieved mechanically in this instance. A toothed, flexible belt 15 is fitted around the focus adjustment ring on each lens and around a toothed drive gear on the shaft of a 12 V d.c. motor 16. The motor can be driven in either direction and is fitted with limit switches. Zoom control is achieved similarly by means of a toothed belt 17 and a motor 18. The flexibility of the two belts allows for the movement necessary to achieve a degree of convergence control.
Convergence control is achieved by pivoting the support cradles 11 in the horizontal plane about pivotal connections 11a to the bed plate near their front ends. At the back of each cradle there is a peg which fits into a spiral groove 19a formed in a nylon gear wheel 19 common to both cameras which can be driven in either direction by a 12 V d.c. motor 20 through appropriate drive gearing. This gives smooth simultaneous movement of the cameras between the near and far limits of convergence. Limit switches are incorporated in order to define maximum and minimum convergence positions. The amount of movement is only in the range of 1/2° to 21/2° and since the pivot points of the camera mounting cradles are substantially under the zoom control and focus adjustment belts there is no change of separation distance at this region that the belts cannot accommodate.
The zoom and focus lens drives, and also the convergence control if desired, can be arranged as feedback servomechanisms by the use of position sensing potentiometers. These are the principal stereoscopic parameters and, in a simple system, other parameters, such as camera separation, can be ignored if a defined television monitor screen size is employed and an average value is selected for the maximum permissible parallax for human observers. Several other systems will now be described.
In a stereo-camera head which does not have a camera separation facility, a technique of auto-focus linked to camera convergence will now be proposed. This enables the use of stereo-cameras to be much simplified for certain applications.
Firstly, the range to the object of principal interest is determined. The cameras can then be adjusted to converge on this point and the two lenses focussed appropriately. The range to the object can be found ultrasonically, as in the Polaroid auto-focussing camera, or by using a light-spot technique. Having obtained the range information, the stereo-camera may have its convergence point and focus adjusted under the control of an electronic circuit containing an EPROM. This circuit will have previously been set-up with a program to respond to range information signals and adjust the stereo-camera parameters accordingly.
Whilst the ultrasonic ranging system is relatively simple, consisting of an ultrasonic transmitter/receiver combination mounted on the stereo-camera, the light spot technique is more sophisticated and accurate.
Work has previously been carried out using structured light and stereoscopic television displays in order to solve the correspondence problem encountered in left and right image matching. It has been shown that if a coherent light spot (He Ne laser) is projected on to an object viewed by a stereoscopic vision system then the two images of this spot can be detected in the video signal. Objects at any position other than the convergence point will give rise to conjugate image points and the system can therefore be made to adjust its convergence so as to superimpose these left and right image points. The focus function of the lenses is slaved to the convergence function as before.
The system described can advantageously be used on a remote controlled robot vehicle, or even as a simple-to-use hand-held stereo-camera.
In the above arrangements, camera separation is fixed, but this can be an important stereoscopic vision parameter which can have a powerful influence on the perceived stereoscopic image. It is particularly advantageous to be able to increase the camera base as object distances become greater.
FIG. 2 of the drawings shows diagrammatically a stereo-camera which embodies a small micro-computer 21 to control the three more important parameters affecting the stereoscopic depth of field. In addition, focus control linked to convergence and lens iris control are available. By putting fixed values into the computer memory for the particular monitor screen size to be used and for the average value of maximum permissible parallax for humans, the computer will control the stereo camera head in such a way as to always present images within the tolerance of fusion limits of the average observer.
Each camera 22 has its own linear translation stage 23 which is on a precision linear guide and driven by a respective stepper motor 25 via a lead screw 24. Rotation stages 26 are mounted on each of the linear stages 23 and again these are driven by respective stepper motors 27. Control of the positions of both linear stages and both rotary stages is achieved through the micro-computer 21. The cameras 22 are provided with a means of mechanical alignment to enable accurate registration of the two camera images to be achieved.
In this way the convergence point and the camera base of the stereo-camera system can both be changed. This enables a fixed object to be viewed with a variety of different stereoscopic depths of field, it being possible to make the cameras lock on to a particular object distance whilst varying the camera separation.
The zoom, focus and iris lens functions of each camera are achieved using individual small electric servo motors with position encoding feedback potentiometers. Optical encoders can also be used. The lens function information is interfaced with the micro-computer control, as at 28, to achieve control of the focus of each lens as the convergence point of the system is varied, all within the limits for ease of fusion of the images by human eyes that are placed upon the system. An alternative to iris control by the computer is to use one of the auto iris lens sytems currently available.
Regarding each lens function control 28, this will generally comprise three servo-motor systems each as shown in FIG. 3. A servo-control differential amplifier module 40 receives input signals from the microcomputer 21 via a suitable interface 41 and supplies a drive signal to a d.c. electric motor 42 which applies the mechanical drive to the respective camera lens control function. A servo-potentiometer 43 also driven by the motor 42 delivers an electrical feedback signal to the servo-control amplifier module 40 whereby the system drives to a null signal condition at a mechanical position dependent on the input signal from the microcomputer.
The microcomputer used can be an Apple II, 8 bit machine which employs the 6502 micro-processor chip. The programming language for this machine is a form of Basic known as Applesoft. The program for present purposes will be found appended to this patent specification.
The outputs of the left and right cameras 22 are applied to vision control electronic circuitry 44 which generates a video signal suitable for application to any compatible video display television monitor 45. This circuitry also generates two switching output signals for controlling the spectacle switching circuit of a stereoscopic viewer, as known in the art, to be worn by the human observer of the 3D image. The circuitry 44 is shown in more detail in FIG. 4. The two camera signals are applied to a DG 211 analogue switch multiplexer 46 and one is also applied to a voltage comparator 47. The output of the voltage comparator is fed to a 74LS123 dual monostable 48 coupled to the multiplexer both directly and through an inverter 49. The multiplexer 46 feeds a video amplifier 50 which supplies the video output signal at 51.
To switch the spectacles of the stereoscopic viewer (not shown) in synchronism with the operation of the multiplexer 46, the switching output of the monostable 48 is also applied to a pair of power transistors 52, 53, in one case directly and in the other case through an inverter 54, so that the transistors supply switched outputs 55, 56 for controlling the stereoscopic viewer. Although in the example described the vision control electronics are designed for presentation of stereoscopic images using the field sequential switching technique, other electronics can be employed whereby the stereo-camera head is used to feed stereoscopic television displays based on other available techniques, e.g. the red/green anaglyph system, polarized screens system, split screen image system and so on.
Since tolerance of fusion of images varies from person to person, it is possible, instead of setting in an average tolerance, to allow each individual user of the stereo-camera system to perform a self-test for tolerance of fusion and set his own limits.
A pair of co-ordinated measuring marks are injected into the video display in such a way as to be presented as conjugate points in the stereo-image. By using two video position analysers 57 one in each video line, between the cameras 22 and the multiplexing electronics 44 it is possible to project left and right measuring marks into the display. The video position analysers (For-A Co. Ltd., type VPA 1000) inject small cross-wires into the video display whose x and y co-ordinates are displayed as they are moved around the area of the monitor screen.
The operator can control the disparity of these marks so that he can determine the limits of his own stereo near and far points. This is achieved as follows. The left and right marks are first positioned so that they are superimposed. This will appear to give a single image at the surface of the monitor screen. If now the left image is moved to the left and the right image to the right then the single fused image as seen through the viewing spectacles will appear to retreat behind the monitor screen. At some point the disparity between the two marks will be so great that the single image seen by the observer will break up into two separate images. The process may be repeated several times in order to find an average value of disparity at which this break-up occurs. This will be the maximum parallax that the observer can tolerate in the image at the far point.
A similar procedure can be adopted to find the near point by separating the marks such that the right image moves to the left and vice versa. The single fused image now appears to advance in front of the monitor screen and eventually this single image will again break up when the disparity between the two marks becomes too great for the observer to fuse them.
The limits of tolerance of fusion thus obtained can then be used in the computer memory in place of the average value of human tolerance of fusion. The technique is also applicable to other types of 3D television imaging systems. All that will be different is the way in which the measuring marks are introduced into the display so as to be correctly presented to each eye.
In the foregoing arrangements twin cameras have been employed to obtain the stereo images. It is however, possible also to use a single vidicon camera to provide 3D images by employing a time-division or sequential switching technique and various configurations of mirror/prism optics. A further development is to replace the single vidicon with 2 CCD imaging chips. These can be placed either closely side by side or separated by using appropriate optics. The technique enables a full-screen sequentially switched 3D image to be obtained.
FIG. 5 shows a system in which the two CCD chips 31 are at separate locations and their sight beams are merged by fixed optics consisting of respective mirrors 32 and a common prism 33. They share a common lens system 34, beyond which the beams are re-split and directed by a prism 35 and two angularly adjustable mirrors 36. The lens functions and the angular settings of the mirrors 36 are controlled by pre-programmed electronics 37.
Using a single lens, the need for parallel tracking of the lens functions, as in a two-camera system, is no longer required. Also the size of the 3D camera is reduced as well as the weight. The size is particularly significant since a two-camera analogy of a single lens system will always have a greater lateral dimension. Therefore, camera heads with the potential to give good stereo images having a large amount of apparent depth can be made significantly smaller. Using CCD imaging chips certain of the drive circuit functions can be used to operate both devices.
A most important aspect of the single lens system used in this way is the realization that on focusing and zooming the front end mirror convergence must be re-adjusted. Again pre-programmed electronics are used to solve this problem, thus giving the front-end optics some limited intelligence.
FIG. 6 illustrates one form of circuit that can be employed as the lens and mirror control electronics 37 of FIG. 5. Since all the functions produce non-linear characteristics (i.e. zoom, focus and convergence) the problem is to produce a non-linear voltage/convergence characteristic from a non-linear source characteristic (either focus or zoom). A way of achieving this is to use a "look-up" table stored in an EPROM for each mode of convergence/zoom and convergence/focus. A d.c. input voltage from either focus or zoom is fed to an analogue-to-digital converter 57 the output of which selects and address in the EPROM 58 containing the correct convergence characteristic value. The data addressed then feeds a digital-to-analogue converter 59 and the resulting d.c. output voltage drives the motor controlling the mirror convergence. Both look-up tables can be stored in the same EPROM and are derived experimentally.
The vision control electronics 60 for the system using two CCD chips can be similar to those shown in FIG. 3.
Another attractive possibility is the construction of a stereo-camera head using fibre optics to reduce even further the size of the package. ##SPC1##
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US2417446 *||Aug 1, 1941||Mar 18, 1947||Bell Telephone Labor Inc||Stereotelevision and television range finding|
|US3457364 *||Sep 14, 1964||Jul 22, 1969||Carrillo Julio B||Color television system providing an illusion of depth|
|US3784738 *||Dec 21, 1971||Jan 8, 1974||Natter H||Image reproduction system for dimensional stereoptic perception|
|US3818125 *||Oct 26, 1971||Jun 18, 1974||Butterfield J||Stereo television microscope|
|US4418993 *||May 7, 1981||Dec 6, 1983||Stereographics Corp.||Stereoscopic zoom lens system for three-dimensional motion pictures and television|
|US4558368 *||Feb 14, 1984||Dec 10, 1985||Asahi Kogaku Kogyo Kabushiki Kaisha||Stop control apparatus for electronic camera|
|US4559555 *||Jun 1, 1984||Dec 17, 1985||Arnold Schoolman||Stereoscopic remote viewing system|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US4829373 *||Aug 3, 1987||May 9, 1989||Vexcel Corporation||Stereo mensuration apparatus|
|US4879596 *||Jan 5, 1989||Nov 7, 1989||Kabushiki Kaisha Toshiba||Stereoscopic camera apparatus which incorporates cameras and can commonly adjust directions of the cameras|
|US4881122 *||Nov 29, 1988||Nov 14, 1989||Kanji Murakami||Three-dimensional shooting video camera apparatus|
|US4953016 *||Jun 1, 1989||Aug 28, 1990||Bobst Sa||Table-shaped jig for positioning elements on a support in accordance to a reference layout|
|US4999713 *||Mar 3, 1989||Mar 12, 1991||Sharp Kabushiki Kaisha||Interlocked zooming apparatus for use in stereoscopic cameras|
|US5003385 *||Aug 23, 1989||Mar 26, 1991||Kabushiki Kaisha Toshiba||Stereoscopic television system|
|US5063441 *||Oct 11, 1990||Nov 5, 1991||Stereographics Corporation||Stereoscopic video cameras with image sensors having variable effective position|
|US5082362 *||Jul 2, 1990||Jan 21, 1992||General Electric Company||Zoom lens for a variable depth range camera|
|US5101269 *||Sep 18, 1990||Mar 31, 1992||Eastman Kodak Company||Stereoscopic electronic slide and print viewer|
|US5119189 *||Oct 24, 1990||Jun 2, 1992||Hitachi, Ltd.||Stereoscopic imaging system|
|US5142357 *||May 9, 1991||Aug 25, 1992||Stereographics Corp.||Stereoscopic video camera with image sensors having variable effective position|
|US5175616 *||Aug 3, 1990||Dec 29, 1992||Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of National Defence Of Canada||Stereoscopic video-graphic coordinate specification system|
|US5237353 *||Jul 12, 1990||Aug 17, 1993||Montes Juan D||Process for three-dimensional taking, copying and reproducing of still and moving pictures|
|US5315999 *||Apr 21, 1993||May 31, 1994||Hewlett-Packard Company||Ultrasound imaging system having user preset modes|
|US5555090 *||Oct 24, 1994||Sep 10, 1996||Adaptive Optics Associates||System for dimensioning objects|
|US5661518 *||Jun 7, 1995||Aug 26, 1997||Synthonics Incorporated||Methods and apparatus for the creation and transmission of 3-dimensional images|
|US5682198 *||May 13, 1996||Oct 28, 1997||Canon Kabushiki Kaisha||Double eye image pickup apparatus|
|US5696551 *||Sep 27, 1996||Dec 9, 1997||Nec Corporation||Three-dimension picture coding system|
|US5699108 *||Mar 29, 1996||Dec 16, 1997||Canon Kabushiki Kaisha||Multi-eye image pickup apparatus with multi-function finder screen and display|
|US5835133 *||Jan 23, 1996||Nov 10, 1998||Silicon Graphics, Inc.||Optical system for single camera stereo video|
|US5864360 *||Aug 5, 1996||Jan 26, 1999||Canon Kabushiki Kaisha||Multi-eye image pick-up apparatus with immediate image pick-up|
|US5874987 *||Dec 16, 1996||Feb 23, 1999||Shinmei Electric Co., Ltd.||Method for recording stereoscopic images and device for the same|
|US5936663 *||Sep 15, 1997||Aug 10, 1999||Olympus Optical Co., Ltd.||Binocular display apparatus|
|US5949477 *||Jun 19, 1997||Sep 7, 1999||Hoglin; Irving M.||Three dimensional stereoscopic television system|
|US5969756 *||Jun 26, 1996||Oct 19, 1999||Image Processing Systems Inc.||Test and alignment system for electronic display devices and test fixture for same|
|US5976076 *||Mar 24, 1997||Nov 2, 1999||Kolff; Jack||Stereo laparoscope with synchronized optics|
|US5978015 *||Oct 12, 1995||Nov 2, 1999||Minolta Co., Ltd.||Stereoscopic system with convergence and dioptric power adjustments according to object distance|
|US6005607 *||Jun 27, 1996||Dec 21, 1999||Matsushita Electric Industrial Co., Ltd.||Stereoscopic computer graphics image generating apparatus and stereoscopic TV apparatus|
|US6058221 *||Jan 16, 1998||May 2, 2000||Image Processing Systems, Inc.||Electron beam profile measurement method and system|
|US6097355 *||Nov 17, 1997||Aug 1, 2000||Image Processing Systems, Inc.||Purity/beam landing error measurement method for electronic display devices|
|US6175379||Nov 23, 1999||Jan 16, 2001||Matsushita Electric Industrial Co., Ltd.||Stereoscopic CG image generating apparatus and stereoscopic TV apparatus|
|US6252626||Jun 13, 1995||Jun 26, 2001||Image Processing Systems, Inc.||Test and alignment system for electronic display devices|
|US6268880||Sep 22, 2000||Jul 31, 2001||Matsushita Electric Industrial Co., Ltd.||Stereoscopic CG image generating apparatus and stereoscopic TV apparatus|
|US6353457||Jun 13, 2001||Mar 5, 2002||Matsushita Electric Industrial Co., Ltd.||Stereoscopic computer graphics image generating apparatus and stereoscopic TV apparatus|
|US6414709 *||Jun 7, 1995||Jul 2, 2002||Synthonics Incorporated||Methods and apparatus for zooming during capture and reproduction of 3-dimensional images|
|US6417880 *||Jun 13, 2001||Jul 9, 2002||Matsushita Electric Industrial Co., Ltd.||Stereoscopic CG image generating apparatus and stereoscopic TV apparatus|
|US6539107 *||Apr 26, 2000||Mar 25, 2003||Cognex Corporation||Machine vision method using search models to find features in three-dimensional images|
|US6580448 *||May 13, 1996||Jun 17, 2003||Leica Microsystems Ag||Process and device for the parallel capture of visual information|
|US6762794||Dec 1, 1998||Jul 13, 2004||Canon Kabushiki Kaisha||Image pick-up apparatus for stereoscope|
|US6767321||Apr 4, 2002||Jul 27, 2004||Robert Czarnek||Stereo laparoscope with discrete working distance|
|US6809771 *||Jun 22, 2000||Oct 26, 2004||Minolta Co., Ltd.||Data input apparatus having multiple lens unit|
|US6947578 *||Apr 12, 2001||Sep 20, 2005||Seung Yop Lee||Integrated identification data capture system|
|US6958746 *||Apr 4, 2000||Oct 25, 2005||Bechtel Bwxt Idaho, Llc||Systems and methods for improved telepresence|
|US6967678 *||Jan 12, 2001||Nov 22, 2005||Vulcan Patents Llc||Moving imager camera for track and range capture|
|US7098458||Jun 3, 2004||Aug 29, 2006||Zeiss Optronik Gmbh||System and method for generating three-dimensional image displays|
|US7123292 *||Sep 29, 1999||Oct 17, 2006||Xerox Corporation||Mosaicing images with an offset lens|
|US7486311||Dec 18, 2003||Feb 3, 2009||Vulcan Patents Llc||Moving imager camera for track and range capture|
|US7567702||Jul 21, 2005||Jul 28, 2009||Vulcan Patents Llc||Data processing system and method|
|US7616254||Mar 16, 2006||Nov 10, 2009||Sony Corporation||Simple method for calculating camera defocus from an image scene|
|US7643748||Jun 2, 2006||Jan 5, 2010||James Cameron||Platform for stereoscopic image acquisition|
|US7652686 *||Jun 15, 2002||Jan 26, 2010||Robert Bosch Gmbh||Device for image detecting objects, people or similar in the area surrounding a vehicle|
|US7711201||Jun 22, 2006||May 4, 2010||Sony Corporation||Method of and apparatus for generating a depth map utilized in autofocusing|
|US7847826||Aug 14, 2008||Dec 7, 2010||Interval Licensing Llc||Moving imager camera for track and range capture|
|US7899321||Oct 13, 2009||Mar 1, 2011||James Cameron||Stereo camera with automatic control of interocular distance|
|US7925077||Jan 30, 2009||Apr 12, 2011||Tyzx, Inc.||Generation of a disparity result with low latency|
|US7929801||Aug 15, 2005||Apr 19, 2011||Sony Corporation||Depth information for auto focus using two pictures and two-dimensional Gaussian scale space theory|
|US7933512||Mar 24, 2009||Apr 26, 2011||Patrick Campbell||Stereo camera with controllable pivot point|
|US7990462||Oct 15, 2009||Aug 2, 2011||Sony Corporation||Simple method for calculating camera defocus from an image scene|
|US8077964||Mar 19, 2007||Dec 13, 2011||Sony Corporation||Two dimensional/three dimensional digital information acquisition and display device|
|US8085293 *||Mar 14, 2001||Dec 27, 2011||Koninklijke Philips Electronics N.V.||Self adjusting stereo camera system|
|US8115832 *||Oct 17, 2008||Feb 14, 2012||Swiss Medical Technology Gmbh||Zoom system for an optical stereo device|
|US8139935||Mar 31, 2010||Mar 20, 2012||James Cameron||3D camera with foreground object distance sensing|
|US8160440 *||Feb 4, 2011||Apr 17, 2012||Panasonic Corporation||Three-dimensional image pickup apparatus and three-dimensional image pickup method|
|US8170412||Dec 18, 2009||May 1, 2012||James Cameron||Platform for stereoscopic image acquisition|
|US8189100 *||Jul 25, 2006||May 29, 2012||Qualcomm Incorporated||Mobile device with dual digital camera sensors and methods of using the same|
|US8194995||Sep 30, 2008||Jun 5, 2012||Sony Corporation||Fast camera auto-focus|
|US8203598 *||Jun 8, 2009||Jun 19, 2012||Sony Corporation||Method and apparatus for capturing three-dimensional stereoscopic images|
|US8213786 *||Dec 22, 2010||Jul 3, 2012||Samsung Electronics Co., Ltd.||Method and apparatus for processing digital image by using fast autofocus|
|US8238741||Mar 31, 2010||Aug 7, 2012||James Cameron & Vincent Pace||Stereo camera platform and stereo camera|
|US8265477||Mar 31, 2010||Sep 11, 2012||James Cameron||Stereo camera with preset modes|
|US8280194||Apr 29, 2008||Oct 2, 2012||Sony Corporation||Reduced hardware implementation for a two-picture depth map algorithm|
|US8355627||Feb 10, 2012||Jan 15, 2013||James Cameron & Vincent Pace||3D camera with foreground object distance sensing|
|US8401380||Aug 15, 2012||Mar 19, 2013||Vincent Pace & James Cameron||Stereo camera with preset modes|
|US8401381||Jul 10, 2012||Mar 19, 2013||Vincent Pace & James Cameron||Stereo camera platform and stereo camera|
|US8406619||Mar 23, 2009||Mar 26, 2013||Vincent Pace & James Cameron||Stereo camera with automatic control of interocular distance|
|US8493461||Nov 16, 2010||Jul 23, 2013||Interval Licensing Llc||Moving imager camera for track and range capture|
|US8553093||Sep 30, 2008||Oct 8, 2013||Sony Corporation||Method and apparatus for super-resolution imaging using digital imaging devices|
|US8648808||Sep 19, 2011||Feb 11, 2014||Amchael Visual Technology Corp.||Three-dimensional human-computer interaction system that supports mouse operations through the motion of a finger and an operation method thereof|
|US8655163||Feb 13, 2012||Feb 18, 2014||Cameron Pace Group Llc||Consolidated 2D/3D camera|
|US8666241||Mar 26, 2013||Mar 4, 2014||Vincent Pace||Stereo camera with automatic control of interocular distance based on lens settings|
|US8698878||Dec 29, 2009||Apr 15, 2014||Sony Corporation||3-D auto-convergence camera|
|US8717450||Sep 14, 2012||May 6, 2014||Interval Licensing Llc||Moving imager camera for track and range capture|
|US8937644||Mar 21, 2012||Jan 20, 2015||Canon Kabushiki Kaisha||Stereoscopic image capture|
|US8964004||Sep 20, 2010||Feb 24, 2015||Amchael Visual Technology Corporation||Three channel reflector imaging system|
|US9019352||Nov 21, 2011||Apr 28, 2015||Amchael Visual Technology Corp.||Two-parallel-channel reflector with focal length and disparity control|
|US9019603||Mar 22, 2012||Apr 28, 2015||Amchael Visual Technology Corp.||Two-parallel-channel reflector with focal length and disparity control|
|US9071738 *||Nov 5, 2012||Jun 30, 2015||Vincent Pace||Integrated broadcast and auxiliary camera system|
|US9167229 *||Jun 23, 2011||Oct 20, 2015||Hysonic. Co., Ltd.||Small three-dimensional imaging device|
|US9183461||May 9, 2013||Nov 10, 2015||Intel Corporation||Systems and methods for row causal scan-order optimization stereo matching|
|US9294672 *||Dec 15, 2014||Mar 22, 2016||Qualcomm Incorporated||Multi-camera system using folded optics free from parallax and tilt artifacts|
|US9319660 *||Apr 26, 2013||Apr 19, 2016||Industrial Technology Research Institute||Device for acquiring depth image, calibrating method and measuring method therefor|
|US9374516||Oct 28, 2014||Jun 21, 2016||Qualcomm Incorporated||Auto-focus in low-profile folded optics multi-camera system|
|US9383550||Apr 1, 2015||Jul 5, 2016||Qualcomm Incorporated||Auto-focus in low-profile folded optics multi-camera system|
|US9386222||Jan 30, 2015||Jul 5, 2016||Qualcomm Incorporated||Multi-camera system using folded optics free from parallax artifacts|
|US9398264||Mar 15, 2013||Jul 19, 2016||Qualcomm Incorporated||Multi-camera system using folded optics|
|US9438889||Sep 18, 2012||Sep 6, 2016||Qualcomm Incorporated||System and method for improving methods of manufacturing stereoscopic image sensors|
|US9485495||Aug 8, 2011||Nov 1, 2016||Qualcomm Incorporated||Autofocus for stereo images|
|US9541740||Jun 17, 2015||Jan 10, 2017||Qualcomm Incorporated||Folded optic array camera using refractive prisms|
|US9549107||Jun 17, 2015||Jan 17, 2017||Qualcomm Incorporated||Autofocus for folded optic array cameras|
|US9557634||Jun 19, 2013||Jan 31, 2017||Amchael Visual Technology Corporation||Two-channel reflector based single-lens 2D/3D camera with disparity and convergence angle control|
|US9733458||May 24, 2016||Aug 15, 2017||Qualcomm Incorporated||Multi-camera system using folded optics free from parallax artifacts|
|US20010017651 *||Jan 12, 2001||Aug 30, 2001||Baker Henry H.||Moving imager camera for track and range capture|
|US20020141635 *||Jan 24, 2002||Oct 3, 2002||Swift David C.||Method and system for adjusting stereoscopic image to optimize viewing for image zooming|
|US20020149610 *||Apr 12, 2001||Oct 17, 2002||Lee Seung Yop||Integrated identification data capture system|
|US20020158984 *||Mar 14, 2001||Oct 31, 2002||Koninklijke Philips Electronics N.V.||Self adjusting stereo camera system|
|US20040135886 *||Dec 18, 2003||Jul 15, 2004||Baker Henry H||Moving imager camera for track and range capture|
|US20040256558 *||Jun 3, 2004||Dec 23, 2004||Gunter Kuerbitz||System and method for generating three-dimensional image displays|
|US20050030378 *||Jun 15, 2002||Feb 10, 2005||Christoph Stiller||Device for image detecting objects, people or similar in the area surrounding a vehicle|
|US20050053274 *||Apr 19, 2004||Mar 10, 2005||Yaron Mayer||System and method for 3D photography and/or analysis of 3D images and/or display of 3D images|
|US20050207486 *||Aug 9, 2004||Sep 22, 2005||Sony Corporation||Three dimensional acquisition and visualization system for personal electronic devices|
|US20050219659 *||Mar 31, 2004||Oct 6, 2005||Shuxue Quan||Reproduction of alternative forms of light from an object using digital imaging system|
|US20060013473 *||Jul 21, 2005||Jan 19, 2006||Vulcan Patents Llc||Data processing system and method|
|US20060204240 *||Jun 2, 2006||Sep 14, 2006||James Cameron||Platform for stereoscopic image acquisition|
|US20070002889 *||Jun 30, 2005||Jan 4, 2007||Symbol Technologies, Inc.||Time division multiplexing for access ports in a wireless network|
|US20070036427 *||Aug 15, 2005||Feb 15, 2007||Makibi Nakamura||Depth information for auto focus using two pictures and two-dimensional gaussian scale space theory|
|US20070189750 *||Feb 16, 2006||Aug 16, 2007||Sony Corporation||Method of and apparatus for simultaneously capturing and generating multiple blurred images|
|US20070216765 *||Mar 16, 2006||Sep 20, 2007||Wong Earl Q||Simple method for calculating camera defocus from an image scene|
|US20070297784 *||Jun 22, 2006||Dec 27, 2007||Sony Corporation||Method of and apparatus for generating a depth map utilized in autofocusing|
|US20080024614 *||Jul 25, 2006||Jan 31, 2008||Hsiang-Tsun Li||Mobile device with dual digital camera sensors and methods of using the same|
|US20080117290 *||Oct 18, 2007||May 22, 2008||Mgc Works, Inc.||Apparatus, system and method for generating stereoscopic images and correcting for vertical parallax|
|US20080232680 *||Mar 19, 2007||Sep 25, 2008||Alexander Berestov||Two dimensional/three dimensional digital information acquisition and display device|
|US20080303908 *||Aug 14, 2008||Dec 11, 2008||Baker Henry H||Moving imager camera for track and range capture|
|US20090136091 *||Jan 30, 2009||May 28, 2009||John Iselin Woodfill||Data processing system and method|
|US20090167843 *||Jun 8, 2006||Jul 2, 2009||Izzat Hekmat Izzat||Two pass approach to three dimensional Reconstruction|
|US20090268985 *||Apr 29, 2008||Oct 29, 2009||Earl Quong Wong||Reduced Hardware Implementation For A Two-Picture Depth Map Algorithm|
|US20100033618 *||Oct 15, 2009||Feb 11, 2010||Earl Quong Wong||Simple method for calculating camera defocus from an image scene|
|US20100079608 *||Sep 30, 2008||Apr 1, 2010||Earl Quong Wong||Method And Apparatus For Super-Resolution Imaging Using Digital Imaging Devices|
|US20100080482 *||Sep 30, 2008||Apr 1, 2010||Earl Quong Wong||Fast Camera Auto-Focus|
|US20100098402 *||Dec 18, 2009||Apr 22, 2010||James Cameron||Platform For Stereoscopic Image Acquisition|
|US20100238272 *||Mar 23, 2009||Sep 23, 2010||James Cameron||Stereo Camera with Automatic Control of Interocular Distance|
|US20100238326 *||Oct 17, 2008||Sep 23, 2010||Joachim Luber||Zoom System for An Optical Stereo Device|
|US20100239240 *||Oct 13, 2009||Sep 23, 2010||James Cameron||Stereo Camera With Automatic Control of Interocular Distance|
|US20100247088 *||Mar 24, 2009||Sep 30, 2010||Patrick Campbell||Stereo Camera with Controllable Pivot Point|
|US20100289874 *||May 17, 2010||Nov 18, 2010||Fuhua Cheng||Square tube mirror-based imaging system|
|US20100309291 *||Jun 8, 2009||Dec 9, 2010||Sony Corporation||Method and apparatus for capturing three-dimensional stereoscopic images|
|US20100321777 *||Jun 18, 2009||Dec 23, 2010||Sony Corporation||Method and apparatus for optimizing stereoscopic effect in a camera|
|US20110001797 *||Dec 29, 2009||Jan 6, 2011||Sony Corporation||3-d auto-convergence camera|
|US20110058033 *||Nov 16, 2010||Mar 10, 2011||Baker Henry H||Moving imager camera for track and range capture|
|US20110085788 *||Mar 31, 2010||Apr 14, 2011||Vincent Pace||Stereo Camera Platform and Stereo Camera|
|US20110150446 *||Dec 22, 2010||Jun 23, 2011||Samsung Electronics Co., Ltd.||Method and Apparatus for Processing Digital Image by Using Fast Autofocus|
|US20120007955 *||Jul 8, 2010||Jan 12, 2012||Daniel Robert Fradenburgh||Portable auxiliary device for making stereoscopic image|
|US20120027392 *||Feb 4, 2011||Feb 2, 2012||Panasonic Corporation||Three-dimensional image pickup apparatus and three-dimensional image pickup method|
|US20120307015 *||Mar 8, 2012||Dec 6, 2012||Florian Maier||Device for Positioning and Calibrating at Least Two Cameras with a Partial Mirror to Take Three-Dimensional Pictures|
|US20130057697 *||Nov 5, 2012||Mar 7, 2013||Vincent Pace||Integrated broadcast and auxiliary camera system|
|US20130201295 *||Oct 10, 2011||Aug 8, 2013||Michael David Lindsay||Stereo 3d filming|
|US20130229496 *||Jun 23, 2011||Sep 5, 2013||Hysonic. Co., Ltd.||Small three-dimensional imaging device|
|US20140092268 *||Dec 11, 2013||Apr 3, 2014||Lc Technologies, Inc.||Eye/Head Controls for Camera Pointing|
|US20140184751 *||Apr 26, 2013||Jul 3, 2014||Industrial Technology Research Institute||Device for acquiring depth image, calibrating method and measuring method therefor|
|US20160306260 *||Apr 19, 2016||Oct 20, 2016||Sensors Unlimited, Inc.||System for parallax correction|
|CN1934874B||Mar 14, 2005||Jul 21, 2010||索尼电子有限公司||Three dimensional acquisition and visualization system for personal electronic devices|
|DE19537220A1 *||Oct 6, 1995||Apr 10, 1997||Hans Thilo Richter||Stereo attachment for camera with electronic image sensor|
|DE19548129A1 *||Dec 21, 1995||Jun 26, 1997||Hans Thilo Richter||Stereo camera system with electronic imaging device|
|EP0811876A1 *||Jun 4, 1997||Dec 10, 1997||Pieter O. Zanen||Method and apparatus for three-dimensional measurement and imaging having focus-related convergence compensation|
|EP0921694A2 *||Dec 2, 1998||Jun 9, 1999||Canon Kabushiki Kaisha||Stereoscopic image pick-up apparatus|
|EP0921694A3 *||Dec 2, 1998||Mar 28, 2001||Canon Kabushiki Kaisha||Stereoscopic image pick-up apparatus|
|EP1400841A1 *||Jun 4, 1997||Mar 24, 2004||Pieter O. Zanen||Apparatus for three-dimensional measurement and imaging having focus-related convergence compensation|
|EP1400842A1 *||Jun 4, 1997||Mar 24, 2004||Pieter O. Zanen||Method for three-dimensional measurement and imaging having focus-related convergence compensation|
|EP1484628A1 *||Jun 3, 2004||Dec 8, 2004||Zeiss Optronik GmbH||System and method for generating three-dimensional images|
|WO1992005463A1 *||Sep 16, 1991||Apr 2, 1992||Eastman Kodak Company||Device and method for stereoscopic viewing of slides and prints|
|WO1996015631A1 *||Nov 9, 1995||May 23, 1996||Synthonics Incorporated||Methods and apparatus for zooming during capture and reproduction of 3-dimensional images|
|WO2005091650A2||Mar 14, 2005||Sep 29, 2005||Sony Electronics Inc.||Three dimensional acquisition and visualization system for personal electronic devices|
|WO2005091650A3 *||Mar 14, 2005||May 4, 2006||Sony Electronics Inc||Three dimensional acquisition and visualization system for personal electronic devices|
|WO2011123700A1 *||Mar 31, 2011||Oct 6, 2011||Waterdance, Inc.||3d camera with foreground object distance sensing|
|U.S. Classification||348/47, 348/211.6, 352/65, 348/335, 348/E13.014, 348/E13.025|
|International Classification||H04N13/00, H04N13/02|
|Cooperative Classification||H04N13/0239, H04N13/0296, H04N2013/0081, G03B35/08|
|European Classification||H04N13/02A2, H04N13/02Y|
|Jan 14, 1992||REMI||Maintenance fee reminder mailed|
|Jun 14, 1992||LAPS||Lapse for failure to pay maintenance fees|
|Aug 18, 1992||FP||Expired due to failure to pay maintenance fee|
Effective date: 19920614