|Publication number||US6224542 B1|
|Application number||US 09/226,050|
|Publication date||May 1, 2001|
|Filing date||Jan 4, 1999|
|Priority date||Jan 4, 1999|
|Publication number||09226050, 226050, US 6224542 B1, US 6224542B1, US-B1-6224542, US6224542 B1, US6224542B1|
|Inventors||William H. L. Chang, Markus Yap, Salmaan Hameed, Richard A. Beutter|
|Original Assignee||Stryker Corporation|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (11), Non-Patent Citations (6), Referenced by (103), Classifications (8), Legal Events (4)|
|External Links: USPTO, USPTO Assignment, Espacenet|
The present invention pertains to the field of medical devices. More particularly, the present invention relates to endoscopic camera systems.
Endoscopy is a medical field which allows the acquisition of high-quality video images of internal features of a human body, without the need for invasive surgery. A basic tool of endoscopy is an endoscopic camera system, which includes a scope that is inserted into the body of a patient. Some endoscopic procedures involve the use of a flexible scope, as in the field of gastroenterology, for example. Other procedures, such as arthroscopy or laparoscopy, involve the use of a rigid scope. The scope is normally connected to a camera head that includes electronics for acquiring video image data through the scope.
The connected scope and camera head may be held and manipulated during endoscopic surgery by a human surgical assistant or by a holding tool, such as a robotic positioning system. The scope has optical properties which allow it to introduce light into the body of the patient and to transmit light from the body cavity to the camera head. A high intensity light source may be coupled to the scope by a fiber optic cable to introduce light into the body. The camera head is coupled through a flexible transmission line to a camera control unit, which is often mounted on a mobile cart. The control unit processes video data provided by the camera head to generate images, which are displayed on a video monitor. The control unit may also be coupled to various peripheral devices, such as a printer and a video cassette recorder (VCR).
During endoscopic surgery, the surgeon sometimes requires a more close-up (“zoomed”) view of a feature inside the body. One way of accomplishing this is for the person or machine holding the scope to physically move the scope closer to the feature of interest. This approach has several disadvantages, however. For example, physically moving the scope consumes valuable time during surgery while the scope is repositioned. The repositioning process may involve several trial-and-error steps as the scope holder makes corrections in response to verbal feedback from the surgeon. It may be difficult for a human holder to maintain the scope in precisely the desired position, particularly when fatigue sets in. Further, moving the scope closer to the object of interest might interfere with the surgeon's ability to operate.
Some endoscopic camera systems provide the capability to zoom in on an object without having to move the scope closer to the object. Such systems use mechanical zooming, which generally involves adjusting the configuration of optics within the scope and/or its connection to the camera head. This may be done manually, such as by turning a knob or coupler, or electronically by pressing a button or other appropriate control. However, even these systems require time to adjust and are subject to a certain amount of trial-and-error in zooming.
Another problem is that zooming reduces the field of view of the scope. The scope has a maximum field of view corresponding to its non-zoomed setting. As the scope zooms in on an object, features that were near the periphery of the field of view may become lost outside the field of view. Consequently, the surgeon undesirably loses view of the general field of surgery within the body. Reacquiring the more general view requires reverting to a lower magnification setting. Thus, it is desirable to have an endoscopic camera system which overcomes these and other disadvantages of the prior art.
An endoscopic camera system includes the capability to receive image data from an endoscopic camera and to process the image data to generate images, including the capability to non-mechanically zoom images. Particular embodiments of the endoscopic camera system may also include the capability to control zooming in response to voice commands.
Other features of the present invention will be apparent from the accompanying drawings and from the detailed description which follows.
The present invention is illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements and in which:
FIG. 1 illustrates an endoscopic camera system.
FIG. 2 is a block diagram of the endoscopic camera system of FIG. 1.
FIG. 3 is a block diagram showing a voice response control system (VCS) integrated with the endoscopic camera system.
FIG. 4 is a block diagram of the camera control unit (CCU) of the endoscopic camera system.
FIG. 5 is a block diagram of the zoom circuitry in the camera control unit (CCU).
FIG. 6 illustrates internal organs of a human body and various zoom views that can be generated using the present invention.
An endoscopic camera system having digital zoom operable in response to voice commands is described. As will be described in greater detail below, the endoscopic camera system includes a camera control unit having zoom circuitry for non-mechanically zooming video images of internal features of the body in real-time. Operation of the zoom circuitry may be controlled by manual user input or by voice commands. The digital zoom feature avoids the need for a person to move the scope back and forth to obtain a closer view of an organ or other feature. Because zooming is done digitally, the endoscope can remain stationary (e.g., held by a robotic device or other tools), thus avoiding waste of surgery time in repositioning the scope. In addition, zoomed views of certain target areas can be pre-defined, stored in memory, and then recalled instantly during surgery when needed. The surgeon can easily and virtually instantaneously switch between zoomed views with a voice command or the touch of a manual control. Further, one or more zoomed views can be displayed within the overall field of view in a picture-in-picture format.
FIG. 1 illustrates an endoscopic camera system in which the present invention may be implemented. The illustrated camera system includes a rigid scope 2 of the type that is commonly used for laparoscopy or arthroscopy. The scope 2 is coupled to a camera head 3 by a coupler 6. The camera head 3 includes well-known circuitry, such as charge-coupled devices (CCDs), for acquiring color video image data of internal features of the body through a system of lenses within the scope 2. Light is provided to the scope 2 by a flexible light source 7 through an appropriate flexible light conduit 8, such as a fiber optic cable. The camera head 3 is coupled to a camera control unit (CCU) 4 by a flexible transmission line 5. Operation of the camera system is controlled, in part, from CCU 4. Transmission line 5 conveys video image data from the camera head 3 to the CCU 4 and conveys various control signals bi-directionally between the camera head 3 and the CCU 4. It is assumed, for purposes of this description, that image data output by the camera head 3 onto transmission line 5 are in an analog format, such as National Television Standards Committee (NTSC) format. However, in alternative embodiments, the image data output by the camera head 3 may be digital, in which case transmission line 5 may be Firewire, Universal Serial Bus (USB), or another type of high-speed digital interface.
A button or other similar manual control 14 on the camera head 3 allows a user to control zooming and/or other functions of the camera system. Zooming and other functions may also be controlled by voice commands using a voice response control system (VCS) 10, which is coupled to the CCU 4. Voice commands are input into a microphone 12 on a headset 11 worn by the surgeon and coupled to the voice control response system (VCS) 10. VCS 10 employs speech-recognition techniques to generate control signals in response to the voice commands. A handheld control device (pendant) 13 is coupled to the VCS 10 as an alternative means of operating certain functions of the VCS 10. Also coupled to the CCU 4 are a video cassette recorder (VCR), a printer 16, and (optionally) other devices (not shown), as desired. Video image data acquired by camera head 3 and processed by CCU 4 is converted to images, which can be displayed on monitor 9, recorded in VCR 15, and/or used to generate static images, hard copies of which can be produced by printer 16.
FIG. 2 is a block diagram of the endoscopic camera system of FIG. 1, according to one embodiment. The CCU 4 includes user input controls for adjusting various settings of the camera system, such as shutter, gain, and white balance. The camera head 3 is coupled to the CCU 4 so as to allow communication of both image data and control signals between CCU 4 and camera head 3. Also coupled to the CCU 4 are the light source 7, monitor 9, VCR 15, printer 16, and frame grabber 17. Frame grabber 17 may be used to capture and save individual frames of video data acquired from camera head 3, which may then be printed on printer 16.
Note that numerous variations upon the embodiment in FIG. 2 may be implemented as alternative embodiments. In one alternative embodiment, for example, the frame grabber 17 is capable of controlling other components in the system (e.g., the printer 16, VCR 15 and/or monitor 9) in response to the CCU 4; this embodiment eliminates the need for some of the illustrated connections between the CCU 4 and these other components. Also, as indicated above, other components may be added to the system, if appropriate.
As noted above, the VCS 10 (FIG. 1) can be used to operate various functions of the endoscopic camera system, including digital zooming. Techniques for recognizing speech and controlling devices in response to speech, such as may be employed by the VCS 10, are well-known in the art and therefore do not need to be described herein. Nonetheless, speech recognition and related control techniques such as may be implemented by the VCS 10 are described in International Application Under the Patent Cooperation Treaty (PCT), number WO 96/09587, entitled “A Speech Interface for an Automated Endoscopic System,” filed on Sep. 21, 1995 and published on Mar. 28, 1996, which is incorporated herein by reference. Endoscopic camera systems equipped with certain voice response functions are also commercially available, such as the Stryker 882 TE Camera System with HERMES Voice Control, which is available from Stryker Endoscopy of Santa Clara, Calif., and which implements HERMES speech recognition techniques of Computer Motion, Inc., of Goleta, Calif.
FIG. 3 illustrates how the VCS 10 may be connected in the endoscopic camera system, according to one embodiment. In the illustrated embodiment, the VCS 10 is coupled to monitor 9 and audio speaker 18. Audio speaker 18 may be an integral component of monitor 9. The CCU 4 and (optionally) various other devices 20 are coupled to the VCS 10 by a conventional communication link/protocol, such as USB, CAN bus (ISO 11898), RS-232, or the like. (Not shown in FIG. 3 are peripheral devices that are coupled directly to the CCU 4, such as shown in FIG. 2.) Note that various configurations may be used to connect components to the VCS 10, including point-to-point connections (as shown) or a daisy chain, for example.
FIG. 4 is a block diagram of the CCU 4, according to one embodiment. In the illustrated embodiment, the CCU 4 includes a processing/control unit 30, a pre-amplification stage 31, an analog-to-digital (A/D) converter 32, an input interface 33, an output interface 34, a random access memory (RAM) 35, a nonvolatile memory 36, and a zoom unit 37. Processing/control unit 30 controls the overall operation of the CCU 4 and performs signal processing, including functions commonly used in generating displayable video images. Accordingly, processing/control unit 30 may be, or may include, a general- or special-purpose microprocessor, such as a digital signal processor (DSP), application specific integrated circuit (ASIC), field programmable gate array (FPGA), or other appropriate device or combination of such devices. Software instructions executable by processing/control unit 30 for performing various functions of the CCU 4 may be stored in RAM 35, nonvolatile memory 36, or both.
During operation of the camera system, image data generated by the camera head 3 are received (via transmission line 5) by pre-amplification stage 31, where the data undergo amplification and appropriate signal conditioning. The amplified and conditioned data are then converted to digital form by A/D converter 32 and provided to processing/control unit 30. Of course, in an embodiment in which the camera head 3 outputs digital data, the A/D converter 32 would be unnecessary.
User inputs from manual controls on the CCU 4 and the camera head 3 are input to input interface 33. In addition, control signals resulting from processed and recognized voice commands from VCS 10 are also received by input interface 33. The input interface 33 then provides these signals, after any appropriate buffering and/or signal conditioning, to processing/control unit 30. In the illustrated embodiment, processing/control unit 30 generates various outputs directed to the light source 7, monitor 9, VCR 15, printer 16, and/or frame grabber 17 via the output interface 34, which performs any appropriate buffering and/or signal conditioning.
Image data may be stored at various stages of processing in RAM 35, nonvolatile memory 36, or both, which are coupled to processing in control unit 30 by a bus 38 or any other suitable type of connection. Nonvolatile memory 36 may be any device suitable for storing relatively large amounts of data, such as: read only memory (ROM), which may be programmable and erasable; flash memory; an optical, magnetic or magneto-optical (MO) mass storage device; or a combination of such devices.
The zoom functions of the present invention are provided by zoom unit 37. Zoom unit 37 generally includes circuitry for non-mechanically (digitally) zooming images generated by processing in control unit 30 in real-time (as the image data are acquired) using data acquired from the camera head 3. For purposes of this description, “non-mechanical” zooming means zooming that does not require physical manipulation of the optical properties of the camera system or repositioning of the scope, or zooming solely through the manipulation of data. Zoom unit 37 may be, or may include, a general- or special-purpose microprocessor, ASIC, FPGA, or other appropriate device or combination of such devices. Note that electronic components capable of enlarging images by manipulating data are commercially available. Such components may employ, for example, pixel and/or line interpolation to enlarge images. One such component which may be suitable for this purpose is the IP00C702 SXGA Expansion/Reduction LSI from Sumitomo Metal Industries, Ltd., which has sales offices in Saddlebrook, N.J., and Santa Clara, Calif.
Zoom unit 37 is preferably capable of enlarging images by many different, user-selectable magnification (zoom) factors. In one embodiment, zoom unit 37 is configured to zoom images according to a user's selection of any of 64 increments between a zoom factor of 1.0 (no zoom, actual size) and a zoom factor of 2.0 (twice actual size). As noted above, zooming may be controlled via a manual control, such as control 14 on camera head 3 (FIG. 1) or a manual control on the CCU 4. Zooming may also be controlled in response to voice commands input to the VCS 10 via microphone 12.
Thus, the digital zoom feature of the present invention avoids the need for a person to move the scope back and forth to focus on an organ or a feature of interest. The endoscope can remain stationary (e.g., held by a robotic device or other tool) while zooming is done digitally, thus avoiding waste of surgery time and avoiding visual disorientation of the surgeon from target organs or target areas. In addition, prior to performing a surgical procedure, the surgeon can look at the overall camera field of view and use the zoom feature to determine subsets of the field of view, i.e., “microviews”, as target areas, such as the gall bladder or the bile ducts. The surgeon's selections can then be stored in memory in the CCU 4 and can then be recalled instantly during surgery through manual or voice control.
In addition, one or more zoomed views can be displayed within the overall field of view in a picture-in-picture fashion. Specifically, the digital zoom feature allows multiple zoomed views to be concurrently created in real-time by operating upon different subsets of the data representing the overall field of view. The surgeon may use voice, a joystick, or other control device to focus on a new target of interest and its corresponding field of view. Further, the surgeon can easily and virtually instantaneously switch between views and between zoom levels with a voice command or the touch of a manual control. Consequently, the surgeon is less likely to lose his or her bearings than with prior art zoom techniques. The zoom unit 37 further provides the capability to automatically zoom in or out by multiple zoom increments in response to a single user input. In that case, zooming in or out may be performed at preset rate, such as one increment per second.
FIG. 5 illustrates a functional block diagram of the zoom unit 37, according to one embodiment. As shown, the zoom unit 37 includes a zoom control circuit 40, a frame memory 41, and pixel and line interpolators 42. The zoom control unit 40 provides addressing signals to frame memory 41 and clocking signals to pixel and line interpolators 42 to control zooming functions. Zoom unit 37 may employ interpolation of pixels and/or lines or any other suitable technique for enlarging images in real-time through the manipulation of data. Hence, video image data are input to the frame memory 41. Zoom unit 37 may receive the data from storage in RAM 35 or nonvolatile memory 36, or from processing and control unit 30. Accordingly, in response to the addressing and clocking signals image data is read from frame memory 41 to the pixel and line interpolators 42 where interpolation takes place. Processed video data representing zoomed images is then output by pixel and line interpolators 42 onto bus system 38, for storage in RAM 35 or non-volatile memory 36 and/or for transmission to other system components, such as the monitor or VCR.
Referring now to FIG. 6, an example of how the digital zoom feature may be used to advantage is now described. FIG. 6 shows internal features of a human body, including the liver 50, the stomach 51, the small intestine 52, the gall bladder 53, and the bile duct 54. Circle 60 corresponds to the general field of view of the camera system, i.e., the field of view corresponding to a non-zoomed image. The surgeon may preselect various zoomed views, such as view 61 of the gall bladder 53 or view 62 of the bile duct 54. Zoomed views 61 and 62 and other zoomed view may be displayed in full-screen format on the monitor. Alternatively, as noted above, one or more zoomed views may be displayed on the monitor in a picture-in-picture manner within the non-zoomed view.
Using the VCS 10, the surgeon can name preselected target areas and save selections, including parameters such as field of view, shutter setting, gain, and lighting levels, for future voice activation during surgery. For example, the gall bladder view 61 can be stored under the name “Gall bladder”, which the surgeon can simply speak into the microphone 12 during surgery to obtain this view. Similarly, the term “Macro” may be used, for example, to instantly view the overall field of view, while the term “Bile Duct” may be used to obtain view 62. Adverbs, such as “slowly” can be added to modify a zoom-related command. For example, the command “Macro, slowly” may be used to instruct the system to progressively zoom out image-by-image at a preset rate to the overall field of view. Thus, the digital zoom capability of the present invention allows near instantaneous zooming of images, thus avoiding valuable time during surgery moving the scope around. The digital zoom feature further enables the surgeon to maintain a better sense of orientation within the field of surgery by allowing quick transitioning between views and by allowing zoomed views to be displayed within the general field of view. The digital zoom feature further is advantageous in that it enables a surgeon to control the zoom feature by spoken voice commands.
Thus, an endoscopic camera system having digital zoom operable in response to voice commands has been described. Although the present invention has been described with reference to specific exemplary embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the invention as set forth in the claims. Accordingly, the specification and drawings are to be regarded in an illustrative sense rather than a restrictive sense.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4891697 *||Nov 1, 1988||Jan 2, 1990||Olympus Optical Co., Ltd.||Electronic endoscope having function of effecting enlargement/reduction processing|
|US4989253 *||Apr 15, 1988||Jan 29, 1991||The Montefiore Hospital Association Of Western Pennsylvania||Voice activated microscope|
|US5261404 *||Jul 8, 1991||Nov 16, 1993||Mick Peter R||Three-dimensional mammal anatomy imaging system and method|
|US5572999 *||Jan 26, 1995||Nov 12, 1996||International Business Machines Corporation||Robotic system for positioning a surgical instrument relative to a patient's body|
|US5815640||Jul 31, 1997||Sep 29, 1998||Computer Motion, Inc.||Automated endoscope system for optimal positioning|
|US5836869 *||Nov 1, 1995||Nov 17, 1998||Olympus Optical Co., Ltd.||Image tracking endoscope system|
|US5876325 *||Sep 30, 1997||Mar 2, 1999||Olympus Optical Co., Ltd.||Surgical manipulation system|
|US5910801 *||Aug 28, 1997||Jun 8, 1999||International Business Machines Corporation||Mechanism for fine-grained and coarse-grained control of zooming in a display of a one-dimensional data set|
|US5945985 *||May 20, 1996||Aug 31, 1999||Technology International, Inc.||Information system for interactive access to geographic information|
|WO1996009587A1||Sep 21, 1995||Mar 28, 1996||Computer Motion, Inc.||A speech interface for an automated endoscopic system|
|WO1997049340A1||Jun 9, 1997||Dec 31, 1997||Computer Motion, Inc.||Multi-functional surgical control system and switching interface|
|1||News article, "Zeus Robotic Surgical System Enables Endoscopic Coronary Anastomosis On a Beating Heart Through Incisions Smaller than the Diameter of a Pencil", downloaded from http://my. excite.com/news/bw/981110/computer-motion on Nov. 16, 1998.|
|2||Press release, "Computer Motion, Inc. Brings Complete Offering of Hermes-Ready(TM) Medical Devices to the Operating Room", Contact: Stephen L. Wilson, Computer Motion, Inc., Oct. 26, 1998, Santa Barbara, CA, downloaded from http://www.computermotion.com/pressr53.htm, 2 pages.|
|3||Press release, "Computer Motion, Inc. Brings Complete Offering of Hermes-Ready™ Medical Devices to the Operating Room", Contact: Stephen L. Wilson, Computer Motion, Inc., Oct. 26, 1998, Santa Barbara, CA, downloaded from http://www.computermotion.com/pressr53.htm, 2 pages.|
|4||Product Information, "The Operating System for the Operating Room", HERMES(TM) downloaded from http://www.computermotion.com/hermes.htm on Nov. 16, 1998, 2 pages.|
|5||Product Information, "The Operating System for the Operating Room", HERMES™ downloaded from http://www.computermotion.com/hermes.htm on Nov. 16, 1998, 2 pages.|
|6||Sackier, M.D., et al., "Robotic's Application in Surgery; Voice Activation of a Surgical Robotic Assistant", The American Journal of Surgery, vol. 174:406-409, Jan. 30, 1997.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US6397286 *||Mar 12, 1998||May 28, 2002||Storz Endoskop Gmbh||Arrangement for the central monitoring and/or control of at least one apparatus|
|US6533721 *||Jul 27, 2001||Mar 18, 2003||Stryker Corporation||Endoscopic camera system with automatic non-mechanical focus|
|US6591239 *||Dec 9, 1999||Jul 8, 2003||Steris Inc.||Voice controlled surgical suite|
|US6642836||Oct 28, 1997||Nov 4, 2003||Computer Motion, Inc.||General purpose distributed operating room control system|
|US6869397||May 31, 2002||Mar 22, 2005||The Board Of Trustees Of The Leland Stanford Junior University||Non-tethered macro-to-micro endoscope|
|US6911916||Jul 13, 2000||Jun 28, 2005||The Cleveland Clinic Foundation||Method and apparatus for accessing medical data over a network|
|US6943663||Dec 9, 2002||Sep 13, 2005||Intuitive Surgical, Inc.||General purpose distributed operating room control system|
|US7057639 *||Feb 28, 2001||Jun 6, 2006||Eastman Kodak Company||Intra-oral camera with integral display|
|US7108687||Sep 18, 2003||Sep 19, 2006||Olympus Corporation||Medical system|
|US7259906||Jan 13, 2004||Aug 21, 2007||Cheetah Omni, Llc||System and method for voice control of medical devices|
|US7319962 *||Dec 6, 2000||Jan 15, 2008||Medtronic, Inc.||Automatic voice and data recognition for implanted medical device instrument systems|
|US7433116||Mar 30, 2004||Oct 7, 2008||Cheetah Omni, Llc||Infra-red light source including a raman shifter|
|US7608039 *||Mar 28, 2006||Oct 27, 2009||Stryker Corporation||Hand-held surgical instrument with illuminated keypad|
|US7633673||Dec 15, 2009||Cheetah Omni, Llc||System and method for generating infrared light for use in medical procedures|
|US7664383 *||Jan 18, 2007||Feb 16, 2010||Sony Ericsson Mobile Communications Ab||Multiple frame photography|
|US7672849 *||Mar 2, 2010||Ge Medical Systems Global Technology Company Llc||Systems and methods for voice control of a medical imaging device|
|US7855727||Sep 15, 2004||Dec 21, 2010||Gyrus Acmi, Inc.||Endoscopy device supporting multiple input devices|
|US7892168 *||Apr 4, 2007||Feb 22, 2011||Hoya Corporation||Confocal endoscope system|
|US7907168 *||May 21, 2002||Mar 15, 2011||Olympus Optical Co., Ltd.||Endoscope system|
|US8026942 *||Jun 29, 2005||Sep 27, 2011||Johnson & Johnson Consumer Companies, Inc.||Skin imaging system with probe|
|US8055108||Nov 8, 2011||Cheetah Omni, L.L.C.||Broadband or mid-infrared fiber light sources|
|US8079950 *||Dec 20, 2011||Intuitive Surgical Operations, Inc.||Autofocus and/or autoscaling in telesurgery|
|US8098423||Jan 17, 2012||Cheetah Omni, Llc||System and method for voice control of medical devices|
|US8199188 *||Nov 7, 2008||Jun 12, 2012||Karl Storz Imaging, Inc.||Video imaging system with a camera control unit|
|US8274559||Sep 25, 2012||Karl Storz Imaging, Inc.||Replaceable hardware component of a camera control unit for video systems|
|US8391660||Mar 5, 2013||Cheetah Omni, L.L.C.||Broadband or mid-infrared fiber light sources|
|US8472108||Jan 12, 2012||Jun 25, 2013||Cheetah Omni, Llc||System and method for voice control of medical devices|
|US8620473||May 14, 2010||Dec 31, 2013||Intuitive Surgical Operations, Inc.||Medical robotic system with coupled control modes|
|US8659646||Oct 11, 2010||Feb 25, 2014||Gyrus Acmi, Inc.||Endoscopy device supporting multiple input devices|
|US8670642||Jan 25, 2013||Mar 11, 2014||Omni Medsci, Inc.||Broadband or mid-infrared fiber light sources|
|US8679011||Jun 25, 2012||Mar 25, 2014||Omni Medsci, Inc.||System and method for voice control of medical devices|
|US8715167||Dec 13, 2011||May 6, 2014||Intuitive Surgical Operations, Inc.||Autofocus and/or autoscaling in telesurgery|
|US8758234||Dec 20, 2012||Jun 24, 2014||Karl Storz Imaging, Inc.||Solid state variable direction of view endoscope|
|US8771177 *||Jan 20, 2012||Jul 8, 2014||Karl Storz Imaging, Inc.||Wide angle flexible endoscope|
|US8848282||Jun 10, 2013||Sep 30, 2014||Omni Medsci, Inc.||System and method for voice control of medical devices|
|US8864652||Dec 17, 2008||Oct 21, 2014||Intuitive Surgical Operations, Inc.||Medical robotic system providing computer generated auxiliary views of a camera instrument for controlling the positioning and orienting of its tip|
|US8903546||Aug 15, 2009||Dec 2, 2014||Intuitive Surgical Operations, Inc.||Smooth control of an articulated instrument across areas with different work space conditions|
|US8918211||Feb 12, 2010||Dec 23, 2014||Intuitive Surgical Operations, Inc.||Medical robotic system providing sensory feedback indicating a difference between a commanded state and a preferred pose of an articulated instrument|
|US8944070||Mar 30, 2005||Feb 3, 2015||Intuitive Surgical Operations, Inc.||Non-force reflecting method for providing tool force information to a user of a telesurgical system|
|US8971681||Nov 5, 2013||Mar 3, 2015||Omni Medsci, Inc.||Broadband or mid-infrared fiber light sources|
|US8992418||Sep 16, 2005||Mar 31, 2015||Karl Storz Imaging, Inc.||Video recording and image capture device|
|US8992423||Jun 23, 2014||Mar 31, 2015||Karl Storz Imaging, Inc.||Solid state variable direction of view endoscope|
|US8996098||Sep 12, 2013||Mar 31, 2015||Donald Spector||System and method for diagnosing and treating disease|
|US9007450||Feb 29, 2012||Apr 14, 2015||Karl Storz Imaging, Inc.||Video imaging system with detachable storage device|
|US9055868||Sep 3, 2014||Jun 16, 2015||Omni Medsci, Inc.||System and method for voice control of medical devices|
|US9060674||Oct 11, 2012||Jun 23, 2015||Karl Storz Imaging, Inc.||Auto zoom for video camera|
|US9066736||Aug 23, 2011||Jun 30, 2015||Omni Medsci, Inc.||Laser-based method and system for selectively processing target tissue material in a patient and optical catheter assembly for use therein|
|US9077146||Feb 21, 2014||Jul 7, 2015||Omni Medsci, Inc.||Broadband or mid-infrared fiber light sources|
|US9084623||Nov 5, 2009||Jul 21, 2015||Intuitive Surgical Operations, Inc.||Controller assisted reconfiguration of an articulated instrument during movement into and out of an entry guide|
|US9089256||Jun 23, 2009||Jul 28, 2015||Intuitive Surgical Operations, Inc.||Medical robotic system providing an auxiliary view including range of motion limitations for articulatable instruments extending out of a distal end of an entry guide|
|US9101397||Aug 21, 2013||Aug 11, 2015||Intuitive Surgical Operations, Inc.||Real-time generation of three-dimensional ultrasound image using a two-dimensional ultrasound transducer in a robotic system|
|US9138129||Nov 11, 2011||Sep 22, 2015||Intuitive Surgical Operations, Inc.||Method and system for moving a plurality of articulated instruments in tandem back towards an entry guide|
|US9164032||Dec 17, 2013||Oct 20, 2015||Omni Medsci, Inc.||Short-wave infrared super-continuum lasers for detecting counterfeit or illicit drugs and pharmaceutical process control|
|US9179051||Jun 2, 2014||Nov 3, 2015||Clara Stoudt||Voice-activated hands-free camera holder systems|
|US9232984||Nov 10, 2010||Jan 12, 2016||Intuitive Surgical Operations, Inc.||Real-time generation of three-dimensional ultrasound image using a two-dimensional ultrasound transducer in a robotic system|
|US9333042||Dec 3, 2013||May 10, 2016||Intuitive Surgical Operations, Inc.||Medical robotic system with coupled control modes|
|US9345387||Jun 13, 2007||May 24, 2016||Intuitive Surgical Operations, Inc.||Preventing instrument/tissue collisions|
|US20020026093 *||Aug 23, 2001||Feb 28, 2002||Kabushiki Kaisha Toshiba||Endscope system|
|US20020118279 *||Feb 28, 2001||Aug 29, 2002||Eastman Kodak Company||Intra-oral camera with integral display|
|US20020175992 *||May 21, 2002||Nov 28, 2002||Teruo Eino||Endoscope system|
|US20030009086 *||May 31, 2002||Jan 9, 2003||Black Michael D.||Non-tethered macro-to-micro endoscope|
|US20030123856 *||Dec 28, 2001||Jul 3, 2003||David Chatenever||Replaceable hardware component of a camera control unit for video systems|
|US20030197590 *||Dec 9, 2002||Oct 23, 2003||Yulun Wang||General purpose distributed operating room control system|
|US20040028390 *||Dec 28, 2001||Feb 12, 2004||David Chatenever||Replaceable hardware component of a camera control unit for video systems|
|US20040124964 *||Sep 18, 2003||Jul 1, 2004||Computer Motion, Inc.||General purpose distributed operating room control system|
|US20040133072 *||Sep 15, 2003||Jul 8, 2004||Kennedy Bruce L.||Video recording and image capture device|
|US20040172011 *||Nov 26, 2003||Sep 2, 2004||Yulun Wang||Multi-functional surgical control system and switching interface|
|US20040204627 *||Sep 18, 2003||Oct 14, 2004||Olympus Optical Co., Ltd.||Medical system|
|US20040245227 *||Jul 25, 2002||Dec 9, 2004||Clive Grafton-Reed||System and method for delivering an energy beam to selected impinge points on a work piece|
|US20050182296 *||Apr 13, 2005||Aug 18, 2005||Olympus Corporation||Medical system|
|US20050200324 *||Mar 30, 2005||Sep 15, 2005||Intuitive Surgical Inc.||Non-force reflecting method for providing tool force information to a user of a telesurgical system|
|US20050267553 *||May 5, 2005||Dec 1, 2005||Doug Staunton||System and method for controlling electrical stimulation and radiofrequency output for use in an electrosurgical procedure|
|US20060015008 *||Sep 16, 2005||Jan 19, 2006||Kennedy Bruce L||Video recording and image capture device|
|US20060050144 *||Sep 16, 2005||Mar 9, 2006||Kennedy Bruce L||Video recording and image capture device|
|US20060055793 *||Sep 15, 2004||Mar 16, 2006||Acmi Corporation||Endoscopy device supporting multiple input devices|
|US20060241575 *||Jun 21, 2006||Oct 26, 2006||Yulun Wang||Multi-functional surgical control system switching interface|
|US20070083098 *||Sep 29, 2005||Apr 12, 2007||Intuitive Surgical Inc.||Autofocus and/or autoscaling in telesurgery|
|US20070203396 *||Feb 27, 2007||Aug 30, 2007||Mccutcheon John G||Endoscopic Tool|
|US20070233499 *||Jun 12, 2007||Oct 4, 2007||Ge Medical Systems Global Technology Co., Llc||Systems and Methods for Voice Control of a Medical Imaging Device|
|US20070236782 *||Apr 4, 2007||Oct 11, 2007||Pentax Corporation||Confocal endoscope system|
|US20080004603 *||Jun 29, 2006||Jan 3, 2008||Intuitive Surgical Inc.||Tool position and identification indicator displayed in a boundary area of a computer display screen|
|US20080065109 *||Jun 13, 2007||Mar 13, 2008||Intuitive Surgical, Inc.||Preventing instrument/tissue collisions|
|US20080155433 *||Dec 21, 2006||Jun 26, 2008||Microsoft Corporation||Zooming task management|
|US20080175575 *||Jan 18, 2007||Jul 24, 2008||Sony Ericsson Mobile Communications Ab||Multiple frame photography|
|US20090123135 *||Nov 7, 2008||May 14, 2009||Amling Marc R||Image capture module|
|US20090192523 *||Mar 31, 2009||Jul 30, 2009||Intuitive Surgical, Inc.||Synthetic representation of a surgical instrument|
|US20090192524 *||Mar 31, 2009||Jul 30, 2009||Intuitive Surgical, Inc.||Synthetic representation of a surgical robot|
|US20090204110 *||Feb 5, 2009||Aug 13, 2009||Omni Sciences, Inc.||Broadband or Mid-Infrared Fiber Light Sources|
|US20090326318 *||Dec 31, 2009||Intuitive Surgical, Inc.||Medical robotic system providing an auxilary view including range of motion limitations for articulatable instruments extending out of a distal end of an entry guide|
|US20090326553 *||Jun 27, 2008||Dec 31, 2009||Intuitive Surgical, Inc.||Medical robotic system providing an auxiliary view of articulatable instruments extending out of a distal end of an entry guide|
|US20090326556 *||Dec 17, 2008||Dec 31, 2009||Intuitive Surgical, Inc.||Medical robotic system providing computer generated auxiliary views of a camera instrument for controlling the positioning and orienting of its tip|
|US20100274087 *||May 14, 2010||Oct 28, 2010||Intuitive Surgical Operations, Inc.||Medical robotic system with coupled control modes|
|US20110029733 *||Feb 3, 2011||Gyrus Acmi, Inc.||Endoscopy device supporting multiple input devices|
|US20110040305 *||Nov 5, 2009||Feb 17, 2011||Intuitive Surgical, Inc.||Controller assisted reconfiguration of an articulated instrument during movement into and out of an entry guide|
|US20110105898 *||May 5, 2011||Intuitive Surgical Operations, Inc.||Real-Time Generation of Three-Dimensional Ultrasound image using a Two-Dimensional Ultrasound Transducer in a Robotic System|
|US20110175989 *||Jul 21, 2011||Cheetah Omni, Llc||System and method for voice control of medical devices|
|US20110202068 *||Aug 18, 2011||Intuitive Surgical Operations, Inc.||Medical robotic system providing sensory feedback indicating a difference between a commanded state and a preferred pose of an articulated instrument|
|US20120116158 *||Jan 20, 2012||May 10, 2012||Hale Eric L||Wide Angle Flexible Endoscope|
|US20120296212 *||Jul 30, 2012||Nov 22, 2012||Toshiba Medical Systems Corporation||Ultrasound diagnostic apparatus, control method, and image processing apparatus|
|US20140012139 *||Jun 10, 2013||Jan 9, 2014||Covidien Lp||Surgical camera assemblies and systems|
|EP1277432A1 *||Jul 17, 2001||Jan 22, 2003||Byteworks GmbH & Co. KG||Apparatus for viewing and taking pictures of objects in the mouth of a patient and processing|
|WO2007100846A2 *||Feb 27, 2007||Sep 7, 2007||Emphasys Medical, Inc.||Endoscopic tool|
|WO2007100846A3 *||Feb 27, 2007||Mar 6, 2008||Michael Barrett||Endoscopic tool|
|U.S. Classification||600/109, 600/118, 600/168|
|Cooperative Classification||A61B1/00039, A61B1/042|
|European Classification||A61B1/00C6, A61B1/04D|
|Jan 4, 1999||AS||Assignment|
Owner name: STRYKER CORPORATION, MICHIGAN
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHANG, WILLIAM H.L.;YAP, MARKUS;HAMEED, SALMAAN;AND OTHERS;REEL/FRAME:009695/0622;SIGNING DATES FROM 19981230 TO 19990104
|Nov 1, 2004||FPAY||Fee payment|
Year of fee payment: 4
|Sep 30, 2008||FPAY||Fee payment|
Year of fee payment: 8
|Sep 28, 2012||FPAY||Fee payment|
Year of fee payment: 12