|Publication number||US5719622 A|
|Application number||US 08/606,052|
|Publication date||Feb 17, 1998|
|Filing date||Feb 23, 1996|
|Priority date||Feb 23, 1996|
|Publication number||08606052, 606052, US 5719622 A, US 5719622A, US-A-5719622, US5719622 A, US5719622A|
|Original Assignee||The Regents Of The University Of Michigan|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (17), Referenced by (97), Classifications (20), Legal Events (7)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This invention relates generally to the use of video telecommunications to control remotely located devices. More particularly, this invention relates to the use of a remotely directed pointing device to select, operate, and control devices at a remote site.
The availability of relatively inexpensive transmission of video signals has increased dramatically over the last few years. Specifically, many phone and cable television companies have been allowed by the Federal Communications Commission (FCC) to install bundled telephone and cable television systems using the most recent technologies, typically fiber optic cables. With the proliferation of such systems and the bundling of telephone and video communications, it is readily apparent that in the near future traditional audio telephone communications will most likely migrate towards audio/video communications systems. Such audio/video communications systems will typically have an operator at a site receiving audio and video signals so that the operator may both view and listen to what occurs at a remote site, and vise versa for an operator at the opposite site.
Simple audio/video communication systems include merely fixed cameras and video monitors at at least one and often both sites. A method and apparatus for controlling pointers in video images at remote sites from local sites is disclosed in U.S. Ser. No. 07/989,126, filed Dec. 11, 1992, entitled System and Method for Teleinteraction, now U.S. Pat. No. 5,444,476, issued Aug. 22, 1995, assigned to the Assignee of the present invention and herein incorporated by reference. A method and apparatus for controlling remote devices using a visual information stream may be found with reference to U.S. Ser. No. 08/404,886, filed Mar. 16, 1995, entitled Apparatus and Method for Remote Control Using a Visual Information Stream, assigned to the assignee of the present invention and also herein incorporated by reference. Improved systems may enable a operator to track around the room to enable the remote operator increased flexibility for viewing the remote site.
Some remote control systems include video capabilities of the type described above. The remote control systems enable the operator to visually scan the remote location and provide the operator with the capability of remotely operating devices as if the operator is actually in the room, rather than at the remote site. However, these systems are extremely expensive and usually are highly specialized, turn-key systems. These systems also often require expensive equipment such as robots which physically contact the controlled devices or require hardwired connections which transmit control signals to operate the controlled devices.
There also exists remote control systems which do not use video, but enable a user to communicate with particular devices remotely over phone lines. Typically, the operator initiates communication with the remote site over a phone line and enters commands through a computer and modem or through the touch tone pad of the phone to select and control devices. The system may or may not generate computer codes or confirmation tones to indicate to the operator that a command has been received. These systems lend themselves to controlling lights, appliances, entertainment centers, and almost any electronic device. These remote control systems do not, however, provide the user with any visual feedback that the desired, remotely controlled device has been selected. Nor do these systems provide any assurance that no other device has been inadvertently selected. Even with feedback from the system, however, the operator has no definite visual indication regarding which device was properly selected and controlled.
Thus, no remote control system combines a simple, inexpensive configuration of remote selection and control device with video capabilities so that the user can observe devices available for selection and operation and observe proper selection of a device. Further, no remote control system currently exists which may be easily adapted to a remote video system to enable the user to ascertain point to devices available for selection and control and receive visual feedback that the particular devices selected by the operator have indeed been selected. No simple, inexpensive remote selection and control system provides definitive visual feedback so as to give the operator the assurance that the device selected by the operator was indeed the targeted device.
Thus, it is desirable to provide a simple, inexpensive remote selection and control system which enables an operator to view a remote site and to select, and optionally control, particular devices.
A telecommunications system in which video images originate at a remote site and are displayed at a local site. The remote site includes at least one device which may be selected by an operator at the local site. The telecommunications system selects at least one of the devices at the remote site. A camera at the remote site may be oriented in a plurality of positions in accordance with control commands originating at the local site. A pointing device projects a focused electromagnetic signal and moves in accordance with the camera. The focused electromagnetic signal also provides a visual indication of the orientation of the pointing device, and the camera detects the visual indication so that the operator can determine the orientation of the pointing device. A signal detects the focused electromagnetic signal when directed thereon and generates an activation signal in response to detecting the electromagnetic signal. A controlled device is associated with the receiver and is actuated in accordance with the activation signal, where the controlled device is at least one of the above-mentioned devices. The operator selects the controlled device by directing the focused electromagnetic signal on the signal receiver.
Further objects, features and advantages of the invention will become apparent from a consideration of the following description and the appended claims when taken in connection with the accompanying drawings.
FIG. 1 depicts the visual control apparatus disclosed according to the principles of the present invention;
FIG. 2 depicts a visual representation of an exemplary image which appears on the monitor at the local site;
FIG. 3 depicts a visual control apparatus mechanism operable to control more than one device at the remote site;
FIG. 4 depicts a visual control apparatus having one transponder for selecting one of a plurality of devices to control;
FIGS. 5a, 5b, and 5c depict different filtering schemes to limit transient light energy from inadvertently activating a selectable device;
FIG. 6 depicts a visual control apparatus having a modulator for modulating the laser beam so that control commands may be encoded through modulation of the laser beam;
FIG. 7 depicts a visual control selection mechanism in which a computer provides control information to the remotely selected device; and
FIG. 8 depicts a visual control selection mechanism in which control information may be encoded in a visual information stream.
FIG. 1 depicts a diagram of the remote control selection system 10 arranged in accordance with the principles of this invention. The remote control selection system 10 includes a local site 12 and a remote site 14. By convention, local site 12 refers to the controlling site or the site where an operator resides and directs control of devices at remote site 14. Similarly, remote site 14 refers to the site having the controlled device or devices and where an operator may, but need not, be located. A camera 16 located at remote site 14 includes a lens 18 to capture video images and an optional microphone 20 to capture audio signals at remote site 14. Camera 16 mounts to a base 22 having an upwardly telescoping neck 24 which enables telescopic and rotational or panning movement of camera 16 and associated lens 18. Camera 16 may also tilt in a vertical direction about a swivel 26. Thus, camera 16 moves through three degrees of freedom about telescoping neck 24 and swivel 26 to scan substantially the entirety of the room. Base 22 may also attach to a stationary foundation, or in the alternative, to a moveable platform for translation over the surface on which it is positioned, to provide a fourth degree of freedom.
A pointer support 28 extends upwardly from camera 16. Pointer support 28 provides a mounting location for a laser pointer 30 which emits a focused signal embodied as electromagnetic radiation. In the invention described herein, the electromagnetic radiation comprises a laser beam and will be referred to throughout the specification as such. One skilled in the art will recognize that any of a number of various encodeable electromagnetic signals would readily substitute for the laser. Control transmitter 32 then mount on top of laser pointer 30. Control transmitter 32 emits and receives electromagnetic radiation, distinct from those signals emitted by laser pointer 30, to provide control commands to the devices following selection. In the invention described herein, control transmitter 32 emits and receives electromagnetic radiation in the form of infrared (IR) signals.
Movement of camera 16 is remotely directed by an operator at local site 12 by a joystick 34 or other directional device. Movement of the joystick 34 generates control signals which are transmitted to camera base 22 via control line 36. Movement of joystick 34 results in a corresponding pan, tilt, or telescoping motion of camera 16 about the telescoping neck 24 and/or swivel 26. The camera 16 outputs a signal transmitted from remote site 14 to local site 12 via audio/video line 38 which provides a signal for input to television or monitor 40. Monitor 40 displays the video image captured by lens 18 of camera 16. Camera 16 may also output an audio signal transmitted from remote site 14 to local site 12 via audio/video line 38. The audio signal transmitted represents the audio information captured by microphone 20. At local site 12, switch box 42 has a toggle switch 44 and outputs a signal on line 46 from local site 12 to remote site 14. The signal output by toggle switch 44 activates and deactivates laser pointer 30 so that laser pointer 30 outputs a focused laser beam when activated. A remote controller 48 located at local site 12 sends and receives specific device control information to and from control transmitter 32 on signal line 50.
In operation, when the user desires to select a device, the user closes the toggle switch 44 of switch box 42. Closing the toggle switch 44 activates the laser pointer 30 so that the laser pointer 30 projects a focused laser beam 52. Through operation of joystick 34, the operator varies the orientation of camera 16, the attached laser pointer 30, and control transmitter 32. The operator may view the monitor 40 in order to determine where the laser beam 52 points because the monitor 40 displays the scene captured by camera 16. Through manipulation of joystick 34, the operator guides the laser beam 52 to point at a transponder 56. When the laser beam 52 illuminates transponder 56, transponder 56 generates an output signal to the controlled device 68 on control line 58. The transponder 56 also generates an activation signal to a device select light 60 which is actuated when the laser beam 52 is directed to the face 62 of transponder 56. Activating device select light 60 provides visual feedback to the operator at local site 12 that the operator has selected transponder 56.
Transponder 56 also provides an enable signal to control receiver 64. Control receiver 64 receives the signal emitted by control transmitter 32 and decodes the received signal into a control signal for output on line 66 to the controlled device 68. The control commands generated by control transmitter 32 are input by the operator at remote controller 48 which sends and receives command and status information to and from control transmitter 32 on signal lines 50. Thus, after the operator has activated the laser pointer 30 using toggle switch 44 and illuminated the transponder 56, the operator may then control the controlled device 68 through remote controller 48. Control transmitter 32 generates electromagnetic signals encoded for receipt by control receiver 64. Control receiver 64 then decodes the signals into control commands applied to controlled device 68.
FIG. 2 depicts an exemplary image viewed by the operator at the local site 12 on monitor 40. Within the image of monitor 40, the laser beam 52 remains fixed in, for example, the center of the image. Because the laser pointer 30 is generally fixed with respect to the camera lens 18, the image of the position of laser beam 52 should remain fixed in a predetermined position in accordance with the orientation of the laser pointer 30 with respect to the camera lens 18. Thus, as the operator manipulates the joystick 34 to pan and tilt the camera 16, the laser pointer 30 moves accordingly as well, thereby maintaining the laser beam 52 at a substantially fixed position with respect to lens 18. Of course, it will be understood by one skilled in the art that the position of laser beam 52 on monitor 40 will be affected by the parallax caused by separation between the axis of the camera lens 18 and the axis of the laser beam 52.
FIG. 2 further depicts device select light 60, transponder 56, and control receiver 64, occupying a first position A, shown in phantom in the lower left section of monitor 40, and occupying a second position B in the center of monitor 40. The operator uses the joystick 34 to manipulate the camera 16 to reposition these devices within the monitor 40. For example, if the operator desires to select transponder 56 occupying at position A, the operator would manipulate joystick 34 so that the camera moves in the direction of transponder 56 at position A, translating transponder 56 toward position B in the center of monitor 40, as indicated by the arrow. By using joystick 34, the operator translates select light 60, transponder 56, and control receiver 64 from their initial position A in the lower left to position B in the center of monitor 40. At position B when the laser beam 52 strikes the transponder 56, device select light 60 illuminates, indicating to the operator has selected transponder 56b. When the laser beam 52 moves off transponder 56 at position A, transponder 56 is no longer selected.
In addition to the configuration of FIG. 2, where the transponder 56 for selection is readily visible, one skilled in the art will appreciate that transponder 56 need not be as readily visible on monitor 40. In specific instances requiring privacy or security, transponder 56 may be concealed within the background of the remote site so that the only an operator familiar with the remote site can select the concealed transponder. Selection of the concealed transponder may be acknowledged by activation of a device select light 60b. Optionally, one skilled in the art will appreciate that in certain instances, one may elect not to acknowledge selection to provide greater privacy and confidentiality.
In a second embodiment of the remote control selection, FIG. 3 depicts a remote control selection system 70. Remote control selection system 70 is configured similarly to the remote control selection system 10 of FIG. 1, but further includes a plurality of controlled devices which may be controlled from the local site 12. It should be noted that with respect to FIG. 3 and throughout this specification, like reference numerals designate like components throughout the figures and a prime (') or letter designation may be appended to a reference numeral to designate like components within the same or other drawings. Further, note that some components will only be defined in FIG. 1, but are present in the succeeding embodiments described herein, though not described.
With respect to FIG. 3, at least one of a plurality of controlled devices 68, 68', and 68" may be selected by orienting laser pointer 30 to direct the laser beam 52 at any of transponders 56, 56', or 56". When the laser beam 52 activates a transponder (56', for example), the transponder 56' generates an output signal on control line 58' which enables operation of controlled device 68' an activates device select light 60'. When actuated, transponder 56' also provides an enable signal to control receiver 64' which receives electromagnetic control signals output by control transmitter 32. The control receiver 64' receives the electromagnetic control signals, decodes the control signals, and provides control signals to controlled device 68' on control line 66'. It will be understood by one skilled in the art that the operator may direct laser beam 52 to transponder 56 or 56" to effect operation of controlled devices 68 and 68", respectively. Operation of the controlled devices 68' and 68" occurs similarly as described with respect to controlled device 68'.
With respect to FIGS. 1 and 3, it will be understood by one skilled in the art that the remote control selection systems 10 and 70 may be simplified to mere selection systems in which the laser pointer 30 directs laser beam 52 to select a particular device to be controlled from the local site 12. For example, in remote control systems in which mere selection is required for actuation and no control commands need be transmitted, remote controller 48, control transmitter 32, and control receiver 64 may be eliminated to provide a simple, less expensive system in which only selection and actuation are required.
Referring to FIG. 4, yet another embodiment of the invention is disclosed in remote control selection system 80. Local site 12 is as described with respect to FIGS. 1 and 3. The remote site 14 is substantially as described with respect to FIGS. 1 and 3, but further includes a plurality of controlled devices 68, 68', and 68". Each of the plurality of controlled devices 68, 68', and 68" is controlled through one transponder 82. When laser pointer 30 is oriented so that laser beam 52 illuminates transponder 82, transponder 82 enables at least one of the controlled devices 68, 68', and 68". When this occurs the transponder 82 actuates device select light 84 to indicate to the operator at local site 12 that the transponder 82 has been illuminated. Through camera 16, an operator at the local site 12 can observe illumination of light 84. Once transponder 82 is selected, control receiver 86 is activated to receive input from control transmitter 32. The operator at the local site 12 generates control commands on remote controller 48 which select which of the controlled devices 68, 68', or 68" to control and a particular command to issue to the particular selected device. Controller transmitter 32 receives control signals generated by remote controller 48 and provides an electromagnetic (IR) signal received by control receiver 86. Control receiver 86 decodes the electromagnetic signal and provides output signals on at least one of the selected control lines 58, 58', or 58". Note that remote controller 48 preferable may control any of the controlled devices 68, 68', or 68" after the laser beam 52 has selected transponder 82. Transponder 84 may alternatively include a sensor for each controlled device which it operated or may determine the controlled device to operate in accordance with a predetermined illumination scheme.
In the embodiments of FIGS. 1-4, the transponders have been assumed to operate only in response to illumination by the laser beam 52. However, in some environments, transient light could falsely activate the transponder. It is thus preferable in some instances to filter light input to the transponders. FIGS. 5a-5c depict various embodiments for filtering light input to a transponder (56, for example). Referring to FIG. 5a, the laser pointer 30 receives an electrical signal in accordance with the position of toggle switch 44 of FIGS. 1-4. The electrical signal determines actuation of switch 90. A first signal level opens switch 90, and a second signal level closes switch 90. When switch 90 is closed the laser pointer 30 produces a laser beam 52 for detection by transponder 56. The transponder 56 of FIG. 5a includes a photo-detector 92 which outputs a signal to amplifier 94 in response to the detection of light. Amplifier 94 amplifies and otherwise conditions the signal. The output from amplifier 94 is then input to threshold detector 96. When the intensity of the signal detected by photo-detector 92 exceeds a predetermined value, threshold detector 96 outputs an enable signal to the controlled device 68 (not shown in FIG. 5a).
While the configuration of FIG. 5a operates sufficiently to detect the laser beam 52, an improved configuration depicted in FIG. 5b provides more robust light detection and substantially reduces the detection of transient light which may falsely activate transponder 56. The apparatus of FIG. 5b operates similarly to the apparatus described in FIG. 5a. The transponder 56 of FIG. 5b further includes a filter 98 inserted before photo-detector 92. Filter 98 narrows the bandwidth of light incident on photo-detector 92 to the frequency of laser pointer 30. In this manner, the filter 98 limits light incident upon photo-detector 92 substantially to light of the frequency of laser pointer 30.
FIG. 5c depicts the use of a modulator 100 to modulate the output of laser 30 and provided added security against undesired actuation of transponder 56. A modulator 100 modulates the laser beam 52 output by laser pointer 30 so that the transponder 56 is actuated only in response to receipt of a modulated laser beam. Modulator 100 provides a modulation signal to laser pointer 30 which in turn outputs a modulated laser beam 52 in accordance with the modulation signal output by modulator 100. The modulator 100 includes an internal waveform generator to provide a signal envelope for controlling modulation of the laser beam 52. Common examples of such modulation include amplitude modulation (AM) or pulse code modulation (PCM). In addition to the above described modulation, the transponder 56 of FIG. 5c also includes a filter 98 for limiting the transient light incident upon the photo-detector 92 to light at the frequency of the laser beam 52.
In operation with a modulated signal, the modulated laser beam 52 strikes photo-detector 92 causing photo-detector 92 to output a signal to amplifier 94. Amplifier 94 in turn outputs an amplified signal to a second filter 102. Filter 102 is tuned to pass primarily signals at the carrier or modulation frequency of modulator 100 or a pulse code in accordance with the particular manner of modulation. Thus, only lasers having the properly modulated signal will yield input to threshold detector 96. Threshold detector 96 outputs an enable signal upon the receipt of a proper level of output signal from filter 102.
FIG. 6 presents an additional manner of exploiting the laser beam following selection of a particular device. Whereas in FIG. 5c modulation provides security against false actuation, modulation as described with respect to FIG. 6 provides security and enables the transmission of data and commands from the local site controller to the selected device using modulation of the laser beam. A modulator 112 receives control input from toggle switch 44 and remote controller 48. Toggle switch 44 provides a signal which activates and deactivates laser pointer 30, and may optionally operate laser pointer 30 directly. Remote controller 48 provides a signal to modulator 112 having control information which modulator 112 encodes into a format which may be read and interpreted by demodulator 120. Examples of modulation schemes for transmitting data and control commands from the remote site to the selected device include pulse code modulation (PCM), pulse position modulation (PDM), and pulse duration modulation (PDM). When the modulated laser beam 114 strikes transponder 116, transponder 116 illuminates device select light 118, indicating that the transponder 116 has been enabled. Transponder 116 outputs the modulated signal to demodulator 120 which demodulates the signals and provides a control input to controlled device 68 on signal line 122. In addition to transmitting data to the controlled device through the modulated laser beam 114, the modulator 112 may further employ AM or other modulation to guard against transient light inadvertently activating a transponder. FIG. 6 provides the additional advantage that the laser pointer 30 not only selects specific devices, but also provides control input encoded in the laser beam 114 using an encoding scheme.
FIG. 7 depicts yet another embodiment for providing control signals from local site 12 to remote site 14. In FIG. 7, the monitor 40 at the local site 12 receives video signals from the camera 16 over a video link, such as an Integrated Services Digital Network (ISDN) video link. A computer 130 generates control commands for operating a controlled device (not shown in FIG. 7). The computer 130 outputs control command via a standard telephone link. The control commands are output to a modem 132 which is connected to a phone line 134. At the remote site 14, a second modem 136 receives the signal over the telephone link from the local site 12 and converts signal back to the control commands for input to the computer 138. Computer 138 decodes the input signal at the remote site 14 and generates a control signal for directing the selected controlled device 68 to perform specific operations.
In yet another embodiment for providing control commands to the remote site 14 from local site 12, FIG. 8 depicts an embodiment in which a visual interpreter as described in U.S. Ser. No. 08/404,886 decodes control command to operate devices at the remote site 14. Such a configuration is particularly applicable where two-way video communication using ISDN, cable television (CTV) or the like is employed. The incoming video signal received from remote site 14 is input to the visual signaller 140. The operator uses visual signaler 140 to overlay control commands onto the incoming video signal. The overlaid control commands are then output to the monitor 40 and to the remote site 14 via the two-way video communication link. The signal received back at the remote site 14 is input to a splitter 142 which splits the signal for output to remote monitor 144 and to a visual interpreter 146. Visual interpreter 146 then decodes the command overlaid onto the video signal by visual signaler 140 and outputs the appropriate control signal to operate the controlled device (not shown in FIG. 8) as selected using laser pointer 30. Operation of the visual signaler 140 and visual interpreter 146 is as described in U.S. Ser. No. 08/404,886.
The visual interpreter 146 decodes the commands overlaid onto the video signal and outputs control signals for operating the controlled device 68. The control signals may be either hard wired to the controlled device or alternatively may be transmitted electromagnetically. The commands are received and decoded by a control receiver 64 and input to controlled device 68. In the embodiment of FIG. 8, the visual interpreter 146 may further decode the overlaid video signal and generate control commands output on control line 150 and input to camera 16 to control the pan, tilt, and zoom of the camera 16. Further, once a particular transponder 56 is selected, control receiver 64 may output a signal received by visual interpreter 146. The control signal received by visual interpreter 146 provides the visual interpreter 146 with information regarding a menu of available commands for controlling the controlled device. Visual interpreter 146 outputs this menu of available commands on the video signal output by remote site 14. The menu is then interpreted by the visual signaler 140 and provides the operator with the available menu of commands.
From the foregoing, it can be seen that use of a pointing device in a remote site to select particular devices for control from a local site provides the advantage that particular devices may be selected relatively easily, in both digital and analog video applications. Thus, the operator may freely explore the remote environment to observe which devices are available for control, and select particular devices to exercise said control. Further, in more sophisticated implementations, the selected device can provide feedback information to be overlaid onto the video signal returned to the local site indicating an available menu of commands for selection by the user. The user may then select among these command to control the remotely located device by using an iconic pointer at remote site.
While the above detailed description describes the preferred embodiment of the present invention, it will be understood that the present invention is susceptible to modification, variation and alteration without deviating from the scope and fair meaning of the subjoined claims.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US3984628 *||Jan 13, 1975||Oct 5, 1976||Paul Grayson Sharp||Remote camera-position control|
|US4280135 *||Jun 1, 1979||Jul 21, 1981||Schlossberg Howard R||Remote pointing system|
|US4503506 *||Aug 5, 1981||Mar 5, 1985||Westinghouse Electric Corp.||Apparatus for mapping and identifying an element within a field of elements|
|US4716465 *||Aug 20, 1986||Dec 29, 1987||Peter Meyer||Device for wireless video monitoring and control of a still camera|
|US4974088 *||May 12, 1989||Nov 27, 1990||Maruwa Electronic & Chemical Company||Remote control apparatus for a rotating television camera base|
|US5045843 *||Dec 6, 1988||Sep 3, 1991||Selectech, Ltd.||Optical pointing device|
|US5049988 *||Aug 10, 1989||Sep 17, 1991||Pearpoint Limited||Scanning T.V. camera|
|US5073824 *||Jun 15, 1990||Dec 17, 1991||Vertin Gregory D||Remote control and camera combination|
|US5179421 *||Aug 20, 1990||Jan 12, 1993||Parkervision, Inc.||Remote tracking system particularly for moving picture cameras and method|
|US5268734 *||May 31, 1990||Dec 7, 1993||Parkervision, Inc.||Remote tracking system for moving picture cameras and method|
|US5383044 *||Sep 18, 1992||Jan 17, 1995||Recoton Corporation||Systems, methods and apparatus for transmitting radio frequency remote control signals|
|US5444476 *||Dec 11, 1992||Aug 22, 1995||The Regents Of The University Of Michigan||System and method for teleinteraction|
|US5465144 *||Oct 19, 1994||Nov 7, 1995||Parkervision, Inc.||Remote tracking system for moving picture cameras and method|
|US5517300 *||Feb 17, 1994||May 14, 1996||Parkervision, Inc.||Remote controlled tracking system for tracking a remote control unit and positioning and operating a camera|
|US5528289 *||Jan 17, 1995||Jun 18, 1996||Videoconferencing Systems, Inc.||Method for automatically adjusting a videoconferencing system camera to center an object|
|US5561519 *||Jun 6, 1995||Oct 1, 1996||Parkervision, Inc.||Remote-controlled tracking system for tracking a remote control unit and positioning and operating a camera and method|
|US5598209 *||Jan 17, 1995||Jan 28, 1997||Videoconferencing Systems, Inc.||Method for automatically adjusting a video conferencing system camera|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US5884096 *||Nov 12, 1997||Mar 16, 1999||Apex Pc Solutions, Inc.||Interconnection system for viewing and controlling remotely connected computers with on-screen video overlay for controlling of the interconnection switch|
|US6161933 *||Jul 14, 1997||Dec 19, 2000||Arnold & Richter Cine Technik Gmbh & Co. Betriebs Kg||Device for controlling, regulating and monitoring a motion-picture camera|
|US6304895||Jul 23, 1999||Oct 16, 2001||Apex Inc.||Method and system for intelligently controlling a remotely located computer|
|US6380968 *||Jan 6, 1998||Apr 30, 2002||Intel Corporation||Method and apparatus for controlling a remote video camera in a video conferencing system|
|US6433826 *||Mar 26, 1998||Aug 13, 2002||Umax Data System Inc.||Adjusting mechanism for the lens set of an imaging system|
|US6614465||Oct 18, 2001||Sep 2, 2003||Intel Corporation||Method and apparatus for controlling a remote video camera in a video conferencing system|
|US6690003 *||Mar 25, 2002||Feb 10, 2004||Zak Artur||Laser actuated remote operator|
|US6714238 *||Mar 11, 1997||Mar 30, 2004||Canon Kabushiki Kaisha||Video/audio communication system with confirmation capability|
|US6724429||Apr 22, 2002||Apr 20, 2004||Panavision, Inc.||System for sensing and displaying lens data for high performance film and video cameras and lenses|
|US6798459 *||Sep 1, 2000||Sep 28, 2004||Sony Corporation||Apparatus and method for transmitting and receiving, as an electric wave, a signal generated by electronic equipment, and a control signal to control operation of the electronic equipment|
|US6819867||May 29, 2002||Nov 16, 2004||Panavision, Inc.||Hand-held remote control and display system for film and video cameras and lenses|
|US6980485||Oct 25, 2001||Dec 27, 2005||Polycom, Inc.||Automatic camera tracking using beamforming|
|US6982697 *||May 31, 2002||Jan 3, 2006||Microsoft Corporation||System and process for selecting objects in a ubiquitous computing environment|
|US7050093 *||Jun 1, 1999||May 23, 2006||Industrial Electric Industrial Co., Ltd.||Video camera pivoting apparatus, a pivoting video camera apparatus, and a monitoring system with a pivoting video camera|
|US7140789 *||Jun 14, 2004||Nov 28, 2006||Reinert Jason A||Remote controlled pan head system for video cameras and its method of operation|
|US7248231||Nov 5, 2003||Jul 24, 2007||Speakeasy, Llc||Integrated information presentation system with environmental controls|
|US7250936 *||Dec 20, 2004||Jul 31, 2007||Microsoft Corporation||System and process for selecting objects in a ubiquitous computing environment|
|US7307617 *||Dec 20, 2004||Dec 11, 2007||Microsoft Corporation||System and process for selecting objects in a ubiquitous computing environment|
|US7479624 *||Jul 30, 2003||Jan 20, 2009||Glenn Morris||Laser light actuation system|
|US7496666||Jan 3, 2006||Feb 24, 2009||Raritan Americas, Inc.||Multi-user computer system|
|US7552403||Jul 19, 2005||Jun 23, 2009||Microsoft Corporation||Controlling an electronic component within an environment using a pointing device|
|US7596767||Jun 17, 2005||Sep 29, 2009||Microsoft Corporation||System and process for controlling electronic components in a ubiquitous computing environment using multimodal integration|
|US7714802||Mar 19, 2007||May 11, 2010||Speakeasy, Llc||Integrated information presentation system with environmental controls|
|US7721231||Mar 2, 2009||May 18, 2010||Microsoft Corporation||Controlling an object within an environment using a pointing device|
|US7747702||Oct 13, 2006||Jun 29, 2010||Avocent Huntsville Corporation||System and method for accessing and operating personal computers remotely|
|US7818367||May 16, 2005||Oct 19, 2010||Avocent Redmond Corp.||Computer interconnection system|
|US7823089||Apr 18, 2008||Oct 26, 2010||Microsoft Corporation||Manipulating objects displayed on a display screen|
|US7952063||Jul 11, 2005||May 31, 2011||Koninklijke Philips Electronics N.V.||Method and system for operating a pointing device to control one or more properties of a plurality of other devices|
|US8009173||Aug 2, 2007||Aug 30, 2011||Avocent Huntsville Corporation||Rack interface pod with intelligent platform control|
|US8132126||Aug 14, 2008||Mar 6, 2012||Microsoft Corporation||Controlling electronic components in a computing environment|
|US8189011 *||Dec 13, 2006||May 29, 2012||Koninklijke Philips Electronics N.V.||System and method for controlling lighting systems|
|US8249298||Oct 15, 2007||Aug 21, 2012||Polycom, Inc.||Ultrasonic camera tracking system and associated methods|
|US8269783||Jul 24, 2007||Sep 18, 2012||Avocent Redmond Corporation||KVM switch including a terminal emulator|
|US8363143 *||Oct 22, 2010||Jan 29, 2013||Nihon Video System Co., Ltd||View finder device, fixture adapter for the same|
|US8427489||Sep 20, 2006||Apr 23, 2013||Avocent Huntsville Corporation||Rack interface pod with intelligent platform control|
|US8456379||Mar 31, 2010||Jun 4, 2013||Speakeasy, Llc.||Integrated information presentation system with environmental controls|
|US8456419||Apr 18, 2008||Jun 4, 2013||Microsoft Corporation||Determining a position of a pointing device|
|US8537231||Jun 11, 2009||Sep 17, 2013||Koninklijke Philips N.V.||User interface system based on pointing device|
|US8648811 *||Sep 10, 2009||Feb 11, 2014||Shenzhen Taishan Online Technology Co., Ltd.||Remote control system for electronic device and remote control method thereof|
|US8707216||Feb 26, 2009||Apr 22, 2014||Microsoft Corporation||Controlling objects via gesturing|
|US8866870 *||Oct 20, 2011||Oct 21, 2014||Lockheed Martin Corporation||Methods, apparatus, and systems for controlling from a first location a laser at a second location|
|US8937725 *||Mar 12, 2013||Jan 20, 2015||Nikon Corporation||Measurement assembly including a metrology system and a pointer that directs the metrology system|
|US8970725||Sep 4, 2013||Mar 3, 2015||Koninklijke Philips N.V.||User interface system based on pointing device|
|US8971629||Mar 31, 2011||Mar 3, 2015||Koninklijke Philips N.V.||User interface system based on pointing device|
|US9081473 *||Mar 29, 2013||Jul 14, 2015||Google Inc.||Indicating an object at a remote location|
|US9124441 *||Oct 6, 2009||Sep 1, 2015||Intel Corporation||Remote audio|
|US9178712||Dec 31, 2009||Nov 3, 2015||Intel Corporation||Remote audio|
|US9454244||May 7, 2008||Sep 27, 2016||Microsoft Technology Licensing, Llc||Recognizing a movement of a pointing device|
|US9477387 *||Jun 24, 2015||Oct 25, 2016||Google Inc.||Indicating an object at a remote location|
|US20020091850 *||Dec 31, 2001||Jul 11, 2002||Cybex Corporation||System and method for remote monitoring and operation of personal computers|
|US20030081504 *||Oct 25, 2001||May 1, 2003||Mccaskill John||Automatic camera tracking using beamforming|
|US20030193572 *||May 31, 2002||Oct 16, 2003||Andrew Wilson||System and process for selecting objects in a ubiquitous computing environment|
|US20030202796 *||Oct 1, 2002||Oct 30, 2003||Allied Telesis K.K.||Optical wireless communication device and postion adjustment method therefor|
|US20040090424 *||Nov 5, 2003||May 13, 2004||Hurley Gerald C.||Integrated information presentation system with enviromental controls|
|US20050023447 *||Jul 30, 2003||Feb 3, 2005||Glenn Morris||Laser light actuation system|
|US20050063108 *||Sep 24, 2003||Mar 24, 2005||Belkin Corporation||Distance extender and method making use of same|
|US20050156883 *||Dec 20, 2004||Jul 21, 2005||Microsoft Corporation||System and process for selecting objects in a ubiquitous computing environment|
|US20050232260 *||May 16, 2005||Oct 20, 2005||Avocent Redmond Corporation||Computer interconnection system|
|US20050257173 *||Jun 17, 2005||Nov 17, 2005||Microsoft Corporation||System and process for controlling electronic components in a ubiquitous computing environment using multimodal integration|
|US20050257174 *||Jul 19, 2005||Nov 17, 2005||Microsoft Corporation||System and process for controlling electronic components in a ubiquitous computing environment using multimodal integration|
|US20050273534 *||Jul 29, 2005||Dec 8, 2005||Compaq Computer Corporation||High speed peripheral interconnect apparatus, method and system|
|US20060007141 *||Sep 13, 2005||Jan 12, 2006||Microsoft Corporation||Pointing device and cursor for use in intelligent computing environments|
|US20060007142 *||Sep 13, 2005||Jan 12, 2006||Microsoft Corporation||Pointing device and cursor for use in intelligent computing environments|
|US20060109245 *||Dec 30, 2005||May 25, 2006||Microsoft Corporation||Pointing device and cursor for use in intelligent computing environments|
|US20070019962 *||Jul 22, 2005||Jan 25, 2007||Inventec Corporation||Infrated transceiver module that can adjust its transmitting and receiving angle automatically|
|US20070033265 *||Oct 13, 2006||Feb 8, 2007||Avocent Huntsville Corporation||System and method for accessing and operating personal computers remotely|
|US20070162858 *||Mar 19, 2007||Jul 12, 2007||Speakeasy Llc||Integrated information presentation system with environmental controls|
|US20070284949 *||Apr 25, 2007||Dec 13, 2007||Belkin Corporation||Distance Extender|
|US20070291004 *||Jul 24, 2007||Dec 20, 2007||Avocent Redmond Corporation||KVM switch including a terminal emulator|
|US20080082705 *||Nov 27, 2007||Apr 3, 2008||Avocent Redmond Corporation||KVM switch including a terminal emulator|
|US20080095401 *||Oct 15, 2007||Apr 24, 2008||Polycom, Inc.||Ultrasonic camera tracking system and associated methods|
|US20080192070 *||Apr 18, 2008||Aug 14, 2008||Microsoft Corporation||Manipulating objects displayed on a display screen|
|US20080265143 *||Jul 11, 2005||Oct 30, 2008||Koninklijke Philips Electronics, N.V.||Method for Control of a Device|
|US20080265802 *||Dec 13, 2006||Oct 30, 2008||Koninklijke Philips Electronics, N.V.||System and Method for Controlling Lighting Systems|
|US20080313575 *||Aug 14, 2008||Dec 18, 2008||Microsoft Corporation|
|US20090046146 *||Aug 13, 2008||Feb 19, 2009||Jonathan Hoyt||Surgical communication and control system|
|US20090164952 *||Mar 2, 2009||Jun 25, 2009||Microsoft Corporation||Controlling an object within an environment using a pointing device|
|US20090198354 *||Feb 26, 2009||Aug 6, 2009||Microsoft Corporation||Controlling objects via gesturing|
|US20090207135 *||Apr 27, 2009||Aug 20, 2009||Microsoft Corporation||System and method for determining input from spatial position of an object|
|US20090251559 *||Jun 11, 2009||Oct 8, 2009||Koninklijke Philips Electronics N.V.||User interface system based on pointing device|
|US20100023869 *||Oct 6, 2009||Jan 28, 2010||Ylian Saint-Hilaire||Remote audio|
|US20100189219 *||Jan 29, 2009||Jul 29, 2010||Searete Llc, A Limited Liability Corporation Of The State Of Delaware||Diagnostic delivery service|
|US20100194715 *||Mar 31, 2010||Aug 5, 2010||Speakeasy Llc.||Integrated information presentation system with environmental controls|
|US20100229099 *||Dec 31, 2009||Sep 9, 2010||Ylian Saint-Hilaire||Remote Audio|
|US20110001696 *||Sep 13, 2010||Jan 6, 2011||Microsoft Corporation||Manipulating objects displayed on a display screen|
|US20110181766 *||Oct 22, 2010||Jul 28, 2011||Kentaro Hashiguchi||View finder device, fixture adapter for the same|
|US20110187643 *||Mar 31, 2011||Aug 4, 2011||Koninklijke Philips Electronics N.V.||User interface system based on pointing device|
|US20110216011 *||Sep 10, 2009||Sep 8, 2011||Shenzhen Taishan Online Technology Co., Ltd.||Remote control system for electronic device and remote control method thereof|
|US20130088421 *||Sep 10, 2012||Apr 11, 2013||Sony Corporation||Display control device|
|US20130335749 *||Mar 12, 2013||Dec 19, 2013||Nikon Corporation||Measurement assembly including a metrology system and a pointer that directs the metrology system|
|US20140281968 *||Mar 29, 2013||Sep 18, 2014||Google Inc.||Indicating an object at a remote location|
|US20150370454 *||Jun 24, 2015||Dec 24, 2015||Google Inc.||Indicating an object at a remote location|
|USRE44814||Mar 4, 2002||Mar 18, 2014||Avocent Huntsville Corporation||System and method for remote monitoring and operation of personal computers|
|CN104380138A *||Jun 14, 2013||Feb 25, 2015||株式会社尼康||Measurement assembly, method for measuring feature on surface, method for manufacturing structure and pointer|
|WO2006013479A2 *||Jul 11, 2005||Feb 9, 2006||Philips Intellectual Property & Standards Gmbh||Method for control of a device|
|WO2006013479A3 *||Jul 11, 2005||Dec 7, 2006||Philips Intellectual Property||Method for control of a device|
|WO2014158686A1 *||Feb 28, 2014||Oct 2, 2014||Google Inc.||Indicating an object at a remote location|
|U.S. Classification||348/211.8, 348/211.7, 398/1, 348/E07.088, 356/152.1, 398/122, 340/555, 398/127, 340/556, 398/126, 340/531, 398/118|
|International Classification||H04B10/10, G01S17/88, H04N7/18|
|Cooperative Classification||G01S17/88, H04B10/11, H04N7/185|
|European Classification||H04B10/11, H04N7/18D2|
|Feb 23, 1996||AS||Assignment|
Owner name: MICHIGAN, THE REGENTS OF THE UNIVERSITY OF, MICHI
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CONWAY, LYNN;REEL/FRAME:007882/0521
Effective date: 19960222
|Aug 16, 2001||FPAY||Fee payment|
Year of fee payment: 4
|Aug 30, 2005||SULP||Surcharge for late payment|
Year of fee payment: 7
|Aug 30, 2005||FPAY||Fee payment|
Year of fee payment: 8
|Sep 21, 2009||REMI||Maintenance fee reminder mailed|
|Feb 17, 2010||LAPS||Lapse for failure to pay maintenance fees|
|Apr 6, 2010||FP||Expired due to failure to pay maintenance fee|
Effective date: 20100217