|Publication number||US5153833 A|
|Application number||US 07/684,820|
|Publication date||Oct 6, 1992|
|Filing date||Apr 15, 1991|
|Priority date||Jun 23, 1988|
|Also published as||US5008804, US5008804|
|Publication number||07684820, 684820, US 5153833 A, US 5153833A, US-A-5153833, US5153833 A, US5153833A|
|Inventors||Gary B. Gordon, Robert R. Gonnelli|
|Original Assignee||Total Spectrum Manufacturing, Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (34), Non-Patent Citations (4), Referenced by (59), Classifications (15), Legal Events (11)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This is a continuation of application Ser. No. 07/575,852, now U.S. Pat. No. 5,008,804, filed Aug. 30, 1990 which is a continuation of application Ser. No. 07/228,933, now U.S. Pat. No. 4,959,798, filed Jun. 23, 1988.
The invention relates to a robotic camera dolly system, and more specifically to such a system which can remotely and automatically direct a camera dolly among studio floor positions.
As the television broadcast market continues to mature, there is growing interest in controlling costs and improving equipment utilization through the greater use of automation. Newsrooms are leading the way. Central computers are being used to organize the overall news gathering process and the sequencing of the show, and increasingly to control certain studio equipment such as teleprompters.
The trend is toward controlling ever more studio equipment, such as lighting, character-generators, and effects generators.
Cameras, however, are still manually controlled despite the fact most of their shots are well structured, highly repetitive, and known in advance. Automating them therefore has the potential to further reduce costs and improve equipment utilization in an automated studio. Automating shot taking would require that the shots be framed before the television show, assigned names, and then recalled as needed.
A camera shot can be thought of as consisting of seven parameters, all set by the cameraman. They are camera focus, zoom, tilt, pan, pedestal height, and the x and y positions of the camera dolly on the floor. Ideally all seven degrees of freedom are servo controlled, and stored as a set. The control and storage of the first four parameters: focus, zoom, tilt, and pan, is known within the prior art. Examples are the products manufactured by Total Spectrum Manufacturing Inc., known as the Multicontroller and the HS-110-P robotic camera head. Partial camera automation is practical at this level, but the cameras must either be anchored, or dollied about manually. These restrictions tend to nullify the gains of automation, obtainable with respect to focus, zoom, tilt, and pan, since the restrictions require manual intervention, or additional cameras, or aesthetic compromises.
One way to achieve mobility is to place the cameras on a track; however this method has its drawbacks. It clutters the floor, is expensive to relocate, is one-dimensional, limits camera locations to those along the track, and prevents the cameras from crossing past each other.
Another way to achieve mobility is to place the cameras on wheeled dollies and, with the aid of a motor control system, to direct the dollies to the appropriate camera locations and angular orientations. However, this approach runs into the problem of assuring precision in movements which may be of the order of 50 feet in a typical television studio, it being obviously very important in television production that both the location and orientation of the cameras be properly located while shooting. Moreover, when a series of predetermined locations is to be traversed by the camera the problem would become successively magnified as such errors would accumulate from shooting location to shooting location.
An object of the invention is, therefore, to provide a dolly apparatus which can be taught to automatically transport a video camera between preselected locations and angular orientations with great precision on a studio floor.
In accordance with one aspect of the invention this object is met with a dolly apparatus which can be taught to automatically transport the camera under open loop control (dead reckoning) to the immediate vicinity of targets positioned at and/or in relation to preselected locations on the studio floor, and with the aid of sensors on the dolly, to thereafter correct the translational position and the angular orientation of the dolly and/or the camera with respect to the targets.
In accordance with another aspect of the invention, the dolly carries a camera carriage which can raise and lower and rotate the camera in a conventional manner, and rides on powered and steerable wheels which are controlled first in an open loop manner and then in a closed loop manner with target sensors in order to bring the dolly close to, and then precisely on, a target.
In accordance with another aspect of the invention, the targets are marked in the plane of movement of the dolly, such as on a studio floor, and designate at least two translational positions from which camera shots are to be taken. The targets may also mark the angular orientation which the dolly should adopt at the respective translational positions. Sensor means such as a plurality of downwardly directed optical sensors are provided on the dolly for detecting the translational position and angular orientation of the dolly relative to the target when the dolly has reached the close vicinity of the target by dead reckoning
A computer-based dolly controller is connected to the dolly via a serial data link. The controller contains a control stick, coupled to the wheels via the serial data link and used to control steering and propulsion of the wheels, and is employed to teach the motions to be performed during the dead reckoning movement. The computer contains means to continually sample and store for future use, the instantaneous position demand signals which instruct the speed and steering of the wheels. This teaching approach is analogous to the manner in which the aforementioned Multicontroller and HS-110-P robotic head can be used to teach and store coordinated pan, tilt, zoom and focus motions of the robotic head and the camera which it supports In the case of teaching speed and steering of the dolly wheels, the taught motion may be somewhat complicated to move from one camera location to a second one, for example from a weather set to a news set, the path and speed being chosen by the computer operator so as to avoid other cameras and other obstacles, and being stored in the computer.
In accordance with one other embodiment of the invention, the movement of the dolly from one target to the next is taught in steps, that is, along a succession of selected points along the floor.
During such movements, the wheels normally all point in the same direction: in television terms, the wheels move in a "crab mode". When the dolly has reached the immediate vicinity of the target in completing the first stage of repositioning the camera to a new camera shooting position, the wheels move in the crab mode to correct the translational position and may be steered to be tangent to a circle to allow the dolly to rotate for correcting the angular orientation.
With a target of about two feet square photoreproduced on the floor and having sufficient detail to allow automatic centering of the dolly above it, as well as to correct its angular orientation, it is necessary only that the dead reckoning control be capable of guiding the dolly to within a foot or so of its desired location, from which the alignment control will be able to sense the target in order to perform the automatic centering and correction of angular orientation. The intrinsic accuracy of the dolly and the dead reckoning control is such that the dolly is capable of traversing typical studio distances of 50 feet ending up within a foot of the destination target with only a small error in angular orientation, so as to be within homing range of the destination target.
The targets do not have to be aligned in either position or rotation to any absolute grid or coordinate system. Since the system is taught a path and speed between particular end points, and traces this track by dead reckoning, the only reference required is the actual position and orientation of the target from which the dolly starts its move (and which therefore defines the starting position and orientation of the dolly). In effect, the person teaching the motion shows the dolly system the coordinates of the destination target, using the reference from the origin target Subsequent moves begin anew, and each move has context only with respect to the target from which it originates. It is this recalibrating (the closed loop homing in on the target) at the end of each move that allows repeated moving, from shooting location to shooting location in a sequence, to work. The system breaks up a large problem into small managable ones, allowing the present camera automation system to work without accumulating excessive errors.
These and other aspects of the invention will be more completely understood from the following description of the preferred embodiment when taken with the accompanying drawings in which:
FIG. 1A is a perspective view of a robotic dolly with photosensors for reading a "target," with the wheel assemblies being omitted for simplicity of illustration;
FIG. 1B is a schematic illustration of the electromechanical elements of one of three identical wheel assemblies for use with the dolly;
FIG. 1C is a perspective view of the dolly with a camera, head and support;
FIG. 2 is a schematic illustration of a typical studio floor, showing various positions to be taken by the camera assemblies;
FIG. 3 is a block diagram of a television-camera dolly system in accordance with a first embodiment of the present invention;
FIG. 4A and 4B are flow charts of programs for the teaching and repeat programs employed in the first embodiment;
FIGS. 5A-5F are schematic representations illustrating the optosensors with respect to the target during alignment in the first embodiment;
FIG. 6 is a flow chart illustrating the alignment program for the first embodiment;
FIG. 7 is a block diagram of a studio system showing the interconnection of various elements thereof and a newsroom computer in a second embodiment of the invention; and
FIG. 8 is a block diagram of the electronics and motors in the second embodiment.
Referring now to FIG. 1A, there is shown a camera assembly 10 (with the wheel assemblies being omitted for ease of illustration). The camera assembly 10 includes a dolly 12 of generally equilateral triangle shape. At each of the three corners of the generally equilateral triangle shaped bottom surface 14 of the dolly 12 are provided circular openings 16 for shafts to mount the respective wheel assemblies (not shown in FIG. 1A). In a central portion of the bottom surface 14 are provided optosensors 18 arranged in a square pattern, with the diagonally opposite optosensors 18a and 18c being arranged on a line 18' parallel to the side edge 14a of the bottom surface 14. The other diagonally opposite optosensors 18b and 18d are arranged on a line 18" which is perpendicular to line 18'.
The optosensors 18 are conventional devices which project respective beams directly downward so as to focus onto the studio floor, and which include respective sensors to detect light reflected back from the floor. As will be described in greater detail below, the optosensors are used to precisely locate and orient the dolly with respect to one of various targets 20 located on the studio floor. Targets 20 which is shown from below and, for the purpose of illustration only, assumed to be partially transparent in FIG. 1A may, for example, be two feet square and consist of adhesive-backed sheets of acetate, with a pattern of two black squares 22 and 24 and two white squares 26 and 28, the boundaries between the squares defining X and Y axes. As will be described in greater detail below, the optosensors 18 are utilized to detect the transitions between the black and white squares. The optosensors 18 may, for example, be those manufactured by TRW having part number TRW-OPB703A, and are preferably spaced 1 foot apart when the target 20 is 2 feet square.
One of three identical wheel assemblies 30 is illustrated in FIG. 1B and includes a mounting shaft 32 for mounting the wheel assembly in a respective opening 16 in the bottom surface of the dolly 12. Wheel assembly 30 may be of conventional design and may be a model number HS-105P produced by Total Spectrum Manufacturing Company. Wheel assembly 30 includes a casing 34 housing therein a steering motor 36 which rotates the assembly 30 about the mounting shaft 32 via anti-backlash reduction gears 38. A propulsion motor 40 rotates the wheel 42 through an anti-backlash reduction gears 43. Control of the respective motors for the wheel assemblies will be described below.
FIG. 1C illustrates the entire camera assembly 10. Shown are the wheels 42 supporting the dolly 12 on which a vertically adjustable pedestal 44 supports the horizontally rotatable camera head 46. The camera head may, for example, be a conventional head such as the Total Spectrum Manufacturing model number HS-110P. The camera 48 is therefore rotatably and vertically adjustably mounted on the dolly 12 by the pedestal 44 and head 46.
In use, for example, on a television studio floor having a news set, a weather set and a talk-show set, two or more camera assemblies 10 may be employed and the pan, tilt, zoom, focus and vertical height of the respective cameras controlled via cables from a remotely located dolly controller. Typical positions of the dolly and angular positions of the cameras thereon are illustrated in FIG. 2 showing a typical arrangement of a talk-show set, a news set and a weather set with the camera assemblies 10a, 10b and 10c indicated in front of the news set, alternate positions thereof in front of the sets being shown in broken line. As can be seen in FIG. 2, in order to move the camera assemblies 10 from one location to the other without contacting the other camera assemblies or otherwise interfering with their operation or running over their respective cables 50, which extend from a producer's booth 51, the camera assemblies 10 may be required to take a somewhat complex or circuitous route. The cameras need to be movable so as to allow at least two-camera coverage of each of the two sets, as shown. On occasion, a pull-back shot requires one of the cameras to recede from the set, during an on-air move. The various positions which the dollies are to take are marked with targets as described above.
A camera assembly 10 moves from one target to another in two steps. The first step moves the camera assembly 10 by dead reckoning from one target to a position very close to the other target (destination target) along a taught path. Once the camera assembly has reached the vicinity of the destination target, final alignment of the dolly is accomplished in a closed loop manner with the aide of the optosensors thereon sensing the target.
A simplified first embodiment of a robotic television-camera dolly system in accordance with the present invention will now be described with reference to FIG. 3, which schematically illustrates a joystick 52, a dolly controller 53, and a dolly 54 having the same construction as the dolly 12 previously discussed with respect to FIGS. 1A-1C. In particular, dolly 54 includes optosensors 18 and three wheels 42 (See FIG. 1C), one of which is rotated by the propulsion motor 40 and directed (with respect to dolly 54) by the steering motor 36. One of the remaining wheels is rotated by propulsion motor 40' and directed by steering motor 36', and the last wheel is rotated by propulsion motor 40" and directed by steering motor 36". Motors 40--40" are mechanically connected to tachometers 56--56", which provide feedback signals for speed control circuits 58--58". Speed control circuits 58--58" receive speed command signals from dolly controller 53, as will be discussed. Position encoders 60--60", mounted on motors 36--36", are indirectly linked thereto (although not illustrated in FIG. 1B) so as to detect the relative positions of the casings 34 with respect to the base of the dolly. Position encoders 60--60" provide feedback signals for position control circuits 62--62", which additionally receive position or steering command signals from dolly controller 53. Dolly 54 is connected to dolly controller 53 by a cable 64, which may also include conductors (not illustrated) for various other purposes such as providing power to the motors and returning the video signal.
Joystick 52 includes an X-potentiometer 66 and a Y-potentiometer 68. Each potentiometer is connected between a power supply terminal 70 at a voltage V and ground. Potentiometers 66 and 68 have sliding taps which are mechanically connected to a joystick handle 71, this mechanical connection being schematically indicated by the dotted lines in FIG. 3. The mechanical connection is such that the sliding tap of potentiometer 66 is moved in accordance with the X component of the movement of handle 71, and the sliding tap of potentiometer 68 is moved in accordance with the Y component of the movement of handle 71. Although not illustrated, handle 71 is preferably spring-biased, so that it returns to a vertical position when it is released. In the vertical position, the voltage at the tap of potentiometer 66 is V/2 and the voltage at the tap of potentiometer 68 is also V/2.
Dolly controller 53 includes an analog/digital converter 72 which is connected to the sliding tap of potentiometer 68 to receive the Y component of the signal from joystick 52, and another analog/digital converter 74 which is connected to the sliding tap of potentiometer 66 to receive the X component. The resulting X and Y digital signals provide inputs for microprocessor 76. Other inputs to microprocessor 76 are provided by path-training switch 78, path-repeat switch 80, and final alignment switch 82. Microprocessor 76 also receives signals from optosensors 18. Based upon these input signals microprocessor 76 generates a speed command signal which is stored in speed control latch 84 to control the speed of motors 40--40", and direction command signals which are stored in direction control latches 86--86" to control the directions in which motors 36--36" aim their respective wheels. Although not illustrated in FIG. 3, dolly controller 53 may also include digital/analog converters connected to latches 84 and 86--86" to convert the command signals to analog form before they are transmitted via cable 64 to dolly 54.
The path-training program will now be described with reference to FIGS. 3 and 4A. It is assumed that dolly 54 is positioned over an initial target 20 (see FIG. 1A) and is to be moved from this initial position to a final position above a different target 20. An operator closes path-training switch 78 and then manipulates the handle 71 of joystick 52 to guide dolly 54 along the desired path. After switch 78 has been closed, a counter in microprocessor 76 is reset at step 88. Thereafter, a timer 90 in microprocessor 76 is set. Timer 90 times-out after 1/15th second. At step 92, the X signal from A/D converter 74 and the Y signal from A/D converter 72 are read. These signals need to be corrected, since the X and Y signals both correspond to V/2 when handle 71 is in its vertical position. This correction is accomplished at step 94, where V/2 is subtracted from each signal. The result is essentially a transformation of coordinates, so that the movement of handle 71 can be interpreted thereafter in a true cartesian fashion; that is, in the plus and minus X directions and the plus and minus Y directions. The cartesian coordinates are then converted to polar form at step 96. As a result, the cartesian coordinates of the position of handle 71 are transformed into a radial signal and an angular signal. The radial signal corresponds to the desired speed of dolly 54 and in step 98 is stored in latch 84 as the speed command signal. The angular signal corresponds to the desired direction of dolly 54 and in step 98 is stored in each of latches 86--86" as the direction command signal. The speed command signal is conveyed via cable 64 to speed control circuits 58--58" to drive motors 40--40" at the desired speed and the direction command signal is conveyed via cable 64 to position control circuits 62--62" to point the wheels in the desired direction. It should be noted that the wheels are kept parallel during the path-teaching procedure. The same pair of command signals which are used to drive dolly 54 under the control of joystick 52 is also stored at step 100 in a memory in microprocessor 76. The address of the storage location is determined by the current content of the counter in microprocessor 76.
After the command signals are stored at step 100, a check is made at step 102 to determine whether 1/15th of a second has expired. If not, microprocessor 76 waits until it has. After expiration of the time, another check is made at step 104 to determine whether path-teaching switch 78 is still closed. Since the training operator opens this switch when dolly 54 arrives at the desired location, "yes" at step 104 indicates that the path has not been completed. The counter is thereupon incremented at step 106, and the program returns to step 90 so that command signals for the next 1/15th of a second can be stored. On the other hand, if switch 78 is not closed, the counter content is stored at step 108, and at step 110 latches 84 and 86--86" are reset to zero to insure that dolly 54 does not move unintentionally.
The path-repeat program will now be described with reference to FIGS. 3 and 4B. It is assumed that dolly 54 is currently located at an initial position and has already been trained to move from this initial position to the desired final position. After path-repeat switch 80 has been closed, the counter in microprocessor 76 is reset at step 112 and the 1/15th second timer in microprocessor 76 is set at step at 114. The stored speed command and direction command signals are then read at step 116, with the counter content providing the address of the desired pair of command signals. The read-out command signals are transferred to latches 84 and 86--86" at step 118, and dolly 54 is driven accordingly. At step 120 a check is made to determined whether 1/15th of a second has expired, and after it has a check is made at step 122 to determine whether the counter content now equals the value stored at step 108 in FIG. 4A. If these values are equal, it will be apparent that all of the command signals stored during the training operation have been read out and have been applied, in pairs, for intervals of 1/15th of a second to dolly 54. By "dead reckoning," dolly 54 should now be very close to the desired final position, so at step 124 zeros are emitted to latches 84 and 86--86" to replace any previous values that may have been stored. On the other hand if "no" is the result of the query at step 122, the counter in microprocessor 76 is incremented at step 124 and the program returns to step 114. The next pair of command signals (that is, speed command and direction command) will be read out of memory from the locations determined by the counter content, and thereafter will be applied for a 1/15th of a second to dolly 54.
Turning next to FIGS. 3, 5A-5F, and 6, the final alignment of dolly 54 after path-repeat switch 80 has been opened and alignment switch 82 has been closed will now be described. It will be assumed that dolly 54 is close to the desired position upon conclusion of the path-repeat procedure (for example, within 6 inches) and that it is oriented approximately in the desired direction (which normally would be within a few degrees but could in principle be any angle less than 45 degrees). With the squares 22-28 of target 20 each being one foot on a side and with the optosensors spaced one foot apart, then with the dolly within 6 inches of the desired position over the target, the colors of the squares detected by the respective optosensors completely define which squares the optosensors are detecting. The target 20 at the desired position is FIG. 5A, along with four optosensors A, B, C, and D which are disposed above target 20 in a square pattern as illustrated. Optosensors A, B, C, and D correspond to optosensors 18a, 18b, 18c, and 18d of FIG. 1A. In FIGS. 5A-5F the sides of the square defined by the four optosensors A-D are shown in solid lines, and the diagonals are shown in dotted lines. As will be apparent from FIG. 5A, a coordinate system is defined by the transition between white square 28 and black square 22; the transition between black square 22 and white square 26; the transition between white square 26 and black square 24; and the transition between black square 24 and white square 28.
After alignment switch 82 has been closed, the first problem is to locate a transition between a white square and a black square (step 126 in FIG. 6). This is accomplished by moving dolly 54 linearly until one of the optosensors A-D detects such a transition. Although the direction of this linear movement can be arbitrary, in FIG. 5A the direction is selected to be along the diagonal AC as indicated by arrow 128. To accomplish this movement all of the wheels are turned parallel to diagonal AC (that is command values which identify diagonal AC are loaded into latches 86--86" of FIG. 3), and the dolly 54 is moved at a slow speed (that is, a small speed command signal is loaded into latch 84 of FIG. 3). The value in latch 84 is reduced to zero when one of the optosensors (in this example, optosensor B) encounters a transition. This stops dolly 54, at the position illustrated in FIG. 5B.
Next, dolly 54 is moved so that one of the diagonals is parallel to one of the axes X or Y of target 20 (step 130 of FIG. 6). This is accomplished by rotating dolly 54 about its vertical axis until a transition is detected by the optosensor (here, optosensor D) opposite the optosensor which detected the initial transition (that is, optosensor B). Rotating dolly 54 is accomplished by loading a small speed command signal into latch 84 and loading a signal corresponding to zero degrees in latch 86, a signal corresponding to 120 degrees in latch 86', and a signal corresponding to 240 degrees in latch 86". The signals in latches 86--86" cause the wheels to turn tangent to a circle. In FIG. 5B, the center about which dolly 54 rotates is the point defined by the intersection of diagonal AC and diagonal BD. Rotating about the center, optosensor D moves through an arc 132 before encountering a transition. The arc 134 through which photosensor B moves during this rotation is equal to arc 132. Propulsion motors 40--40' are stopped when optosensor D detects the transition, leaving the optosensors positioned as illustrated in FIG. 5C. It will be apparent from FIG. 5B that a line connecting the midpoint of arc 132 to the midpoint of arc 134 would be parallel to the Y axis. Accordingly, in FIG. 5C dolly 54 is rotated in the reverse direction by half the length of these arcs. The result is illustrated in FIG. 5D, and it will be noted that diagonal BD is parallel to the Y axis and diagonal AC is parallel to the X axis.
The next step is to find one of the axes (step 136 in FIG. 6). In FIG. 5D this is accomplished by moving dolly 54 so that diagonal AC moves parallel to the X axis as indicated by arrow 138 (determined by which squares the optosensors are positioned over). To do this, the wheels are turned so that they are again parallel to diagonal AC, and propulsion motors 40--40" are slowly driven. The direction in which to move is uniquely determined by the black or white values sensed by the optosensors. In FIG. 5D the dolly is moved in the negative X direction, and optosensors B and D encounter transitions simultaneously along the Y axis. Dolly 54 is thereupon stopped at the position illustrated in FIG. 5E.
In an alternate procedure which might be useful where it cannot be assured that the dead reckoning procedure brings the dolly within 6 inches (only within 12 inches say) of the desired position (centered on the origin of the target), the optosensors might be unable to determine in which direction the dolly should move as might be the case if the axis of the dolly were almost one foot from the origin of the target. In that case, had the direction of arrow 138 in FIG. 5D been reversed, so that the movement was in the positive X direction, photosensor A alone would have encountered a transition. Dolly 54 could then have been brought to the position illustrated in FIG. 5E by reversing the direction of movement after optosensor A encountered a transition, and moving dolly 54 by half the distance of diagonal AC.
To find the second axis (step 140 in FIG. 6), the wheels are turned so that they are parallel to the first axis (here, the Y axis), and dolly 54 is moved slowly as indicated by arrow 142 until optosensors A and D simultaneously encounter transitions. This leaves dolly 54 correctly positioned and oriented, as shown in FIG. 5F. In the above alternative procedure applicable where it cannot be assured that dead reckoning brings the dolly to within 6" of the desired position, had the direction of arrow 142 in FIGS. 5E been reversed, so that diagonal AC moved in the positive X direction, optosensor D would have encountered the X axis. However, a transition at this stage cannot be reliably detected by optosensor D since the black and white squares come together at the origin. Accordingly, to avoid this problem if the wrong direction is selected for arrow 142, movement is continued in the selected direction until optosensors A and C encounter transitions or until dolly 54 has been moved by more than half the length of a diagonal without transitions having been encountered. In this latter case, the direction of movement is reversed, and thereafter dolly 54 is stopped when optosensors A and C detect transitions.
The proceding discussion of the alignment of dolly 54 with target 20 has been predicated on the assumption that, upon completion of the path-repeat procedure, dolly 54 is located near the desired position and is directed at approximately the desired angle. This assumption should, of course, be verified by several trials after a new path has been taught. Should the assumption be unwarranted it will be necessary to break the path into two or more segments, each of which terminates at a target 20. This permits mid-course corrections to be made before the dead reckoning error becomes undesirably large.
A second embodiment of a robotic television camera system in accordance with the present invention will now be described with reference to FIGS. 7 and 8, which show a control system for controlling two dollies. In FIG. 7, remote joystick panel 160 includes two conventional joysticks (not illustrated) and two control switches (not illustrated), one joystick and one control switch being dedicated to control of each of the dollies. A joystick is moved to control the speed and steering of the wheels of the respective dolly 12 via a remote dolly control computer 162 and on board dolly controls 164 for the first camera assembly and 166 for the second camera assembly.
The dolly control computer 162 stores the steering and wheel speed instructions from the control stick so that they may be repeated later. Thus, in this embodiment a single set of instructions is provided to bring the camera assembly from one target to another.
In an alternative embodiment, for simplicity, the computer 162 may be programmed to move the camera assemblies successively along straight path segments to preselected way points along a selected path on the studio floor. The selected path may be altered slightly with "spline fits" to maintain continuous movement of the camera assemblies past the selected way points by smoothing the transitions between adjacent segments on the path. Various combinations of such movements of the camera assemblies may be taught in this manner.
A newsroom computer 168, utilized to control the overall automation of the television program, may be utilized to select the particular paths to be taken in accordance with the alternative dead reckoning technique. A display device 0 coupled to the dolly control computer 162 may also be utilized, for example, to select the particular way points along the path of movement of the camera in the alternative dead reckoning procedure. The display may, for example, include a touch screen for aide in selecting the appropriate path for the respective camera assembly. The newsroom computer may, for example, be the Newstar Newsroom Computer manufactured by Dynatech.
Serial data cables 172 and 174 connect the dolly control computers 162 to the first dolly controls 164 and the second dolly controls 166, respectively. These cables may, for example, be RS 422 buses. In addition to signals used to move the dollies during the teaching operation, the cables 172 and 174 also carry control signals during the actual operation of the camera assemblies 10a and 10b to control the translation of the dollies, as well as providing unregulated power and additional signals which may be needed such as pedestal control signals and head control signals for controlling the vertical movement of the pedestal 44 and the rotational movement of the head 46.
The dolly controls 164 and 166 are substantially identical and are illustrated in FIG. 8. Referring to FIG. 8, dolly control 164, which is substantially identical to dolly control 166, includes a microprocessor 180 which may be of the one-board type, based on the Intel 80286 microprocessor or similar microprocessor.
The microprocessor 180 controls the steering control servo 182 of each of three steering control circuits 184, 186 and 188. The microcomputer 180 also controls a propulsion control servo 190. Each of the servo loops is identical and is controlled in a conventional manner. The digital position loop of each servo loop is fed from an incremental encoder. In the case of the steering control circuit 184, the encoder is a wheel angle encoder 192 mounted on a steering motor 193. In the case of the propulsion control circuit 191, the encoder is an incremental position encoder 194 mounted on one of three propulsion motors 196, 196' and 196".
Each servo loop also uses an analog velocity loop for damping, fed by a tachometer mounted on the respective motor. In the case of the steering control circuit 184, a tachometer 198 is mounted on the steering motor 193 and in the case of the propulsion control circuit 191, a tachometer 200 is mounted on the propulsion motor 196".
In the mode of operation of the dolly in moving from one target to another under the dead reckoning procedure, the dolly microcomputer continually subtracts the actual position of the motor, as read from the respective encoder, from a position demand signal received via the serial link 172 from the control computer 162 to obtain a position error signal, and commands the amplifier of the respective servo to produce a motor velocity proportional to the position error.
For steering, in accordance with the second embodiment of the invention, the wheels are all aligned in parallel and turned in parallel during this first mode of operation in moving the dolly from one target to the immediate vicinity of another target. The propulsion motors 196, 196' and 196" for propulsion of the respective wheels 42 are all disposed in parallel and receive the same propulsion power from the propulsion control servo.
The four photosensors 18 that sense the respective targets 20, are also connected to the microcomputer 180 via standard binary input ports, and signals from the optosensors take over control of the propulsion control servo 190 and steering control servo 180 from the demand signal received via the serial link, during the second mode of operation in which the dolly is exactly located over the target 20 under closed loop control.
Acceleration and turning of the wheels of the dolly are controllable in a conventional manner with a conventional joystick panel 160, dolly control computer 162 and dolly 10 with wheel assemblies 30. The joystick of the joystick panel 160 has two axes of freedom. When moved fore and aft, signals are sent via the dolly control computer to the propulsion control servo causing the dolly to move forward and backward, with a velocity proportional to the stick displacement. When the stick is moved side to side, signals are sent to the steering servo 182 via the control dolly computer 162 to cause the dolly wheels to turn, parallel to each other, progressively to the left or right at a rate proportional to the displacement of the stick. The stick is spring biased so that when released, the spring returns to its central location and the dolly is caused to stop moving, but the wheels stay in the direction they were pointed.
In order to teach a movement of a dolly from one target to another, the dolly must first be properly aligned both in location and angle with respect to the first target. When the operator is ready to commence a move for purposes of teaching, he depresses a start button on the joystick panel 160, and proceed to guide the dolly across the floor with the control stick on the joystick panel guiding the dolly so as to avoid obstacles and park the dolly reasonably close to the destination target, whereupon a stop button on the joystick panel 160 is depressed.
Prior to moving the dolly for purposes of teaching, the dolly control computer 162 provides an inquiry signal to the operation asking the name (identification) of the dolly move. As a safety measure, the name comprises names (identification) of the start and destination targets being traversed. Move names should be first verified to ensure that the move is compatible with the starting position.
Immediately after the start button is pushed, the dolly control computer 162 begins storing the steering and propulsion demand signals resulting from the movement of the control stick, at a rate of, for example, 15 per second. At this time, pan, tilt, zoom, focus and pedestal demand signals are also recorded, although they are seldom used as most such moves are off-air. Repetitive storing of the demand signals continues until the stop button is pushed.
When the dolly control computer 162 is commanded as via the newsroom computer 168 to replay a dolly motion, it first verifies that the starting position is compatible with the motion. Next, the dolly control computer 162 outputs from its memory the identical sequential positions, at 15 per second, that were generated and stored during the teaching process. As a convenience, any of the motions may be replayed in reverse, to reduce the teaching effort; that is, so that by teaching a movement from one target to another, a reverse movement is also taught.
For ease of teaching, the targets should be oriented the same, and the dollies' orientation should therefore change little during movement from one target to another, so upon arrival at the destination target, only a minor angular correction and translational correction should be required.
At the completion of this first stage of movement from one target to another, the dolly microcomputer 180, with the use of the target optosensors 18, controls the steering control circuits 184, 186 and 188 and the propulsion control circuit 191 to align the dolly on the destination target 20. The target 20, being formed of black and white squares one foot on a side, provides a two-foot square pattern. The optosensors would therefore preferably be one foot apart in a square shape so that the dolly can be up to approximately six inches out of position in any direction and still be able to find the desired location (the target center), irrespective of the color of the floor on which the targets are disposed. Thus, a boundary between the target and the floor will not be inadvertently detected as a transition between white and black squares. If it can be assured that the target boundary will not be misdetected as a transition between squares, a larger deviation of say 12 inches is permissible between the location of the dolly and the desired location at the end of the first (dead reckoning) stage, and the dolly would still be able to find the target center during the second stage.
The dolly is aligned when each of the four optosensors 18 has centered itself above a respective one of the black-to-white transitions of the target 20. The alignment can be accomplished in the manner previously discussed with respect to FIGS. 5A-5F.
Other alternative means for translating the dolly across the studio floor and then realigning at the final position may also be utilized within the scope of the present invention. For example, rather than teaching a complete movement of a dolly from a first target to a second target using a control stick, it is possible to find several points on a floor along the path which the dolly is to take, define these points in the dolly control computer, and then using known computer techniques, allow the computer to define first respective movements from point to point along the path, these points being "way points" and then creating a spline fit so that the dolly traverses a continuous curve past each of the respective way points without stopping.
The importance of correcting the angular orientation of the dolly at the destination target is to assure that there is a reference from which the camera may be rotated. However, it is also possible to effect the rotational alignment by pointing the camera at an azimuth target on a wall of the studio, and determining azimuth orientation by looking through the camera. Similarly, the rotational realignment could be accomplished by rotating the pedestal 44 with the dolly, with the use of a bearing and azimuth servo, and with the optosensors being affixed to the rotation pedestal. Alternatively, the rotational realignment factor could be fed as a correction factor into the pan axis of the head 46. Other variations will be apparent to those skilled in the art.
It will be understood that the above description of the present invention is susceptible to various modifications, changes and adaptations, and the same are intended to be comprehended within the meaning and range of equivalents of the appended claims.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US3612206 *||Jul 7, 1969||Oct 12, 1971||Eaton Yale & Towne||Automatic guidance system for warehouse trucks and the like|
|US3715572 *||Mar 5, 1971||Feb 6, 1973||D Bennett||Vehicle location and heading computer system|
|US4257619 *||Sep 26, 1978||Mar 24, 1981||Fisher James L||Variable ratio rotary positioning mechanism and camera dolly steering mechanism embodying same|
|US4278142 *||Mar 13, 1979||Jul 14, 1981||Agency Of Industrial Science And Technology||Automatic guidance system for vehicles|
|US4344498 *||Dec 27, 1979||Aug 17, 1982||Lindfors Olof H||Automatic steering means for a driverless carriage|
|US4415975 *||Dec 31, 1980||Nov 15, 1983||Mid-West Conveyor Company, Inc.||Apparatus and method for rough positioning a vehicle at a storage bin in an automatic storage and retrieval system|
|US4463821 *||Mar 1, 1982||Aug 7, 1984||Robot Crabtor International||Drivable, steerable platform for lawnmower and the like|
|US4541049 *||Oct 1, 1981||Sep 10, 1985||Ab Volvo||Method for updating in a wheeled vehicle steered by dead reckoning|
|US4554498 *||Mar 16, 1982||Nov 19, 1985||Mitsubishi Denki Kabushiki Kaisha||Control apparatus for running moving object|
|US4626995 *||Mar 26, 1984||Dec 2, 1986||Ndc Technologies, Inc.||Apparatus and method for optical guidance system for automatic guided vehicle|
|US4647784 *||May 8, 1984||Mar 3, 1987||The General Electric Company Plc||Vehicle guidance and control system|
|US4657220 *||Aug 23, 1985||Apr 14, 1987||W. Vinten Ltd.||Television camera mounting equipment|
|US4751658 *||May 16, 1986||Jun 14, 1988||Denning Mobile Robotics, Inc.||Obstacle avoidance system|
|US4804897 *||Aug 19, 1987||Feb 14, 1989||Hewlett-Packard Company||Orientation-dependant robot controller|
|US4811227 *||Oct 14, 1986||Mar 7, 1989||Wikstroem Sigvard||Method for fine positioning vehicles in extract relationships to geographic reference markings|
|US4811229 *||Jan 5, 1987||Mar 7, 1989||Hewlett-Packard Company||Control system for automatic guided vehicles|
|US4815008 *||May 16, 1986||Mar 21, 1989||Denning Mobile Robotics, Inc.||Orientation adjustment system and robot using same|
|US4816998 *||Dec 20, 1982||Mar 28, 1989||Ab Volvo||Self-piloting vehicle|
|US4817000 *||Mar 10, 1986||Mar 28, 1989||Si Handling Systems, Inc.||Automatic guided vehicle system|
|US4821192 *||Nov 28, 1986||Apr 11, 1989||Denning Mobile Robotics, Inc.||Node map system and method for vehicle|
|US4843566 *||Apr 29, 1988||Jun 27, 1989||Hewlett-Packard Company||Robot motion control system|
|US4847769 *||Jan 6, 1986||Jul 11, 1989||The General Electric Company, P.L.C.||Automated vehicle drift correction|
|US4855822 *||Jan 26, 1988||Aug 8, 1989||Honeywell, Inc.||Human engineered remote driving system|
|US4866617 *||Mar 25, 1987||Sep 12, 1989||Kabushiki Kaisha Komatsu Seisakusho||Method of guiding an unmanned vehicle|
|US4868752 *||Sep 10, 1987||Sep 19, 1989||Kubota Ltd.||Boundary detecting method and apparatus for automatic working vehicle|
|US4887223 *||Jul 20, 1988||Dec 12, 1989||Texas Instruments Incorporated||Visual navigation system for a mobile robot having capabilities of regenerating of hidden images|
|US4939650 *||Jun 14, 1988||Jul 3, 1990||Shinko Electric Co., Ltd.||Path correction method for a self-contained unmanned vehicle|
|US4939651 *||Jun 14, 1988||Jul 3, 1990||Shinko Electric Co., Ltd.||Control method for an unmanned vehicle (robot car)|
|FR2554800A1 *||Title not available|
|GB2053516A *||Title not available|
|JPS63711A *||Title not available|
|JPS59158678A *||Title not available|
|JPS60138616A *||Title not available|
|JPS60196817A *||Title not available|
|1||"CRAFT--a small, prototype AGV for parts transfer between machine tools" D. M. Allen CRAG, Cranfield Institute of Technology, UK, pp. 111-121.|
|2||"Dead reckoning guidance combined with guide path method for AGVs", Komatsu et al., Proc. 5th Int. Conf. Automated Guided Vehicle Systems, Oct. 1987, pp. 123-136.|
|3||*||CRAFT a small, prototype AGV for parts transfer between machine tools D. M. Allen CRAG, Cranfield Institute of Technology, UK, pp. 111 121.|
|4||*||Dead reckoning guidance combined with guide path method for AGVs , Komatsu et al., Proc. 5th Int. Conf. Automated Guided Vehicle Systems, Oct. 1987, pp. 123 136.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US5471385 *||Apr 28, 1993||Nov 28, 1995||Tsubakimoto Chain Co.||Routeless guiding method for moving body|
|US5606368 *||Oct 4, 1994||Feb 25, 1997||Boeckeler Instruments, Inc.||Cable-driven pan and tilt mechanism|
|US5793367 *||Jul 8, 1996||Aug 11, 1998||Canon Kabushiki Kaisha||Apparatus and method for displaying both an image and control information related to the image|
|US6433796||Aug 7, 1998||Aug 13, 2002||Canon Kabushiki Kaisha||Apparatus and method for displaying both an image and control information related to the image|
|US7161620 *||Oct 23, 2001||Jan 9, 2007||Shotoku Ltd.||Moving pedestal for a camera including wheels and sensors for detecting a moving amount thereof|
|US7802802 *||Feb 19, 2005||Sep 28, 2010||Cambotics Inc.||Camera dolly|
|US8209051||Sep 27, 2006||Jun 26, 2012||Intouch Technologies, Inc.||Medical tele-robotic system|
|US8340819||Sep 16, 2009||Dec 25, 2012||Intouch Technologies, Inc.||Mobile videoconferencing robot system with network adaptive driving|
|US8384755||Aug 26, 2009||Feb 26, 2013||Intouch Technologies, Inc.||Portable remote presence robot|
|US8401275||Mar 27, 2009||Mar 19, 2013||Intouch Technologies, Inc.||Mobile robot with a head-based movement mapping scheme|
|US8463435||Jan 6, 2009||Jun 11, 2013||Intouch Technologies, Inc.||Server connectivity control for tele-presence robot|
|US8515577||Nov 5, 2007||Aug 20, 2013||Yulun Wang||Medical tele-robotic system with a master remote station with an arbitrator|
|US8670017||Mar 4, 2010||Mar 11, 2014||Intouch Technologies, Inc.||Remote presence system including a cart that supports a robot face and an overhead camera|
|US8718837||Jan 27, 2012||May 6, 2014||Intouch Technologies||Interfacing with a mobile telepresence robot|
|US8836751||Nov 8, 2011||Sep 16, 2014||Intouch Technologies, Inc.||Tele-presence system with a user interface that displays different communication links|
|US8849679||Nov 25, 2008||Sep 30, 2014||Intouch Technologies, Inc.||Remote controlled robot system that provides medical images|
|US8849680||Jan 29, 2009||Sep 30, 2014||Intouch Technologies, Inc.||Documentation through a remote presence robot|
|US8861750||Mar 28, 2012||Oct 14, 2014||Intouch Technologies, Inc.||Mobile tele-presence system with a microphone system|
|US8892260||Sep 30, 2013||Nov 18, 2014||Irobot Corporation||Mobile robot for telecommunication|
|US8897920||Apr 17, 2009||Nov 25, 2014||Intouch Technologies, Inc.||Tele-presence robot system with software modularity, projector and laser pointer|
|US8902278||Jul 25, 2012||Dec 2, 2014||Intouch Technologies, Inc.||Systems and methods for visualizing and managing telepresence devices in healthcare networks|
|US8930019||Sep 23, 2011||Jan 6, 2015||Irobot Corporation||Mobile human interface robot|
|US8935005||Feb 22, 2011||Jan 13, 2015||Irobot Corporation||Operating a mobile robot|
|US8965579||Jan 27, 2012||Feb 24, 2015||Intouch Technologies||Interfacing with a mobile telepresence robot|
|US8983174||Feb 19, 2013||Mar 17, 2015||Intouch Technologies, Inc.||Mobile robot with a head-based movement mapping scheme|
|US8994776 *||Nov 14, 2011||Mar 31, 2015||Crosswing Inc.||Customizable robotic system|
|US8996165||Oct 21, 2008||Mar 31, 2015||Intouch Technologies, Inc.||Telepresence robot with a camera boom|
|US9014848||Feb 22, 2011||Apr 21, 2015||Irobot Corporation||Mobile robot system|
|US9089972||Jan 16, 2014||Jul 28, 2015||Intouch Technologies, Inc.||Remote presence system including a cart that supports a robot face and an overhead camera|
|US9098611||Mar 14, 2013||Aug 4, 2015||Intouch Technologies, Inc.||Enhanced video interaction for a user interface of a telepresence network|
|US9138891||Nov 25, 2008||Sep 22, 2015||Intouch Technologies, Inc.||Server connectivity control for tele-presence robot|
|US9160783||May 9, 2007||Oct 13, 2015||Intouch Technologies, Inc.||Robot system that operates through a network firewall|
|US9174342||Nov 21, 2014||Nov 3, 2015||Intouch Technologies, Inc.||Social behavior rules for a medical telepresence robot|
|US9193065||Jul 10, 2008||Nov 24, 2015||Intouch Technologies, Inc.||Docking system for a tele-presence robot|
|US9198728||Sep 30, 2005||Dec 1, 2015||Intouch Technologies, Inc.||Multi-camera mobile teleconferencing platform|
|US9251313||Apr 11, 2012||Feb 2, 2016||Intouch Technologies, Inc.||Systems and methods for visualizing and managing telepresence devices in healthcare networks|
|US9264664||Dec 3, 2010||Feb 16, 2016||Intouch Technologies, Inc.||Systems and methods for dynamic bandwidth allocation|
|US9296107||May 10, 2012||Mar 29, 2016||Intouch Technologies, Inc.||Protocol for a remotely controlled videoconferencing robot|
|US9296109||Oct 13, 2014||Mar 29, 2016||Irobot Corporation||Mobile robot for telecommunication|
|US9323250||Aug 2, 2013||Apr 26, 2016||Intouch Technologies, Inc.||Time-dependent navigation of telepresence robots|
|US9361021||Nov 21, 2014||Jun 7, 2016||Irobot Corporation||Graphical user interfaces including touchpad driving interfaces for telemedicine devices|
|US9375843||Jun 18, 2010||Jun 28, 2016||Intouch Technologies, Inc.||Protocol for a remotely controlled videoconferencing robot|
|US9429934||Oct 15, 2013||Aug 30, 2016||Intouch Technologies, Inc.||Mobile videoconferencing robot system with network adaptive driving|
|US9469030||Oct 27, 2015||Oct 18, 2016||Intouch Technologies||Interfacing with a mobile telepresence robot|
|US9498886||Nov 18, 2014||Nov 22, 2016||Irobot Corporation||Mobile human interface robot|
|US9600631 *||Jun 18, 2015||Mar 21, 2017||Intouch Technologies, Inc.||Remote presence system including a cart that supports a robot face and an overhead camera|
|US9602765||May 28, 2014||Mar 21, 2017||Intouch Technologies, Inc.||Portable remote presence robot|
|US9610685||Jan 12, 2010||Apr 4, 2017||Intouch Technologies, Inc.||Graphical interface for a remote presence system|
|US9715337||Aug 7, 2014||Jul 25, 2017||Intouch Technologies, Inc.||Tele-presence system with a user interface that displays different communication links|
|US20020164164 *||Oct 23, 2001||Nov 7, 2002||Shotoku Ltd.||Image pick-up method and image pick-up system|
|US20060076745 *||Feb 19, 2005||Apr 13, 2006||Gordon Gary B||Camera dolly|
|US20070291128 *||Jun 15, 2006||Dec 20, 2007||Yulun Wang||Mobile teleconferencing system that projects an image provided by a mobile robot|
|US20080316368 *||Dec 7, 2006||Dec 25, 2008||Kuka Roboter Gmbh||Method and Device For Moving a Camera Disposed on a Pan/Tilt Head Long a Given Trajectory|
|US20100115418 *||Jan 12, 2010||May 6, 2010||Yulun Wang||Graphical interface for a remote presence system|
|US20100191375 *||Jan 29, 2009||Jul 29, 2010||Wright Timothy C||Documentation through a remote presence robot|
|US20110050841 *||Aug 26, 2009||Mar 3, 2011||Yulun Wang||Portable remote presence robot|
|US20140009561 *||Nov 14, 2011||Jan 9, 2014||Crosswing Inc.||Customizable robotic system|
|US20150286789 *||Jun 18, 2015||Oct 8, 2015||Intouch Technologies, Inc.||Remote presence system including a cart that supports a robot face and an overhead camera|
|USRE45870||Jul 6, 2012||Jan 26, 2016||Intouch Technologies, Inc.||Apparatus and method for patient rounding with a remote controlled robot|
|U.S. Classification||701/26, 348/375, 348/E05.022, 180/167|
|International Classification||F16M11/18, H04N5/222, F16M11/42|
|Cooperative Classification||F16M11/28, F16M11/42, F16M11/18, F16M11/08, H04N5/222|
|European Classification||F16M11/42, F16M11/18, H04N5/222|
|Mar 16, 1993||RR||Request for reexamination filed|
Effective date: 19930203
|Aug 23, 1994||AS||Assignment|
Owner name: TOTAL SPECTRUM MANUFACTURING, INC., NEW YORK
Free format text: CHANGE OF NAME;ASSIGNOR:VINTEN BROADCAST INC.;REEL/FRAME:007115/0390
Effective date: 19930927
Owner name: VINTEN BROADCAST INC., NEW YORK
Free format text: MERGER N.Y. AND DELAWARE;ASSIGNOR:TOTAL SPECTRUM MANUFACTURING, INC.;REEL/FRAME:007113/0556
Effective date: 19940617
Owner name: VINTEN TSM INC., NEW YORK
Free format text: CHANGE OF NAME;ASSIGNOR:TOTAL SPECTRUM MANUFACTURING, INC.;REEL/FRAME:007115/0386
Effective date: 19940609
|Aug 8, 1995||B1||Reexamination certificate first reexamination|
|May 14, 1996||REMI||Maintenance fee reminder mailed|
|Sep 4, 1996||AS||Assignment|
Owner name: BANK OF AMERICA NATIONAL TRUST AND SAVING ASSOCIAT
Free format text: SECURITY AGREEMENT;ASSIGNOR:ATTACHMATE CORPORATION;REEL/FRAME:008119/0163
Effective date: 19960628
|Oct 7, 1996||SULP||Surcharge for late payment|
|Oct 7, 1996||FPAY||Fee payment|
Year of fee payment: 4
|Dec 17, 1996||FP||Expired due to failure to pay maintenance fee|
Effective date: 19961009
|Mar 17, 2000||FPAY||Fee payment|
Year of fee payment: 8
|Apr 9, 2004||SULP||Surcharge for late payment|
Year of fee payment: 11
|Apr 9, 2004||FPAY||Fee payment|
Year of fee payment: 12