WO2003003132A1 - Tuning control parameters for vibration reduction and motion control - Google Patents

Tuning control parameters for vibration reduction and motion control Download PDF

Info

Publication number
WO2003003132A1
WO2003003132A1 PCT/US2002/018929 US0218929W WO03003132A1 WO 2003003132 A1 WO2003003132 A1 WO 2003003132A1 US 0218929 W US0218929 W US 0218929W WO 03003132 A1 WO03003132 A1 WO 03003132A1
Authority
WO
WIPO (PCT)
Prior art keywords
controller
model
motion
data
processor
Prior art date
Application number
PCT/US2002/018929
Other languages
French (fr)
Inventor
Robert N. Jacques
Original Assignee
Cymer, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cymer, Inc. filed Critical Cymer, Inc.
Publication of WO2003003132A1 publication Critical patent/WO2003003132A1/en

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B13/00Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
    • G05B13/02Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
    • G05B13/04Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric involving the use of models or simulators
    • G05B13/042Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric involving the use of models or simulators in which a parameter or coefficient is automatically adjusted to optimise the performance
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B5/00Anti-hunting arrangements
    • G05B5/01Anti-hunting arrangements electric

Definitions

  • the invention relates to the tuning of control parameters relating to vibration reduction and motion control systems, suitable for use for use in, for example, the control of manufacturing equipment and robotic systems.
  • semiconductor chip manufacture can be so sensitive, that tiny ranges of unwanted motion, for example, in the micrometer (m) to nanometer (ran) range, can interfere with components or subsystems that require precise alignment and positioning.
  • the need for such near-exacting precision in chip manufacturing is illustrated, for instance, in the careful matching of a wafer mask to a silicon substrate. Because, in this context, small variances in mask placement may escape detection until the quality control inspection, or worse, until installation in end-products, the need for identifying and quickly correcting the effect of positioning and disturbance-related errors in the first place is of utmost importance.
  • chip throughput requirements have also increased.
  • One consequence of the increased requirements has been a larger positioning bandwidth of photolithography stages.
  • the increase in positioning bandwidth has implicated the need to predict and control flexible deformation modes of stages into the control band of the system. This, coupled with the typical stage's relatively low level of structural damping (arising from the requirement that the stages be both light and stiff), creates a host of scenarios where the stage must be carefully controlled to achieve sustained, near-optimal operational behavior.
  • the need for highly precise control is keenly felt.
  • control system used in such situations should ideally be capable of tuning itself to maximize system performance in the presence of these variations. Also, since optimality of the control system is dependent on magnitude, frequency response, and other characteristics of system disturbances, the control system preferably should notice, adjust and, if necessary, compensate for and overcome unwanted effects of the disturbances.
  • Active vibration and motion control provides one promising method of achieving adequate system governance. Active control is often a suitable technology for dealing with vibration and motion control issues for a number of reasons, such as those discussed in commonly-owned U.S. Serial No. 09/491,969, which is hereby incorporated by reference.
  • unknowns in plant dynamics and unforeseen disturbances to the system being controlled can significantly alter the actual results attained through active structural control, especially when used with sensitive machines such as semiconductor capital equipment.
  • disturbances can manifest themselves in a variety of ways, such as affecting the signals input to the system being controlled, causing variances in sensor signals or by impacting performance variables.
  • uncertainty in stage dynamics, and the impact upon those dynamics caused by changes in equipment configuration, mass distribution, and aging of equipment, subsystems, or components all may serve to limit the performance of any standard control method chosen.
  • direct adaptive controllers compute control gains "adaptively", i.e., directly from measurement errors.
  • these types of controllers guarantee stability via Lyapunov theory.
  • direct controllers usually require that actuators and sensors be collocated and dual to enforce a positive real condition in the transfer functions. In practice, it is often difficult to construct sensor/actuator pairs that yield truly positive real behavior. Either non-idealities, such as amplifier dynamics, violate the condition, or the collocation of actuators and sensors forces an unsatisfactory reduction in closed-loop performance.
  • Tonal controllers are those designed to perform disturbance rejection at one or several discrete frequencies.
  • the disturbance is usually a sinusoid, usually of unknown frequency.
  • the tonal controller typically either adapts to changes in frequency, changes in plant dynamics, or both.
  • This type of control can achieve perfect disturbance rejection (even in non-positive-real systems) in instances where the number of error sensors is less than or equal to the number of actuators and the actuators have sufficient control authority.
  • Self- tuning regulators add an extra step to the adaptation process, namely, the adaptive updating of an internal model in the tuning algorithm.
  • This model is used to compute control gains.
  • These methods generally do not require collocation, and are distinguished from each other primarily by the algorithm used to perform identification (ID) of the internal model.
  • ID methods used in these types of controllers are neural nets, modal parameters, physical structural properties (e.g. mass and stiffness) and families of models that span the parameter variation space.
  • existing self-tuning regulators exhibit several shortcomings that hamper their utility. For example, existing regulators update the controller (and the internal model associated therewith) at each controller cycle. As such, the computations required to ensure stability of the controller's operation are complex and burdensome. In application, there are times when these computations cannot be adequately performed during each controller cycle, such as when the equipment being regulated demands relatively high bandwidth control. In addition, because the equipment being regulated is in operation i.e., "normal use,” while tuning data is acquired, it is undesirable and, sometimes impossible, to inject any alternative "test” actuation signals into the system; thus, any self tuning is solely dependent upon the existing operating signals.
  • McConnell et al. discloses the use of time domain measurements to update a single input, single output open loop controller in U.S. Patent No. 5,594,309. However, this system only provides for adjustment of the input filter used to command the point-to-point movement of the system. It does not provide for adjustment of the controller to account for external disturbances or for trajectory following. Dickerson et al. discloses a form of input command adjustment in U.S. Patent No. 5,946,449, which closely parallels the adjustment performed by Dickerson et al.
  • a system to govern the behavior of a controller used to dictate motion of a machine component.
  • the system includes a sensor that measures data that accurately characterizes the physical behavior of the component. The sensor takes its data reading when the component is not in normal use.
  • the system also includes a processor which dynamically generates a mathematical relation of minimal order based upon which the controller dictates component motion when the component is in normal use.
  • a system to control the physical behavior of an apparatus.
  • the behavior of the apparatus is estimated by an initial behavioral model.
  • the system includes a sensor element, and a processor capable of generating a drive signal, estimating a updated behavioral model and generating a signal according to the controller used to control the behavior of the apparatus.
  • a method for governing motion in a physical system by inducing motion in the physical system, measuring frequency response data and updating an initial behavioral model according to the collected data. Appropriate stimulus is applied to the physical system causing motion in the system, thereby causing the system to behave as desired.
  • a method is provided for creating an updated model for the behavior of a physical system and for deriving optimal controllers based on the updated model
  • FIG. 1 is a schematic illustration of a control system according to the present invention in which tuning is implemented.
  • FIGS. 2, 3, 4 are block diagrams illustrating several different embodiments of tuning systems according to the present invention in which the tuning processing is accomplished.
  • FIG. 5 is a flow ch art illustrating embodiments of the invention in which tuning or updating of the controller is performed.
  • FIG. 6 is a schematic illustration of another embodiment of a control system according to the present invention.
  • FIG. 7 is a schematic illustration of a method for producing a LQG problem specification according to the invention.
  • a motion control system responds to some event, such as an operator command or automated detection of degraded performance by shifting the system into data acquisition mode.
  • events such as an operator command or automated detection of degraded performance by shifting the system into data acquisition mode.
  • events might occur simply as a product of routine maintenance and/or daily line or plant shutdowns, or may occur in case of more serious, equipment malfunction-related causes.
  • transfer function data is collected by injecting signals into all relevant actuators and taking measurements from all sensors of interest.
  • the data is collected in either an open or closed loop fashion.
  • the new data is used to update the model parameters. This is done by using non-linear curve fitting techniques to fit the log magnitude and phase of the transfer function data.
  • the system is suited for use with either single input / single output (SISO) or multi input / multi output (MIMO) models.
  • the new model is used to recompute a new controller.
  • the new controller structure and controller gains are found by re-solving the original optimization problem used to derive the original controller, substituting the new model parameters (gains) and deriving the new controller and its parameters.
  • Typical analytical methods for this are Linear Quadratic Gaussian (LQG), H-infinity, -synthesis and hybrids thereof.
  • LQG Linear Quadratic Gaussian
  • H-infinity H-infinity
  • -synthesis hybrids thereof.
  • At least three new illustrative hardware systems are provided in accordance with the invention.
  • feedback control is performed by a digital signal processor (DSP)-based system.
  • the tuning capability is added by attaching the DSP to a host computer via an appropriate interface.
  • System ID data is passed back to the host computer that performs the model tuning and control redesign and passes the new controller back to the DSP.
  • a second embodiment places all functionality for tuning and control redesign on the DSP.
  • a third embodiment includes a second processor located on the DSP board or a daughter board attached to the DSP-based system.
  • the host computer could be located off-site and thus the data transfer between the host and the DSP could occur over a communications link, such as an ethernet connection or through the use of a product like CymerOnLineTM s a ⁇ so offered by Cymer, Inc.
  • the present invention also allows for taking a relatively few measurements from the system (such as gain and phase at only a few frequencies) and using this information to directly and accurately modify the control gains of the system (direct adaptation).
  • One instance of this is using several measurements to determine the frequency at which a peak in the modal response occurs and the gain and phase at that peak.
  • the gains of an active damping filter are adjusted to maintain the specified loop gain and phase at the peak.
  • the proposed innovation is extremely useful.
  • One existing impediment to implementing gain scheduled controllers in robotics is the amount of time involved to design controllers over a large configuration space.
  • the tuning methodology proposed here would enable the automation of the computation of the gain schedule, thus allowing the operator to formulate one initial controller and allowing a control system according to the invention to iteratively update and refine the controller.
  • the tuning approach according to the invention has several steps, some or all of which are used in different embodiments. These steps generally include system identification, controller updating, control parameter adjustment, and model adjustment.
  • system ID is performed using transfer function data collected between key actuators and sensors in the system.
  • the logarithmic error between the model and the data is penalized in the optimization using the following relation:
  • is a vector of parameters which describe the model (usually input by a user, such as a control engineer)
  • the frequency response of the model from actuator j to sensor i measured at frequency f ⁇ G lk (f k ) is the measured frequency response from actuator j to sensor i measured at frequency f ⁇
  • p is the number of sensors
  • q is the number of actuators
  • N is the number of frequency points of interest.
  • the model is parameterized using a pole-residue form:
  • G Too (f , ⁇ ) for discrete time systems.
  • the elements of the parameter vector, ⁇ are the coefficients, Cj ⁇ , bj ⁇ and pj ⁇ .
  • This parameterization offers two key advantages: 1) it has been demonstrated to have good numeric conditioning; 2) it can represent multivariable systems with minimal order. "Minimal order" in this context means the fewest number of states needed to accurately model the behavior of the plant. Of course, other parameterization methods may used instead, such as polynomial parameterization, pole-zero parameterization, and modal parameterization.
  • the Levenberg-Marquardt algorithm has been demonstrated to be useful in solving this type of curve fitting problem, though other solution methods, including other non-linear curve-fitting methods such as Gauss-Newton, steepest descent and Powell's method, or linear and least squares-type methods, could be used instead.
  • the parameter estimate, ⁇ minimizes the cost function, J( ⁇ ), which can be expressed as a sum of squares of error terms, Pi( ⁇ ).
  • p ljk ( ⁇ )
  • the error terms in this case are the logarithmic transfer function error for each actuator, sensor and frequency of interest.
  • the parameter, ⁇ in this equation is a positive real constant which is varied as the algorithm progresses.
  • J displays more quadratic behavior, the value of the parameter, ⁇ , is decreased.
  • the system ID method used in the invention offers several advantages. For example, since it is based on transfer function data, the quality of the fit can be adjusted based upon frequency range. Thus, the model can be generated to match the data closely in frequency ranges important for control design (e.g., near the loop gain crossover frequency), and allowed to merely approximate the data in frequency ranges where the model information is not important (i.e. frequencies where the control gains have been rolled off). Another advantage stems from the fact that the algorithm includes log magnitude and phase explicitly in the error function used for curve fitting, quantities that are important to good control design. Yet another advantage of the ID method used in the invention is that the model parameterization, cost function, and curve- fitting algorithm together have a very good region of convergence. As a result, the algorithm recovers the optimal fit to the data even when the initial guess has very large errors.
  • x is a stat e vector of the system
  • u is a vector of control inputs
  • Q, R, and N are state and control weighting matrices.
  • E[] is the expectation operator.
  • the information used to create the optimal control problem is the actuator to sensor information. Additionally, it may be desirable to standardize the optimal control problem formulation as much as possible. Toward this end, the inventors have found it possible to reduce specifying the optimal control problem to specifying a finite set of values. A computer program implementing the auto-tuning algorithm reads these values from a file or an alternate communications channel at run-time. Advantageously, this permits a designer to quickly make changes to the optimal control problem formulation, and to observe the effect of these changes in the actual system, without having to recompile the program. This approach is in some regards analogous to being able to download the coefficients specifying a controller at run time.
  • the design problem is typically specified by describing, or at least estimating, the input / output behavior from all disturbances (including sensor noise), w, and controller outputs, u, to all performance variables (including controller penalty), z, and controller inputs, y.
  • this is done by specifying a state space filter which maps disturbances and controller inputs to performance variables and controller outputs.
  • This filter includes frequency-weighting filters used by the designer to adjust the properties of the controller returned by the LQG algorithm as well as the plant dynamics.
  • Figure 7 shows the most general way in which an actuator to sensor model can be combined with weighting sensors to produce a full LQG problem specification.
  • This figure uses filters E ⁇ , E2, E3, O ⁇ £>2, ⁇ , and F2 to specify the relationship between disturbances, w, performance variables, z, controller inputs, y, controller outputs, u, plant inputs, r, and plant outputs, s.
  • the identified actuator to sensor model and the filter, F completely describe an LQG problem formulation, and since the solution of the LQG problem is unique, the filter, F, completely describes a mapping from an identified model to a controller.
  • the filter, F is thus universally applicable, obviating the need for programming a new filter for each configuration of equipment, thus saving time, money, processing power, and computer programmer time. Indeed, to specify this map, the designer only needs to provide the coefficients, i.e., a vector of numbers, describing a state space model of the filter.
  • the control parameters themselves may be adjusted using techniques such as non-linear optimization to minimize a more general set of cost functions:
  • J F(Q, ⁇ C ) where ⁇ is the vector of model parameters, and ⁇ c is a vector of controller parameters.
  • is the vector of model parameters
  • ⁇ c is a vector of controller parameters.
  • multi-model optimization where the LQG cost function is optimized simultaneously for several different actuator to sensor models. This approach provides a controller which is less sensitive to variations.
  • the multiple models can either be obtained directly from the plant by performing system identification with the plant in different configurations, or it can be obtained by applying parametric variations to a single identified model (such as varying modal frequencies).
  • control parameters may be adjusted using techniques such as non-linear optimization to minimize a more general set of cost functions:
  • FIG. 1 shows a schematic illustration of a control system 80 according to the invention in which tuning is implemented.
  • a switch 10 selects an output 12 of a controller 21 (typically a computer processor) as an input 13 to a plant 20 ("plant” being used herein as a generic term for the system being controlled, such as manufacturing equipment).
  • plant being used herein as a generic term for the system being controlled, such as manufacturing equipment.
  • the system 80 is switched to tuning mode, the plant input 13 is switched to a function generator 15.
  • Signals going into the plant, i.e., plant input 13, and coming out of the plant, i.e. plant output 17 (from sensors in the plant), including the addition of any system disturbances 9, are analyzed and an internal model of the system is updated to reflect the new data.
  • Model estimation 18 is passed to a tuning algorithm 19, which adjusts or tunes the controller 21 to maximize stability and performance.
  • the updated, or tuned, controller parameters are then installed or written into the controller 21 at, for example, an electronic memory location. Then, the switch 10 is toggled to begin controlling the system in normal operation.
  • Figure 2 adds detail to the plant, in this case, manufacturing equipment 20, and shows a procedure by which control parameters can be updated for manufacturing equipment 20, where equipment 20 is shown as including sensor(s) 25, actuators or motor(s) 23 and manufacturing equipment 24.
  • an event 51 occurs which causes the system to switch the controller 21 into data acquisition mode 52.
  • Events 51 that might initiate this change include a command generated by an operator, a command generated as a result of a clock in communication with the system, or a change in the performance of the system.
  • the controller 21 when the controller 21 is placed into data acquisition mode, it generates a drive signal that is applied to amplifier(s) 22, which then applies a signal to the actuators/motors 23.
  • the actuators/motors 23 command some motion or action in the manufacturing equipment 24.
  • the motion of action results in the sensor(s) 25 generating at least one sensor signal that is at least partly responsive to, or indicative of, the motion or action generated by the actuators 23 on the manufacturing equipment 24.
  • the sensor signal is then conditioned by signal conditioner 26 and passed back to the controller 21.
  • the controller 21 would follow the procedure illustrated in Figure 5 following the point in which the system acquires new data in data acquisition mode 53.
  • Figure 3 shows an alternative procedure by which control parameters can be updated for a system or plant 20.
  • an event 51 occurs which causes the system to switch the secondary processor (or a host personal computer PC) 27 into data acquisition mode 52.
  • Events 51 that might initiate this change include a command generated by an operator, a command generated as a result of a clock in communication with the system, or a change in the performance of the system.
  • the secondary processor 27 when the secondary processor 27 is placed into data acquisition mode it generates at least one signal that is applied to amplifier(s) 22, which then applies at least one signal to the actuators or motors 23.
  • the actuators or motors 23 command some motion or action in the manufacturing equipment 24.
  • the motion or action results in the sensor(s) 25 generating at least one sensor signal that is at least partly responsive to the motion or action generated by the actuators 23 upon the manufacturing equipment 24.
  • the sensor signal is then conditioned and passed back to the processor 27.
  • processor 27 would follow the procedure illustrated in Figure 5 following the point at which the system acquires new data in data acquisition mode 53. Once the new controller or control parameters, 55 or 56, are created according to Figure 5, secondary processor 27 would write or install the controller or control parameters into processor 21. The system would then switch into controller mode 58.
  • FIG 4 shows an embodiment of the procedure where an event 51 commands the system to enter data acquisition mode 52. This command to enter data acquisition mode is first communicated to the controller 21 which then communicates with secondary processor 27. Secondary processor 27 then continues with the procedure as described in Figure 3.
  • Figure 6 illustrates one embodiment of a feedback control system that could be used on a piece of manufacturing equipment.
  • the manufacturing equipment 40 sends a signal 81 to a commumcation module 41.
  • the module 41 then sends the signal to the processor 42.
  • This signal may correspond to the event 51 that is described as part of Figure 5.
  • the processor 41 then sends a signal to amplifier 46 that then sends a signal 87 to the actuator/motor 45.
  • Actuator/motor 45 then acts on the manufacturing equipment 40.
  • a sensor 44 measures the behavior of the manufacturing equipment 40 due to the effect the actuator/motor has upon the manufacturing equipment 40.
  • the sensor 44 then sends a signal to signal conditioning unit 43.
  • Signal conditioning unit 43 then sends signal 85 to the processor.
  • processor 42 might be Model SBC67 supplied by Alternative Integration Inc. with offices in Simi Valley, CA. This processor is a high performance stand-alone digital signal processor single board computer featuring analog input and output capability.

Abstract

The invention is directed to acquiring and processing parameters used to adjust and tune a controller (21) used, for example, to govern and compensate for motion, including vibrations and distrubances, in a physical system, such as a piece of manufacturing equipment (24). The invention may also be used to control, for example, a robot or other spatially dependent machine. Included in the invention are systems and methods for generating a controller (21), and for controlling motion in a physical system or apparatus.

Description

TUNING CONTROL PARAMETERS OF VIBRATION REDUCTION AND
MOTION CONTROL
ROBOTIC SYSTEMS
Field of the Invention
The invention relates to the tuning of control parameters relating to vibration reduction and motion control systems, suitable for use for use in, for example, the control of manufacturing equipment and robotic systems.
Background of the Invention The ability to accurately and controllably reduce vibration, and to otherwise precisely control motion, is a coveted capability useful in governing the behavior of a wide variety of manufacturing processes and equipment. For example, it is well-known that semiconductor capital equipment, such as lithography stages, laser light sources, metrology stages, pick-and place-equipment and wafer-handling robots, must operate within specifically calibrated, relatively fault-intolerant operational ranges of movement and other physical conditions. Beyond these ranges, the products produced by such equipment, and the equipment itself, may be defective or nonfunctional.
Indeed, semiconductor chip manufacture can be so sensitive, that tiny ranges of unwanted motion, for example, in the micrometer (m) to nanometer (ran) range, can interfere with components or subsystems that require precise alignment and positioning. The need for such near-exacting precision in chip manufacturing is illustrated, for instance, in the careful matching of a wafer mask to a silicon substrate. Because, in this context, small variances in mask placement may escape detection until the quality control inspection, or worse, until installation in end-products, the need for identifying and quickly correcting the effect of positioning and disturbance-related errors in the first place is of utmost importance.
As chip-making technology has advanced, for example, through the use of advanced photolithography lasers such as those sold by Cymer, Inc. of San Diego, California, chip throughput requirements have also increased. One consequence of the increased requirements has been a larger positioning bandwidth of photolithography stages. However, with greater bandwidth has come increases in the attendant motion or stage control issues. For example, among other effects upon manufacturing, the increase in positioning bandwidth has implicated the need to predict and control flexible deformation modes of stages into the control band of the system. This, coupled with the typical stage's relatively low level of structural damping (arising from the requirement that the stages be both light and stiff), creates a host of scenarios where the stage must be carefully controlled to achieve sustained, near-optimal operational behavior. Here again, the need for highly precise control is keenly felt.
Any control system used in such situations should ideally be capable of tuning itself to maximize system performance in the presence of these variations. Also, since optimality of the control system is dependent on magnitude, frequency response, and other characteristics of system disturbances, the control system preferably should notice, adjust and, if necessary, compensate for and overcome unwanted effects of the disturbances.
Active vibration and motion control provides one promising method of achieving adequate system governance. Active control is often a suitable technology for dealing with vibration and motion control issues for a number of reasons, such as those discussed in commonly-owned U.S. Serial No. 09/491,969, which is hereby incorporated by reference. However, unknowns in plant dynamics and unforeseen disturbances to the system being controlled can significantly alter the actual results attained through active structural control, especially when used with sensitive machines such as semiconductor capital equipment. In this context, disturbances can manifest themselves in a variety of ways, such as affecting the signals input to the system being controlled, causing variances in sensor signals or by impacting performance variables. In addition, uncertainty in stage dynamics, and the impact upon those dynamics caused by changes in equipment configuration, mass distribution, and aging of equipment, subsystems, or components, all may serve to limit the performance of any standard control method chosen.
The shortcomings of active control are especially appreciated when taken from a predictable laboratory setting to the rigors of the factory floor. In laboratory tests, one can characterize the system being controlled, including experimentally induced disturbances, before closing the loops and then adjust the control gains to get the best possible response out of the system. In this manner, it is possible to eliminate much of the uncertainty about a system's input/output behavior in a specified frequency range, especially when using modem system identification techniques. In real world applications, however, it is more difficult to recreate system performance identical to that observed in the lab. Part-to-part variation results in differences in response to control inputs, even between nominally identical systems, and even when using the same controller. Changes in environment and equipment configuration can cause sometimes difficult to pinpoint modeling errors because they can vary from location to location and may also vary with time. These issues often arise in the case of semiconductor fabrication equipment, where the dynamics of the individual system may not be completely known until it has been deployed and used in the factory. Furthermore, the exact character of a disturbance in physical conditions, let alone specific disturbance frequencies, may not be known ahead of time with the precision needed to optimize performance and can be time-varying themselves.
Researchers have been addressing these issues outside of the semiconductor industry by applying adaptive control techniques to the structural control problem. The thrust of these efforts has been to make the adaptive control algorithms as general as possible, with the goal of making a controller which uses an unchanging theoretical model to work for all conceivable systems under all conditions. Such an ideal controller usually is necessarily (and undesirably) complex for most practical applications and, in use, may limit the performance of the controller. In addition, if the model of the plant changes as a function of time, the performance of the controller may be limited if these changes are not captured in the model.
Some research in the area of adaptive control has focused on its application to flexible structures. Roughly, the favored approaches of these efforts can be divided into three classes of feedback control: direct adaptive control, self-tuning regulators, and tonal controllers. The direct adaptive controllers compute control gains "adaptively", i.e., directly from measurement errors. In general, these types of controllers guarantee stability via Lyapunov theory. However, direct controllers usually require that actuators and sensors be collocated and dual to enforce a positive real condition in the transfer functions. In practice, it is often difficult to construct sensor/actuator pairs that yield truly positive real behavior. Either non-idealities, such as amplifier dynamics, violate the condition, or the collocation of actuators and sensors forces an unsatisfactory reduction in closed-loop performance.
Tonal controllers are those designed to perform disturbance rejection at one or several discrete frequencies. The disturbance is usually a sinusoid, usually of unknown frequency. The tonal controller typically either adapts to changes in frequency, changes in plant dynamics, or both. This type of control can achieve perfect disturbance rejection (even in non-positive-real systems) in instances where the number of error sensors is less than or equal to the number of actuators and the actuators have sufficient control authority. Self- tuning regulators add an extra step to the adaptation process, namely, the adaptive updating of an internal model in the tuning algorithm. This model is used to compute control gains. These methods generally do not require collocation, and are distinguished from each other primarily by the algorithm used to perform identification (ID) of the internal model. Among the ID methods used in these types of controllers are neural nets, modal parameters, physical structural properties (e.g. mass and stiffness) and families of models that span the parameter variation space.
Generally, existing self-tuning regulators exhibit several shortcomings that hamper their utility. For example, existing regulators update the controller (and the internal model associated therewith) at each controller cycle. As such, the computations required to ensure stability of the controller's operation are complex and burdensome. In application, there are times when these computations cannot be adequately performed during each controller cycle, such as when the equipment being regulated demands relatively high bandwidth control. In addition, because the equipment being regulated is in operation i.e., "normal use," while tuning data is acquired, it is undesirable and, sometimes impossible, to inject any alternative "test" actuation signals into the system; thus, any self tuning is solely dependent upon the existing operating signals. The result is that there are times where these operating signals do not adequately excite the dynamics of the plant to a level necessary to obtain a high fidelity model of the plant dynamics. Since a controller, to some degree, is only as good as the plant model upon which it depends, model fidelity can directly limit the performance of the controller. Thus, in order to better characterize the plant, the ability to introduce an alternative excitation signal would be desirable. Attempting to tune controller parameters during system operation is an additional layer of complexity that is frequently excessive and unnecessary too most manufacturing applications. Indeed, many of the advantages of adaptive control, without the limitations imposed by non-linear stability requirements, can be realized by occasionally taking a manufacturing machine off-line i.e., "abnormal use," to gather system data and tune the controller parameters based on the new data. This concept of tuning control parameters at infrequent intervals to improve performance of feedback control systems has been implemented in the context of tuning a proportional plus-integral-plus-derivative (PID) controller. Recent work extends PID auto-tuning concepts to multivariable systems, albeit systems with a few degrees of freedom or states, usually only suitable for measuring a maximum of three parameters: frequency, amplitude, and phase of a signal. Since only three parameters are measured, it is only possible to modify a controller for a system that is a second order (or lower) dynamic system. This constraint hampers the usefulness of this method.
Moreover, it is typically only possible to apply this method to single-input, single-output PID controllers, making it poorly suited for dynamically complex multi-input, multi- output systems typical of semiconductor manufacturing equipment. Manufacturing equipment often requires more than about 16, and sometimes as many as 32 or more, states to accurately model the system and to control it adequately. Other work has extended the concept to multivariable systems, and employs the use of non-linear curve fitting to match models to frequency response measurements. That work, however, has been generally limited to large flexible structures, such as spacecraft, and used several very high powered computers, including a Cray supercomputer, to implement the algorithms. Also, it assumed that transfer functions from disturbances and from actuators to performance variables could be measured. In addition, the prior work required the creation of unique mathematical filters for every given system configuration, which in turn required the services of a computer programmer to effectively create new software unique to any given control situation. As a result, prior attempts to tune control parameters in an off-line scenario have required large amounts of experimental data and significant amounts of processing time at uncommon processing speeds to achieve results. Such methods, using specialized equipment and expertise, proves to be impractical in a typical manufacturing setting for all but the most time- and cost-insensitive applications. Other prior systems and methods further demonstrate the need for a practical, novel approach to self-tuning regulators. For example, tuning of a portion of a control system is practiced by McConnell et al. in U.S. Patent Nos. 6,011,373 and 6,002,232, and Singer, et al. in U.S. Patent No. 4,916,635. However, the adjustment performed is considered to be command shaping. In these scenarios, adjustment of the input commands is performed rather than adjustment of the feedback controller used to regulate the operation of the system. This adjustment to the input command is in response to errors measured from previous input commands. The disadvantage of this method is that it does not address external disturbances.
McConnell et al. discloses the use of time domain measurements to update a single input, single output open loop controller in U.S. Patent No. 5,594,309. However, this system only provides for adjustment of the input filter used to command the point-to-point movement of the system. It does not provide for adjustment of the controller to account for external disturbances or for trajectory following. Dickerson et al. discloses a form of input command adjustment in U.S. Patent No. 5,946,449, which closely parallels the adjustment performed by Dickerson et al.
In U.S. Patent No. 6,076,951, Wang et al. disclose a system that employs relay feedback or step input, where a linear least squares curve fit is employed to derive the desired controller. In this case, a direct inversion of the desired closed loop performance is conducted. The controller structure and gains are derived directly from a system identification fit of the closed loop performance using a polynomial parameterization of the control. This method has poor numeric conditioning and, as such, usually will not converge to the correct model for large order (i.e., greater than 10 states) systems. In addition, the use of a step or relay input to the system does not always provide enough information about the dynamic behavior of the plant. WO 00/41043 by Tan et al. discloses a system that provides for adjustment of gain values for a PI controller using time domain data to determine how to adjust the system. This disclosure does not address updating of model parameters, but rather, requires that the model be known. As such, the performance of the system is not robust to variations in the plant.
Summary of the Invention In accordance with the present invention, there are provided systems and methods that address the shortcomings of prior controller tuning and motion control attempts, with a minimum addition of hardware.
Thus, according to one aspect of the invention, a system is provided to govern the behavior of a controller used to dictate motion of a machine component. The system includes a sensor that measures data that accurately characterizes the physical behavior of the component. The sensor takes its data reading when the component is not in normal use. The system also includes a processor which dynamically generates a mathematical relation of minimal order based upon which the controller dictates component motion when the component is in normal use.
According to another aspect of the invention, a system is provided to control the physical behavior of an apparatus. The behavior of the apparatus is estimated by an initial behavioral model. The system includes a sensor element, and a processor capable of generating a drive signal, estimating a updated behavioral model and generating a signal according to the controller used to control the behavior of the apparatus.
According to a third aspect of the invention, a method is provided for governing motion in a physical system by inducing motion in the physical system, measuring frequency response data and updating an initial behavioral model according to the collected data. Appropriate stimulus is applied to the physical system causing motion in the system, thereby causing the system to behave as desired. According to yet another aspect of the invention, a method is provided for creating an updated model for the behavior of a physical system and for deriving optimal controllers based on the updated model
Brief Description of the Drawings
FIG. 1 is a schematic illustration of a control system according to the present invention in which tuning is implemented.
FIGS. 2, 3, 4 are block diagrams illustrating several different embodiments of tuning systems according to the present invention in which the tuning processing is accomplished.
FIG. 5 is a flow ch art illustrating embodiments of the invention in which tuning or updating of the controller is performed.
FIG. 6 is a schematic illustration of another embodiment of a control system according to the present invention.
FIG. 7 is a schematic illustration of a method for producing a LQG problem specification according to the invention.
Detailed Description
The systems and methods of the invention extend, for example, to fabrication equipment and robotic systems and to dealing with servo and tracking problems. The invention, in one regard, contemplates its application to command following, and does so in a sufficiently timely manner to allow it to be implemented in a typical semiconductor fabrication facility, although the invention is equally applicable to other scenarios, such as typical disturbance rejection problems. Thus, according to one aspect of the invention, a motion control system responds to some event, such as an operator command or automated detection of degraded performance by shifting the system into data acquisition mode. Such events, by way of example, might occur simply as a product of routine maintenance and/or daily line or plant shutdowns, or may occur in case of more serious, equipment malfunction-related causes. In this mode, transfer function data is collected by injecting signals into all relevant actuators and taking measurements from all sensors of interest. The data is collected in either an open or closed loop fashion. Using the previous model as an initial guess, the new data is used to update the model parameters. This is done by using non-linear curve fitting techniques to fit the log magnitude and phase of the transfer function data. The system is suited for use with either single input / single output (SISO) or multi input / multi output (MIMO) models. The new model is used to recompute a new controller. In one example, the new controller structure and controller gains are found by re-solving the original optimization problem used to derive the original controller, substituting the new model parameters (gains) and deriving the new controller and its parameters. Typical analytical methods for this are Linear Quadratic Gaussian (LQG), H-infinity, -synthesis and hybrids thereof. The new controller is loaded and the controller is restarted.
In addition to the methods and processes encompassed by the invention, at least three new illustrative hardware systems are provided in accordance with the invention. In the first embodiment, feedback control is performed by a digital signal processor (DSP)-based system. The tuning capability is added by attaching the DSP to a host computer via an appropriate interface. System ID data is passed back to the host computer that performs the model tuning and control redesign and passes the new controller back to the DSP. A second embodiment places all functionality for tuning and control redesign on the DSP. A third embodiment includes a second processor located on the DSP board or a daughter board attached to the DSP-based system. Of course, one possessing ordinary skill in the art will appreciate that other hardware configurations that remain within the scope of the invention are possible. For example, in the first embodiment, the host computer could be located off-site and thus the data transfer between the host and the DSP could occur over a communications link, such as an ethernet connection or through the use of a product like CymerOnLineTM s aιso offered by Cymer, Inc.
The present invention also allows for taking a relatively few measurements from the system (such as gain and phase at only a few frequencies) and using this information to directly and accurately modify the control gains of the system (direct adaptation). One instance of this is using several measurements to determine the frequency at which a peak in the modal response occurs and the gain and phase at that peak. The gains of an active damping filter are adjusted to maintain the specified loop gain and phase at the peak. In systems that have configuration dependent or operating point dependent dynamics, such as robots, the proposed innovation is extremely useful. One existing impediment to implementing gain scheduled controllers in robotics is the amount of time involved to design controllers over a large configuration space. The tuning methodology proposed here would enable the automation of the computation of the gain schedule, thus allowing the operator to formulate one initial controller and allowing a control system according to the invention to iteratively update and refine the controller.
Generally speaking, in order to fully characterize a system of interest, one provides information regarding the physical configuration of the system, e.g., the number and placement of actuators and sensors in relation to system components (the "plant"), as well as information regarding the desired control behavior of the system. This information is then processed to yield a "controller", which is a mathematical command structure according to which the system will be governed. It is important to note that the present invention does not specifically require user-input regarding system disturbances, which often are unforeseen. Thus, the tuning approach according to the invention has several steps, some or all of which are used in different embodiments. These steps generally include system identification, controller updating, control parameter adjustment, and model adjustment.
System Identification
The process of updating an internal model to match measured data is system identification ("ID"). In a one possible embodiment, system ID is performed using transfer function data collected between key actuators and sensors in the system. The logarithmic error between the model and the data is penalized in the optimization using the following relation:
Figure imgf000012_0001
where θ is a vector of parameters which describe the model (usually input by a user, such as a control engineer),
Figure imgf000012_0002
the frequency response of the model from actuator j to sensor i measured at frequency f^,Glk(fk) is the measured frequency response from actuator j to sensor i measured at frequency f^. p is the number of sensors, q is the number of actuators, and N is the number of frequency points of interest. The model is parameterized using a pole-residue form:
G (f , θ) = V -. — — — r for continuous time systems. k=1 (j2πf -p
G„ (f , θ) = for discrete time systems.
Figure imgf000013_0001
where the elements of the parameter vector, θ, are the coefficients, Cj^, bjφ and pjς. This parameterization offers two key advantages: 1) it has been demonstrated to have good numeric conditioning; 2) it can represent multivariable systems with minimal order. "Minimal order" in this context means the fewest number of states needed to accurately model the behavior of the plant. Of course, other parameterization methods may used instead, such as polynomial parameterization, pole-zero parameterization, and modal parameterization.
The Levenberg-Marquardt algorithm has been demonstrated to be useful in solving this type of curve fitting problem, though other solution methods, including other non-linear curve-fitting methods such as Gauss-Newton, steepest descent and Powell's method, or linear and least squares-type methods, could be used instead. The parameter estimate, θ, minimizes the cost function, J(θ), which can be expressed as a sum of squares of error terms, Pi(θ). nout nin npts θ = argminj(θ) = ∑∑∑|pljk(θ) = ∑|p,(θ)2
1=1 j=l k=l
The error terms in this case are the logarithmic transfer function error for each actuator, sensor and frequency of interest.
Figure imgf000013_0002
The parameter estimate is found iteratively. First, define the gradient and Hessian approximations for the cost function, J:
Figure imgf000014_0001
J"(θ)
Figure imgf000014_0002
At each iteration, a new search direction is computed by solving the equation:
Figure imgf000014_0003
The parameter, λ, in this equation is a positive real constant which is varied as the algorithm progresses. As the cost function, J displays more quadratic behavior, the value of the parameter, λ, is decreased. The parameter vector for the next iteration is found by minimizing the cost function over this search direction: θ ("+0 = θ (<) + δθ(,)argmin j(θ(,) + αδθ(,)) a
The system ID method used in the invention, such as the one described above, offers several advantages. For example, since it is based on transfer function data, the quality of the fit can be adjusted based upon frequency range. Thus, the model can be generated to match the data closely in frequency ranges important for control design (e.g., near the loop gain crossover frequency), and allowed to merely approximate the data in frequency ranges where the model information is not important (i.e. frequencies where the control gains have been rolled off). Another advantage stems from the fact that the algorithm includes log magnitude and phase explicitly in the error function used for curve fitting, quantities that are important to good control design. Yet another advantage of the ID method used in the invention is that the model parameterization, cost function, and curve- fitting algorithm together have a very good region of convergence. As a result, the algorithm recovers the optimal fit to the data even when the initial guess has very large errors.
Updating The Controller
Once the model has been updated, it may be desirable to update the controller gains. This is usually done by constructing and solving an optimal control problem, such as is described by a properly formulated Linear Quadratic Gaussian (LQG) problem. A compensator is generated during the solution of this problem by minimizing the following equation:
Figure imgf000015_0001
when the system is subject to Gaussian white noise on disturbances and sensors. In this equation, x is a stat e vector of the system, u is a vector of control inputs, and Q, R, and N are state and control weighting matrices. E[] is the expectation operator.
Notably, the information used to create the optimal control problem is the actuator to sensor information. Additionally, it may be desirable to standardize the optimal control problem formulation as much as possible. Toward this end, the inventors have found it possible to reduce specifying the optimal control problem to specifying a finite set of values. A computer program implementing the auto-tuning algorithm reads these values from a file or an alternate communications channel at run-time. Advantageously, this permits a designer to quickly make changes to the optimal control problem formulation, and to observe the effect of these changes in the actual system, without having to recompile the program. This approach is in some regards analogous to being able to download the coefficients specifying a controller at run time.
In practice, keeping with the LQG method by way of example, the design problem is typically specified by describing, or at least estimating, the input / output behavior from all disturbances (including sensor noise), w, and controller outputs, u, to all performance variables (including controller penalty), z, and controller inputs, y. In general, this is done by specifying a state space filter which maps disturbances and controller inputs to performance variables and controller outputs. This filter includes frequency-weighting filters used by the designer to adjust the properties of the controller returned by the LQG algorithm as well as the plant dynamics.
For automated controller design, it is usually necessary to separate the plant dynamics from the frequency weighting filters. Figure 7 shows the most general way in which an actuator to sensor model can be combined with weighting sensors to produce a full LQG problem specification. This figure uses filters E^, E2, E3, O\£>2, ¥\, and F2 to specify the relationship between disturbances, w, performance variables, z, controller inputs, y, controller outputs, u, plant inputs, r, and plant outputs, s. Mathematically these relationships are expressed as: z = E,w + E2u + E3s r = F,w + D,u y = F2w + D2s or in more compact form:
Figure imgf000016_0001
The identified actuator to sensor model and the filter, F, completely describe an LQG problem formulation, and since the solution of the LQG problem is unique, the filter, F, completely describes a mapping from an identified model to a controller. The filter, F, is thus universally applicable, obviating the need for programming a new filter for each configuration of equipment, thus saving time, money, processing power, and computer programmer time. Indeed, to specify this map, the designer only needs to provide the coefficients, i.e., a vector of numbers, describing a state space model of the filter. Alternatively, instead of updating the controller gains as described above, the control parameters themselves may be adjusted using techniques such as non-linear optimization to minimize a more general set of cost functions:
J = F(Q, ΘC) where θ is the vector of model parameters, and θc is a vector of controller parameters. An example of this is multi-model optimization, where the LQG cost function is optimized simultaneously for several different actuator to sensor models. This approach provides a controller which is less sensitive to variations. The multiple models can either be obtained directly from the plant by performing system identification with the plant in different configurations, or it can be obtained by applying parametric variations to a single identified model (such as varying modal frequencies).
Another example where applying non-linear optimization to adjust the control parameters is the case when the LQG problem is as specified above, but the controller order is fixed to be less than the total number of plant and filter states. In this case, the normal LQG solution (which returns a controller with order equal to the total number of plant and filter states), cannot be used. Instead, the optimal controller is found by using iterative search methods.
Alternatively, instead of updating the controller gains as described above, the control parameters may be adjusted using techniques such as non-linear optimization to minimize a more general set of cost functions:
J = (θ,θc) where θ is the vector of model parameters, and θc is a vector of controller parameters.
Additionally, this approach to tuning can be used to adjust the controller directly from the measured data, without performing system ID. In this case, key controller parameters are explicitly made functions of the measured response. θe = H(Gy(fk),i = l...p,j = l..4, k = \.. *) By way of example, this final case of tuning could be useful for updating or tuning positive position feedback (PPF) compensators in which the goal of the controller is to damp out vibration in a piece of manufacturing equipment. Figure 1 shows a schematic illustration of a control system 80 according to the invention in which tuning is implemented. In normal mode, a switch 10 selects an output 12 of a controller 21 (typically a computer processor) as an input 13 to a plant 20 ("plant" being used herein as a generic term for the system being controlled, such as manufacturing equipment). When the system 80 is switched to tuning mode, the plant input 13 is switched to a function generator 15. Signals going into the plant, i.e., plant input 13, and coming out of the plant, i.e. plant output 17 (from sensors in the plant), including the addition of any system disturbances 9, are analyzed and an internal model of the system is updated to reflect the new data. Model estimation 18 is passed to a tuning algorithm 19, which adjusts or tunes the controller 21 to maximize stability and performance. The updated, or tuned, controller parameters are then installed or written into the controller 21 at, for example, an electronic memory location. Then, the switch 10 is toggled to begin controlling the system in normal operation.
Figure 2 adds detail to the plant, in this case, manufacturing equipment 20, and shows a procedure by which control parameters can be updated for manufacturing equipment 20, where equipment 20 is shown as including sensor(s) 25, actuators or motor(s) 23 and manufacturing equipment 24. In this embodiment, an event 51 occurs which causes the system to switch the controller 21 into data acquisition mode 52. Events 51 that might initiate this change include a command generated by an operator, a command generated as a result of a clock in communication with the system, or a change in the performance of the system. In this embodiment, when the controller 21 is placed into data acquisition mode, it generates a drive signal that is applied to amplifier(s) 22, which then applies a signal to the actuators/motors 23. The actuators/motors 23 command some motion or action in the manufacturing equipment 24. The motion of action results in the sensor(s) 25 generating at least one sensor signal that is at least partly responsive to, or indicative of, the motion or action generated by the actuators 23 on the manufacturing equipment 24. The sensor signal is then conditioned by signal conditioner 26 and passed back to the controller 21. At this point, the controller 21 would follow the procedure illustrated in Figure 5 following the point in which the system acquires new data in data acquisition mode 53. Figure 3 shows an alternative procedure by which control parameters can be updated for a system or plant 20. In this embodiment, an event 51 occurs which causes the system to switch the secondary processor (or a host personal computer PC) 27 into data acquisition mode 52. Events 51 that might initiate this change include a command generated by an operator, a command generated as a result of a clock in communication with the system, or a change in the performance of the system. In this embodiment, when the secondary processor 27 is placed into data acquisition mode it generates at least one signal that is applied to amplifier(s) 22, which then applies at least one signal to the actuators or motors 23. The actuators or motors 23 command some motion or action in the manufacturing equipment 24. The motion or action results in the sensor(s) 25 generating at least one sensor signal that is at least partly responsive to the motion or action generated by the actuators 23 upon the manufacturing equipment 24. The sensor signal is then conditioned and passed back to the processor 27. At this point, the processor 27 would follow the procedure illustrated in Figure 5 following the point at which the system acquires new data in data acquisition mode 53. Once the new controller or control parameters, 55 or 56, are created according to Figure 5, secondary processor 27 would write or install the controller or control parameters into processor 21. The system would then switch into controller mode 58.
Figure 4 shows an embodiment of the procedure where an event 51 commands the system to enter data acquisition mode 52. This command to enter data acquisition mode is first communicated to the controller 21 which then communicates with secondary processor 27. Secondary processor 27 then continues with the procedure as described in Figure 3.
Figure 6 illustrates one embodiment of a feedback control system that could be used on a piece of manufacturing equipment. In this embodiment, the manufacturing equipment 40 sends a signal 81 to a commumcation module 41. The module 41 then sends the signal to the processor 42. This signal may correspond to the event 51 that is described as part of Figure 5. The processor 41 then sends a signal to amplifier 46 that then sends a signal 87 to the actuator/motor 45. Actuator/motor 45 then acts on the manufacturing equipment 40. A sensor 44 then measures the behavior of the manufacturing equipment 40 due to the effect the actuator/motor has upon the manufacturing equipment 40. The sensor 44 then sends a signal to signal conditioning unit 43. Signal conditioning unit 43 then sends signal 85 to the processor. By way of example, processor 42 might be Model SBC67 supplied by Innovative Integration Inc. with offices in Simi Valley, CA. This processor is a high performance stand-alone digital signal processor single board computer featuring analog input and output capability.
Equivalents
While the invention has been particularly shown and described with reference to specific preferred embodiments, it should be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

What is claimed is:
1. A system for controlling the physical behavior of an apparatus, the behavior of the apparatus estimated by an initial behavioral model, the system comprising: a sensor element located in proximity to the apparatus for acquiring data indicative of the physical behavior of the apparatus; a system processor which includes a tunable controller based on the initial behavioral model, the processor capable of generating a drive signal, estimating a behavioral model, tuning and adjusting the controller and generating a control signal, wherein the processor adapts the initial model to an updated model based upon the gathered data, combines the updated model with a universal filter to create a relation that describes the behavior of the apparatus and creates a controller based on the relation such that the controller is tuned according to the updated model, and wherein the control signal generated by the processor according to the controller is used to control the physical behavior of the apparatus.
2. The system of claim 1 , wherein the drive signal causes motion in the apparatus.
3. The system of claim 1, wherein the relation is formulated as an optimal control problem.
4. The system of claim 3, wherein the relation is solved by a method chosen from the group of methods consisting of: linear quadratic gaussian (LQG), H-infinity and - synthesis.
5. The system of claim 1, wherein the universal filter includes a set of numbers provided by a user of the system.
6. The system of claim 1 , wherein the universal filter is
Figure imgf000021_0001
where E\, E2, E3, O\,O2, F\, and F2 are filters that specify the relationship between a disturbance, w, at least one performance variable of the apparatus, z, at least one controller input to the apparatus, y, at least one controller output, u, at least one plant input, r, and at least one plant output, s.
7. The system of claim 1 wherein the controller is a digital signal processor (DSP).
8. The system of claim 1 further comprising a second processor in data communication with the system processor.
9. The system of claim 8, wherein the second processor is portable from the location of the system processor.
10. The system of claim 1, wherein the system begins acquiring data upon occurrence of a predefined event.
11. The system of claim 10, wherein the predefined event is an event selected from the group of events consisting of: input received from an operator, exceeding a threshold operating value in the apparatus, and the passage of a predetermined length of time.
12. The system of claim 1, further comprising an actuator in electrical communication with the system processor, wherein the drive signal causes activation of the actuator and wherein the actuator is located such that the physical behavior of the apparatus is modified by the activation of the actuator.
13. The system of claim 12, wherein transfer function data is collected between the actuator and the sensor element.
14. The system of claim 13, wherein the sensor element gathers frequency data and wherein the accuracy of the updated model is adjustable as a function of the gathered frequency data.
15. The system of claim 1, wherein the system processor further includes a signal conditioner.
16. The system of claim 1, wherein the system processor further includes a signal amplifier.
17. The system of claim 1, wherein the updated model is a model of minimal order.
18. The system of claim 1 , wherein the relation is a multivariate and fully coupled.
19. The system of claim 1, wherein the processor creates the updated model by nonlinear curve-fitting thereby describing the updated model by a known mathematical equation according to the data gathered by the sensor.
20. The system of claim 19, wherein an error function is associated with the known mathematical equation, the error function including log magnitude and phase information.
21. The system of claim 13, wherein the logarithmic error between the collected data and the initial behavioral model is:
Figure imgf000023_0001
where θ is a vector of parameters which describe the model, is the frequency response of the model from actuator j to sensor i measured at frequency f^, is the measured frequency response from actuator j to sensor i measured at frequency f^. p is the number of sensors, q is the number of actuators, and N is the number of frequency points of interest.
22. A system for governing a controller of the type usable to dictate motion of a machine component in normal use, comprising: a sensor which measures data that accurately characterizes the physical behavior of the component, the data measuring occurring during an abnormal period triggered by an event, the measured data being indicative of the behavior of the machine component when in normal use; and a signal processor which dynamically generates and uses a multivariable, fully- coupled mathematical relation of minimal order in conjunction with a universal filter to create a controller, the controller dictating motion after the abnormal period has ceased and when the equipment component is in normal use.
23. The system of claim 22, wherein the mathematical relation provides an accurate model of the normal motion characteristics of the equipment component and the controller is created by using a method chosen from the group of methods consisting of: linear quadratic gaussian (LQG), H-infinity and -synthesis.
24. The system of claim 23, wherein the mathematical relation includes at least one parameter for governing the controller and wherein the parameter is a function of data measured by the sensor.
25. A method for governing motion in a physical system, the physical system being estimated by an initial behavioral model, comprising the steps of inducing motion in the physical system, measuring frequency data which characterizes the motion in the system, updating the initial behavioral model to create an updated behavioral model which accurately conforms to the measured data, using the updated behavioral model in conjunction with a universal filter to create a command structure and applying appropriate stimulus to the system to cause motion in the physical system, thereby causing the physical system to behave in accordance with the command structure.
26. A method for creating an updated model for the motion characteristics of a physical system from a previously stored model of the system, the updated model governing the actions of a system controller which dictates motion in the physical system, comprising the steps of: detecting the occurrence of a start event; gathering data relating to the motion characteristics of the physical system; updating the stored model by comparing the gathered data to the stored model; and iteratively adapting the stored model until the stored model predicts the motion characteristics of the system according to the gathered data; and storing the updated model at an electronic memory location accessible to the system controller.
27. The method of claim 23, wherein the step of gathering data comprises acquiring a frequency response to an induced motion to the physical system.
28. The method of claim 23, wherein the step of comparing the data comprises fitting a non-linear curve to the gathered data.
29. A method for controlling movement of a mechanical apparatus based on the spatial location of a movable portion of the mechanical apparatus, the movement of the portion initially estimated by a first mathematical model and governed by a first controller which is based on the first mathematical model and a mathematical filter, comprising the steps of: introducing a first signal to induce motion in the movable portion; measuring the motion and spatial location of the movable portion in response to the first signal; updating the first mathematical model to generate a second mathematical model which approximates the motion of the movable portion and updating the first controller using the second mathematical model and the filter to create and solve an optimal control problem and thereby generate a second controller, such that the motion induced when a second signal is applied to the mechanical apparatus is well-predicted.
30. A method of creating a controller of the type employed by a user to govern motion in a physical system comprising the steps of: generating an identification of the system by measuring the response of the system to commands; accepting input from the user specifying certain parameters of the system; applying a universal filter to the input from the user to create a user-defined behavioral range for the physical system; creating a problem specification from the identification of the system and the behavioral range; and solving the problem specification, thereby creating the controller.
31. A system for creating a controller of the type used by a user to govern motion in a physical system comprising: means for generating an identification of the system by measuring the response of the system to commands; means for accepting input from the user specifying certain parameters of the system; means for applying a universal filter to the input from the user to create a user- defined behavioral range for the physical system; means for creating a problem specification from the identification of the system and the behavioral range; and means for solving the problem specification, thereby creating the controller.
PCT/US2002/018929 2001-06-29 2002-06-12 Tuning control parameters for vibration reduction and motion control WO2003003132A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/896,689 2001-06-29
US09/896,689 US7158840B2 (en) 2001-06-29 2001-06-29 Tuning control parameters of vibration reduction and motion control systems for fabrication equipment and robotic systems

Publications (1)

Publication Number Publication Date
WO2003003132A1 true WO2003003132A1 (en) 2003-01-09

Family

ID=25406642

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2002/018929 WO2003003132A1 (en) 2001-06-29 2002-06-12 Tuning control parameters for vibration reduction and motion control

Country Status (2)

Country Link
US (1) US7158840B2 (en)
WO (1) WO2003003132A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1978409A1 (en) * 2007-04-05 2008-10-08 ASML Netherlands BV Lithographic apparatus and device manufacturing method

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7085692B2 (en) * 2001-10-11 2006-08-01 Xerox Corporation Learning systems and methods for market-based control of smart matter
US7158900B2 (en) * 2002-01-07 2007-01-02 Siemens Energy & Automation, Inc. Pulse output function for programmable logic controller
EP1546870A2 (en) 2002-06-03 2005-06-29 Siemens Energy & Automation, Inc. A wizard for programming an intelligent module
US20040117043A1 (en) * 2002-09-07 2004-06-17 Igor Touzov Optimized calibration data based methods for parallel digital feedback, and digital automation controls
EP1547732A4 (en) * 2002-10-01 2012-01-04 Sony Corp Robot device and control method of robot device
US6982537B2 (en) * 2003-03-31 2006-01-03 Delphi Technologies, Inc. Identification of parameters for switched reluctance electric machines
US7194320B2 (en) 2003-06-05 2007-03-20 Neuco, Inc. Method for implementing indirect controller
US20050271110A1 (en) * 2003-08-22 2005-12-08 Rainer Paetzel Excimer laser system with stable beam output
US7415446B2 (en) * 2003-10-20 2008-08-19 General Cybernation Group, Inc. Model-free adaptive (MFA) optimization
US20060217819A1 (en) * 2005-03-23 2006-09-28 Chengyu Cao Low-pass adaptive/neural controller device and method with improved transient performance
FR2887044B1 (en) * 2005-06-10 2007-08-10 Wuilfert Societe Par Actions S DEVICE FOR AUTOMATICALLY ADJUSTING THE ASSISTANCE OF A MECHANICAL MOTION SIMULATOR AND DEVICE THEREFOR
US7363094B2 (en) * 2006-01-09 2008-04-22 General Electric Company Multivariable controller design method for multiple input/outputs systems with multiple input/output constraints
WO2010023768A1 (en) * 2008-08-28 2010-03-04 日産自動車株式会社 Vehicle operation sound control apparatus and control method
US20100170244A1 (en) * 2008-09-03 2010-07-08 Brooks Martin T Robust multiple input multiple output control in a high variability system
US9335761B2 (en) * 2008-09-30 2016-05-10 Rockwell Automation Technologies, Inc. Procedure classification for industrial automation
US8451431B2 (en) * 2009-01-27 2013-05-28 Nikon Corporation Control systems and methods applying iterative feedback tuning for feed-forward and synchronization control of microlithography stages and the like
US8467888B2 (en) * 2009-06-05 2013-06-18 The Mathworks, Inc. Automated PID controller design
DE102009048951A1 (en) * 2009-10-10 2011-04-14 Robert Bosch Gmbh Method for modeling a page register control loop for a processing machine
US9158291B1 (en) * 2010-06-04 2015-10-13 The Mathworks, Inc. Automatic H-infinity optimization for multivariable control systems
US9280146B2 (en) * 2011-02-14 2016-03-08 The Mathworks, Inc. Multi-model, multi-objective tuning of control systems
CN102866631B (en) * 2011-12-31 2015-09-09 上海绿地建设(集团)有限公司 Based on the response of buildings to earthquake Intelligent Control method of Online SVM
JP5877908B2 (en) * 2012-10-24 2016-03-08 東京エレクトロン株式会社 Correction value calculation apparatus, correction value calculation method, and computer program
US9886008B1 (en) 2013-06-07 2018-02-06 The Mathworks, Inc. Automated PID controller design, using parameters that satisfy a merit function
US10061275B2 (en) * 2014-07-29 2018-08-28 Linestream Technologies Optimized parameterization of active disturbance rejection control
WO2017035461A1 (en) * 2015-08-27 2017-03-02 University Of Washington Methods for controlling equipment and controlled equipment using inverse user models
JP2017102619A (en) * 2015-11-30 2017-06-08 オムロン株式会社 Control parameter adjustment device, control parameter adjustment method, and control parameter adjustment program
JP6432494B2 (en) * 2015-11-30 2018-12-05 オムロン株式会社 Monitoring device, monitoring system, monitoring program, and recording medium
DE102018201411A1 (en) * 2018-01-30 2019-08-01 Robert Bosch Gmbh Method for determining a time course of a measured variable, prognosis system, actuator control system, method for training the actuator control system, training system, computer program and machine-readable storage medium
KR102375355B1 (en) * 2020-11-20 2022-03-16 강릉원주대학교 산학협력단 System and control method including robust optimal disturbance observer for high-precision position control performed by electronic devices

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5991525A (en) * 1997-08-22 1999-11-23 Voyan Technology Method for real-time nonlinear system state estimation and control
US6128541A (en) * 1997-10-15 2000-10-03 Fisher Controls International, Inc. Optimal auto-tuner for use in a process control network

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3767900A (en) * 1971-06-23 1973-10-23 Cons Paper Inc Adaptive controller having optimal filtering
US4973215A (en) 1986-02-18 1990-11-27 Robotics Research Corporation Industrial robot with servo
US4916635A (en) 1988-09-12 1990-04-10 Massachusetts Institute Of Technology Shaping command inputs to minimize unwanted dynamics
US5299459A (en) * 1990-05-21 1994-04-05 Underwood Marcos A Adaptive control method for multiexciter sine tests
DE69018837T2 (en) 1990-05-21 1995-08-24 Marcos A Underwood ADAPTIVE CONTROL FOR TESTS WITH SINE MULTIPLE EXCITATION.
US5367612A (en) 1990-10-30 1994-11-22 Science Applications International Corporation Neurocontrolled adaptive process control system
GB2252424B (en) * 1990-11-24 1994-10-05 Dowty Aerospace Gloucester Adaptive control servosystems
US5167002A (en) 1991-08-14 1992-11-24 Fridhandler Robert M Electric motor driver control
US5144595A (en) * 1992-01-27 1992-09-01 The United States Of America As Represented By The Secretary Of The Navy Adaptive statistical filter providing improved performance for target motion analysis noise discrimination
EP0778559B1 (en) 1992-03-12 2001-08-08 Honda Giken Kogyo Kabushiki Kaisha Vibration/noise control system for vehicles
JP2756629B2 (en) 1992-11-19 1998-05-25 本田技研工業株式会社 Adaptive control device
JPH0775937A (en) * 1993-09-07 1995-03-20 Sodick Co Ltd Machine tool and control method thereof
US6791098B2 (en) * 1994-01-27 2004-09-14 Cymer, Inc. Multi-input, multi-output motion control for lithography system
JP3572486B2 (en) 1994-03-25 2004-10-06 本田技研工業株式会社 Vibration noise control device
US5610848A (en) 1994-05-13 1997-03-11 Hughes Aircraft Company Robust resonance reduction using staggered posicast filters
US5594309A (en) 1994-06-15 1997-01-14 Iowa State University Research Foundation, Inc. Robot control scheme
US5604413A (en) 1994-09-07 1997-02-18 Polytechnic University Apparatus for improving operational performance of a machine or device
US5968187A (en) * 1995-08-09 1999-10-19 Ncr Corporation Computer system and method including a portable portion that has a capability to diagnose and perform analysis for a stationary position and for a portable portion
US5691896A (en) * 1995-08-15 1997-11-25 Rosemount, Inc. Field based process control system with auto-tuning
US6249712B1 (en) * 1995-09-26 2001-06-19 William J. N-O. Boiquaye Adaptive control process and system
US5960969A (en) 1996-01-26 1999-10-05 Habisohn; Chris Xavier Method for damping load oscillations on a crane
JP3956057B2 (en) * 1996-01-31 2007-08-08 エイエスエム アメリカ インコーポレイテッド Model reference predictive control of heat treatment
US5946449A (en) 1996-04-05 1999-08-31 Georgia Tech Research Corporation Precision apparatus with non-rigid, imprecise structure, and method for operating same
US5816122A (en) 1996-04-30 1998-10-06 General Dynamics Advanced Technology Systems, Inc. Apparatus and method for adaptive suppression of vibrations in mechanical systems
US6078844A (en) 1996-05-15 2000-06-20 Georgia Tech Research Corp. Optimal arbitrary time-delay (OAT) filter and method to minimize unwanted system dynamics
US5930476A (en) * 1996-05-29 1999-07-27 Sun Microsystems, Inc. Apparatus and method for generating automatic customized event requests
US6076951A (en) 1996-10-16 2000-06-20 National University Of Singapore Frequency-domain adaptive controller
US5845236A (en) 1996-10-16 1998-12-01 Lord Corporation Hybrid active-passive noise and vibration control system for aircraft
US6002232A (en) 1997-08-15 1999-12-14 Iowa State University Research Foundation, Inc. Robust vibration suppression methods and systems
US6285972B1 (en) * 1998-10-21 2001-09-04 Mts Systems Corporation Generating a nonlinear model and generating drive signals for simulation testing using the same
SG82592A1 (en) 1998-12-30 2001-08-21 Univ Singapore A novel predictive and self-tuning pi control apparatus for expanded process control applications
US6361483B1 (en) 1999-10-22 2002-03-26 Morrison Berkshire, Inc. System for controlling vibration of a dynamic surface
WO2001092974A2 (en) * 2000-05-27 2001-12-06 Georgia Tech Research Corporation Adaptive control system having direct output feedback and related apparatuses and methods
US6577908B1 (en) * 2000-06-20 2003-06-10 Fisher Rosemount Systems, Inc Adaptive feedback/feedforward PID controller
AU2001265362A1 (en) * 2000-06-30 2002-01-14 The Dow Chemical Company Multi-variable matrix process control
WO2002005042A2 (en) * 2000-07-12 2002-01-17 Aspen Technology, Inc. Automated closed loop step testing of process units

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5991525A (en) * 1997-08-22 1999-11-23 Voyan Technology Method for real-time nonlinear system state estimation and control
US6285971B1 (en) * 1997-08-22 2001-09-04 Voyan Technology Method for real-time nonlinear system state estimation and control
US6128541A (en) * 1997-10-15 2000-10-03 Fisher Controls International, Inc. Optimal auto-tuner for use in a process control network

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1978409A1 (en) * 2007-04-05 2008-10-08 ASML Netherlands BV Lithographic apparatus and device manufacturing method
US7710540B2 (en) 2007-04-05 2010-05-04 Asml Netherlands B.V. Lithographic apparatus and device manufacturing method

Also Published As

Publication number Publication date
US20030028266A1 (en) 2003-02-06
US7158840B2 (en) 2007-01-02

Similar Documents

Publication Publication Date Title
US7158840B2 (en) Tuning control parameters of vibration reduction and motion control systems for fabrication equipment and robotic systems
US8041436B2 (en) Scaling and parameterizing a controller
Dumont et al. Concepts, methods and techniques in adaptive control
Wojsznis et al. Practical approach to tuning MPC
US20020099475A1 (en) Method and device for vibration control
US20010014834A1 (en) Adaptation to unmeasured variables
Douat et al. Identification and vibration attenuation for the parallel robot Par2
Oveisi et al. Observer‐based repetitive model predictive control in active vibration suppression
US20200133210A1 (en) Apparatus and Methods for Non-Invasive Closed Loop Step Testing with Controllable Optimization Relaxation
Barton et al. Cross-coupled ILC for improved precision motion control: Design and implementation
Zhang et al. Digital PID controller design for delayed multivariable systems
Heertjes et al. Self-tuning in sliding mode control of high-precision motion systems
Klauser et al. Data-driven LPV Control for Micro-disturbance Rejection in a Hybrid Isolation Platform
JP7207474B1 (en) Information processing equipment
Silva et al. A study on Non-parametric Filtering in Linear and Nonlinear Control Loops using the Singular Spectrum Analysis
JP7207473B1 (en) Information processing equipment
Arefin et al. Vibration Tests of a Spacecraft via a Switched Robust Controller-based Virtual Shaker
Gao An algorithmic approach to loop shaping with applications to self-tuning control systems
Patil et al. Design and Analysis of IO and FO Controllers to Investigate the Effects of Process Parameter Perturbations on Lag-Dominant Time Delay Systems
Thunberg et al. Iterative Evaluation and Control Methods for Disturbance Suppression on a High Precision Motion Servo
Crespo et al. A first and second order moment approach to probabilistic control synthesis
Yurdakul Self-tuning PID control with experimental applications
JPH06324711A (en) Design system device for mechanism control system
Lin et al. Smart Structure Technology for Rotor Blade Tip Clearance Control Using a Beam Model
Frame et al. Sliding mode control of a non-collocated flexible system

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP