WO2007053766A2 - Cooling components across a continuum - Google Patents

Cooling components across a continuum Download PDF

Info

Publication number
WO2007053766A2
WO2007053766A2 PCT/US2006/042927 US2006042927W WO2007053766A2 WO 2007053766 A2 WO2007053766 A2 WO 2007053766A2 US 2006042927 W US2006042927 W US 2006042927W WO 2007053766 A2 WO2007053766 A2 WO 2007053766A2
Authority
WO
WIPO (PCT)
Prior art keywords
continuum
levels
control scheme
policies
data
Prior art date
Application number
PCT/US2006/042927
Other languages
French (fr)
Other versions
WO2007053766A3 (en
Inventor
Chandrakant D. Patel
Cullen E. Bash
Ratnesh K. Sharma
Chris G. Malone
Original Assignee
Hewlett-Packard Development Company L.P.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett-Packard Development Company L.P. filed Critical Hewlett-Packard Development Company L.P.
Priority to EP06836867A priority Critical patent/EP1943579A2/en
Priority to CN2006800501865A priority patent/CN101356485B/en
Publication of WO2007053766A2 publication Critical patent/WO2007053766A2/en
Publication of WO2007053766A3 publication Critical patent/WO2007053766A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/20Cooling means
    • G06F1/206Cooling means comprising thermal management
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Definitions

  • a data center may be defined as a location, for instance, a room that houses computer systems arranged in a number of racks.
  • a standard rack for instance, an electronics cabinet, is defined as an Electronics Industry Association (EIA) enclosure, 78 in. (2 meters) wide, 24 in.
  • EIA Electronics Industry Association
  • racks (0.61 meter) wide and 30 in. (0.76 meter) deep.
  • These racks are configured to house a number of computer systems, about forty (40) systems, with future configurations of racks being designed to accommodate 200 or more systems.
  • the computer systems typically dissipate relatively significant amounts of heat during the operation of the respective components. For example, a typical computer system comprising multiple microprocessors may dissipate approximately 250
  • a rack containing forty (40) computer systems of this type may dissipate approximately 10 KW of power.
  • a method of cooling components across a continuum having a plurality of levels is disclosed.
  • detected data related to the components across the continuum is received and evaluated.
  • a control scheme is developed based upon the evaluated data, where the control scheme is configured to manipulate one or more actuators across a plurality of levels.
  • the actuators across the plurality of levels are manipulated in accordance with the developed control scheme.
  • FIG. IA shows a block diagram of a cooling control system according to an embodiment of the invention
  • FIG. IB shows a block diagram of a computational continuum, according to an embodiment of the invention.
  • FIG. 1C shows a block diagram of a cooling control system according to another embodiment of the invention.
  • FIG. 2 shows a flow diagram of a method for cooling components across a continuum, according to an embodiment of the invention.
  • FIG. 3 illustrates a computer system, which may be employed to perform the various functions of the cooling control systems, according to an embodiment of the invention.
  • a holistic approach to cooling components in a room is disclosed herein. More particularly, the disclosed method for cooling the components crosses multiple levels of a continuum to achieve one or more policies.
  • one or more control schemes may be developed based upon evaluated data indicating that one or more policies are not being met.
  • the one or more control schemes may be implemented across the continuum.
  • FIG. IA there is shown a block diagram of a cooling control system 100, according to an example. It should be understood that the following description of the cooling control system 100 is but one manner of a variety of different manners in which such a cooling control system 100 may be operated. In addition, it should be understood that the cooling control system 100 may include additional components and that some of the components described may be removed and/or modified without departing from a scope of the cooling control system 100.
  • the cooling control system 100 is configured to control cooling at multiple component levels in a holistic manner.
  • the multiple component levels may be considered as a continuum 120 (shown in FIG. 1 B) for purposes of control because the cooling control system 100 is configured to control actuators associated with each of the multiple levels under a holistic control scheme.
  • the cooling control system 100 may be operated in various manners to substantially increase the compaction and density of components in a room.
  • the cooling control system 100 may implement one or more algorithms designed to reduce or minimize the amount of energy consumed in cooling the components at a plurality of the multiple levels.
  • the multiple levels in a computational environment may include, for instance, a chip level, a system level, a rack level, a row level, a zonal level, a room level, etc.
  • FIG. IB only a chip level 122, a system level 124, and a room level 126 are shown for purposes of simplicity of illustration. It should, however, be understood that the computational continuum 120 shown in FIG. IB may include any number of levels as described above.
  • the arrows 128 generally signify that information and policy assignments may be transferred among the different levels 122-126.
  • the cooling control system 100 includes a continuum controller 102 configured to perform evaluation and control operations in the cooling control system 100.
  • the continuum controller 102 is depicted as comprising a single device, the evaluation and control operations performed by the continuum controller 102 may be performed by any number of different devices without departing from a scope of the cooling control system 100.
  • the continuum controller 102 may comprise a microprocessor, a micro-controller, an. application specific integrated circuit (ASIC), and the like, configured to perform the various evaluation and control operations described herein.
  • ASIC application specific integrated circuit
  • the continuum controller 102 is configured to receive input from a sensor network 104.
  • the sensor network 104 includes a plurality of sensors 106a-106n, where "n" is an integer greater than one.
  • the sensors 106a-106n may be positioned to detect one or more conditions, such as, temperature, absolute humidity, pressure, airflow direction, airflow magnitude, etc., at various locations with respect to the continuum 120. More particularly, the sensors 106a-106n may be positioned to detect the one or more conditions at multiple levels 122- 126 with respect to the continuum 120.
  • At least one of the sensors 106a-106n may be positioned to detect a condition around a heat generating component, such as, a processor, a micro-controller, a high-speed video card, a memory, a semi-conductor device, and the like.
  • a condition around a heat generating component such as, a processor, a micro-controller, a high-speed video card, a memory, a semi-conductor device, and the like.
  • another of the sensors 106a-106n may be positioned to detect a condition around a heat generating system, such as, a server, a hard drive, a monitor, and the like.
  • another of the sensors 106a- 106n may be positioned to detect a condition at a location in the room housing the components of the continuum 120.
  • the data pertaining to the conditions detected by the sensors 106a-106n may be transmitted to the continuum controller 102 through a network represented by the arrow 108.
  • the network 108 generally represents a wired or wireless structure in the computing environment for the transmission of data between the various components of the cooling control system 100.
  • the network 108 may comprise an existing network infrastructure or it may comprise a separate network configuration installed for the purpose of controlling cooling by the continuum controller 102.
  • the sensors 106a- 106n and/or the continuum controller 102 may be equipped with or have access to software and/or hardware to enable these devices to transmit and/or receive data over the network 108.
  • the continuum controller 102 may store the data received from the sensors 106a- 106n in a memory 110.
  • the continuum controller 102 may be in communication with the memory 110 through, for instance, a memory bus represented by the arrow 112.
  • the memory 110 may form part of the continuum controller 102.
  • the memory 110 may be configured to provide storage of software, algorithms, and the like, that provide the functionality of the continuum controller 102.
  • the memory 110 may store an operating system, application programs, program data, and the like.
  • the memory 110 may be implemented as a combination of volatile and non-volatile memory, such as DRAM, EEPROM, MRAM, flash memory, and the like.
  • the memory 110 may comprise a device configured to read from and write to a removable media, such as, a floppy disk, a CD-ROM, a DVD-ROM, or other optical or magnetic media.
  • the memory 110 may also store an evaluation module 114 and a control module 116, which the continuum controller 102 may implement to control cooling provisioning in the continuum 120.
  • the evaluation module 114 may comprise one or more algorithms that the continuum controller 102 may implement in evaluating the data received from the sensors 106a- 106n.
  • the evaluation module 114 may be implemented to evaluate the data to determine how one or more actuators 118a- 118n, where "n" is an integer greater than one, that affect cooling provisioning may be operated to meet one or more policies.
  • suitable policies include, for instance, thermal management based polices, energy efficiency based policies, irreversibility based policies, and performance based policies.
  • Thermal management based policies are generally designed to ensure that proper temperatures are maintained at maximum performance levels.
  • Energy efficiency based policies are designed to substantially optimize energy efficiencies of the devices contained in the computing environment.
  • Irreversibility based policies are designed to reduce the thermodynamic irreversibility of the devices by substantially optimizing flow work, thermodynamic work, and heat transfer.
  • the continuum controller 102 may implement the control module 116 to develop control schemes for operating the actuators 118a- 118n across the continuum 120 to achieve or meet one or more of the policies.
  • the control schemes may further be developed according to various policies, such as, operational policies and sustainability policies.
  • Operational policies may be employed to govern the operation of the computational and environmental resources in the continuum 120 at, for instance, the chip, system, and room levels 122-126.
  • operational policies may prescribe required computational performance, prevent or mitigate failures in the cooling control system, provide thermal management, meet a wide variety of potential user needs, etc.
  • operational policies may enable the selection to increase the reaction time to air conditioning failures by having redundancy or lower temperature at the expense of greater energy use.
  • Sustainability policies may be employed to affect the operational cost of the cooling control system 100 or reduce the effect of the computing resources on the environment in which it is contained by substantially improving operational efficiency and reducing irreversibilities.
  • sustainability policies may enable the operation of cooling system s at higher temperatures to save energy at the expense of lower reaction time.
  • the policies may be weighted according to user needs and priorities and may be dynamic.
  • the policies may target elements in the continuum 120, such as, individual chips, servers, racks, etc., or the policies may target the continuum 120 as a whole.
  • the computational performance policies may have more weight at night at the expense of operational cost policies when the cost of electricity is relatively low. Conversely, in the daytime, as the cost of electricity rises, performance policies may have less weight.
  • the weightings may change with changes in user priorities.
  • Policies may also be defined to govern the placement of computational workload within the continuum 120 or within computing environments located across the globe. These policies may be based upon sustainability criteria either internally or externally to the computing environments.
  • the mechanism and structure of this type of policy may be based upon a grid computing configuration as described, for instance, in "Energy Aware GRID: Global Service Placement based on Energy Efficiency of the Cooling Infrastructure", authored by Chandrakant D. Patel et al., and published in the ASME International Mechanical Engineering Conference and Exposition, Washington, D.C., USA.
  • An example of an implementation of computational workload placement within computing environments located at various geographic locations is described in co-pending and commonly assigned U.S. Patent Application Serial No. 10/820,786, filed on April 9, 2004 and entitled “Workload Placement Among Data Centers Based on Thermal Efficiency", the disclosure of which is hereby incorporated by reference in its entirety.
  • the continuum controller 102 may transmit or otherwise send instructions pertaining to the developed control schemes to one or more of the actuators 118a- 118n. More particularly, for instance, the continuum controller 102 may send instructions to one or more of the actuators 118a- 118n to vary conditions affected by the actuators 118a- 118n to meet one or more of the policies discussed above.
  • the actuators 118a-118n may include any controllable component designed to deliver a given resource, such as, coolant, cooling airflow, cooling fluid, refrigerant, etc., or designed to produce a contaminant, such as, heat, heated airflow, etc.
  • the actuators 1 ISa-118n may also range in size and may be operable to affect cooling and/or heating at the multiple levels of the continuum 120.
  • the sensors 106a-106n and the actuators 118a-118n associated with one or more chips may be configured as disclosed in commonly assigned U.S. Patent No. 6,612,120, entitled “Spray Cooling with Local Control of Nozzles", the disclosure of which is hereby incorporated by reference in its entirety.
  • the sensors 106a- 106n and the actuators 118 a- 118n associated with one or more chips may be configured as disclosed in commonly assigned U.S. Patent No. 6,904,968, entitled “Method and Apparatus for Individually Cooling Components of Electronic Systems", the disclosure of which is hereby incorporated by reference in its entirety.
  • the sensors 106a-106n may comprise temperature sensors positioned at various locations in a server.
  • the actuators 118a-118n may comprise one or more fans positioned to direct airflow through the server as disclosed in commonly assigned U.S. Patent No. TBD (Attorney Docket No. 200312051-1, filed on December 17, 2003), entitled “Cooling System for Electronic Components", the disclosure of which is hereby incorporated by reference in its entirety.
  • the sensors 106a-106n and the actuators 118a-118n may comprise refrigerated cooling components as disclosed in commonly assigned U.S. PatentNo. TBD (Attorney Docket No. 100110202-1, filed on February 5, 2002), entitled “Method and Apparatus for Cooling Heat Generating Components", the disclosure of which is hereby incorporated by reference in its entirety.
  • the sensois 106a-106n and the actuates 11 Sa-11 Sn may be configured and operated as disclosed in commonly assigned U.S. Patent No. 6,574,104, entitled “Smart Cooling of Data Centers", the disclosure of which is hereby incorporated by reference in its entirety.
  • the actuators 118a-l 18n may comprise one or both of air conditioning units and controllable vent tiles.
  • the sensors 106a-106n and the actuators 118a-l 18n may be configured and operated as disclosed in commonly assigned U.S. Patent No. TBD (Attorney Docket No. 200314965-1, filed on May 26, 2004), entitled “Energy Efficient CRAC Unit Operation", the disclosure of which is hereby incorporated by reference in its entirety.
  • FIG. 1C there is shown a block diagram of a cooling control system 100', according to another example. As shown, the cooling control system 100' has a relatively different configuration as compared to the cooling control system 100 depicted in FIG. IA. It should be understood that the following description of the cooling control system 100' is but one manner of a variety of different manners in which such a cooling control system 100' may be operated. In addition, it should be understood that the cooling control system 100' may include additional components and that some of the components described may be removed and/or modified without departing from a scope of the cooling control system 100'.
  • the cooling control system 100' does not include the continuum controller 102 depicted in FIG. IA. Instead, the cooling control system 100' is depicted with each of the multiple levels 122-126 of the continuum 120 being in communication with each other. Thus, as described in greater detail herein below, in contrast to the cooling control system 100 depicted in FIG. IA, information and policies may be transmitted to each other instead of having a centralized controller, such as the continuum controller 102.
  • any reasonably suitable number of the multiple levels 122-126 may be included in the cooling control system 100' without departing from a scope of the cooling control system 100'.
  • single ones of the multiple levels 122- 126 have been depicted for purposes of simplicity and not of limitation.
  • levels other than those depicted in FIG. 1C may be included in the cooling control system 100' without departing from a scope of the cooling control system 100'. These levels may include, for instance, a rack level, a row of racks level, a cluster of racks level, etc.
  • Each of the multiple levels 122-126 includes a respective controller 152, 162, and 172. More particularly, the chip level 122 is depicted as including a chip level controller 152, the system level 124 is depicted as including a system level controller 162, and the room level 126 is depicted as including a room level controller 172.
  • the controllers 152, 162, and 172 may comprise a microprocessor, a micro-controller, an application specific integrated circuit (ASIC), and the like, configured to perform the various evaluation and control operations described herein. In addition, the controllers 152, 162, and 172 may communicate with each other as indicated by the arrows 128.
  • the controller 152, 162, 172 may communicate information pertaining to conditions detected by the sensor network 104 to each other.
  • the sensor network 104 is depicted as being configured to detect one or more conditions at the respective levels 122-126.
  • the chip level 122 includes a chip sensor network 154 that may comprise one or more of the sensors 106a-106n depicted in FIG. IA.
  • the system level 124 includes a system sensor network 164 that may also include one or more of the sensors 106a-106n and the room level 126 includes a room sensor network 174 that may further include one or more of the sensors 106a-106n.
  • one ormore ofthe sensors l06a-106n mayformpartof more than one of the levels 122-126.
  • the conditions detected by one or more of the sensors 106a-106n may be used to evaluate conditions at more than one level 122-126.
  • Each of the levels 122-126 may also include respective memories 156, 166, 176 configured to provide storage of software, algorithms, and the like, that provide the functionalities of the controllers 152, 162, 172.
  • the memories 156, 166, 176 may store operating systems, application programs, program data, and the like.
  • the memories 156, 166, 176 may each be implemented as a combination ofvolatile and non-volatile memory, such as DRAM, EEPROM, MRAM, flash memory, and the like.
  • the memories 156, 166, 176 may each comprise a device configured to read from and write to a removable media, such as, a floppy disk, a CD-ROM, a DVD-ROM, or other optical or magnetic media.
  • the memories 156, 166, 176 may each store algorithms designed to enable the controllers 152, 162, 172 to control respective actuators 158, 168, 178, which may include one or more of the actuators 118a- 118n depicted in FIG. IA.
  • the memories 156, 166, 176 may each store one or more algorithms designed to enable the cooling control system 100' to be operated in a holistic manner.
  • the one or more algorithms stored in the memories 156, 166, 176 may be implemented by their respective controllers 152, 162, 172 based upon one or more of the policies described above, evaluated based upon information obtained from the controllers 152, 162, 172 of each of the levels 122-126.
  • the controllers 152, 162, 172 may collectively perform various operations ofthe continuum controller 102 described above.
  • the controllers 152, 162, 172 maybe configured to implement an evaluation module 114 and a control module 116.
  • the controllers 152, 162, 172 are configured to control their respective actuatois 158, 168, 178,based upon data pertaining to a plurality of levels in the continuum 120 and thus implement a holistic control scheme.
  • a description of a manner in which the controllers 152, 162, 172 operate is set forth below with respect to FIG. 2.
  • FIG.2 there is shown a flow diagram of a method 200 for cooling electronic components across a continuum 120, according to an example. It is to be understood that the following description of the method 200 is but one manner of a variety of different manners in which an example ofthe invention may be practiced. It should also be apparent to those of ordinary skill in the art that the method 200 represents a generalized illustration and that other steps may be added or existing steps may be removed, modified or rearranged without departing from a scope ofthe method 200.
  • the continuum 120 is comprised of multiple levels that may include, for instance, a chip level 122, a system level 124, a rack level, a row level, a zonal level, a room level 126, etc.
  • the method 200 may be implemented by the continuum controller 102 or the controllers 152, 162, 172 to evaluate data across the continuum 120. More particularly, the continuum controller 102 or the controllers 152, 162, 172 may evaluate the data to develop one or more control schemes for controlling one or more actuators 118a- 118n across the continuum 120.
  • the continuum controller 102 or the controllers 152, 162, 172 may control the one or more actuators 118a- 118n based upon polices that extend beyond any individual level ofthe continuum 120.
  • the method 200 may be performed to substantially increase the compaction and density of computer components in a room.
  • the method 200 may be implemented to substantially reduce or minimize the amount of energy consumed in cooling the components in the multiple levels ofthe continuum 120.
  • the description ofthe method 200 is made with reference to the cooling control systems 100, 100' illustrated in FIGS. IA and 1C, and thus makes reference to the elements cited therein. It should, however, be understood that the method 200 is not limited to the elements set forth in the cooling control systems 100, 100'. Instead, it should be understood that the method 200 may be practiced in a system having a different configuration than that set forth in the cooling control systems 100, 100'.
  • the method 200 may be initiated at step 202 in response to any of a number of stimuli or conditions.
  • the method 200 may be initiated with activation of the components in the room 100, such as, air conditioning units, heat generating components, etc.
  • the method 200 may be manually initiated or the continuum controller 102 or the controllers 152, 162, 172 may be programmed to initiate the method 200 at various times, for a set duration of time, substantially continuously, etc.
  • the sensors 106a-106n may detect one or more conditions and data pertaining to the detected one or more conditions may be received by the continuum controller 102, as indicated at step 204.
  • conditions detected by the sensors 106a-106n ofthe sensor networks 154, 164, 174 may be communicated to each of the controllers 152, 162, 172 at step 204.
  • the continuum controller 102 or the controllers 152, 162, 172 may implement an evaluation module 114 to evaluate the received data as indicated at step 206.
  • the continuum controller 102 or controllers 152, 162, 172 may evaluate the received data to determine whether one or more policies are being met, as indicated at step 208. If the policies are being met, the continuum controller 102 or controllers 152, 162, 172 may continue to receive and evaluate data as indicated at steps 204 and 206.
  • a control scheme that crosses multiple levels of the continuum 120 may be developed to vary conditions in the computing environment, as indicated at step 210. More particularly, a control scheme configured to control one or more actuators 118a- 118n across the continuum 120 to achieve one or more of the desired policies may be developed at step 210.
  • One of the policies that may be achieved includes thermal management based policies, which are designed to substantially ensure that the heat generating components, such as, servers, computers, disk drives, etc., operate under proper temperature conditions at various performance levels.
  • the provisioning of cooling resources at the multiple levels may be varied to substantially maintain temperatures at desired levels.
  • a control scheme may be developed at step 210 to manipulate one or more of the actuators 118a-118n to substantially ensure that the heat generating components are operating under desired conditions.
  • policies may include energy efficiency based policies, which are designed to substantially optimize energy efficiencies of cooling devices, such as, air conditioning units, condensers, fans, etc., contained in the computing environment.
  • the energy efficiency levels of the devices may be determined according to their respective coefficients of performance and a control scheme may be developed at step 210 to manipulate one or more of the actuators 118a-
  • a user may select the energy efficiency needed or desired and the actuators 118a- 118n at the multiple levels may be operated accordingly.
  • the power on chip and system may be changed by using a power management system to obtain the desired or needed level of energy efficiency.
  • Another of the policies may include irreversibility based policies, which are designed to substantially minimize the overall irreversibility at the multiple levels of the continuum 120.
  • Irreversibility represents irreversible processes, such as, mixing of hot and cold streams of air.
  • the level of irreversibility may be determined, for instance, the difference in temperature between the inlet of a given system and the inlet of a heat generating device, the inlet of a heat generating device to vent tile supply, etc.
  • a control scheme for the actuators 118a- 118n may be developed at step 210 to reduce the thermodynamic irreversibility of the system(s) by optimization of flow work, thermodynamic work and heat transfer.
  • Flow work distributes air judiciously around the room, thermodynamic work compresses the refrigerant to exchange heat at low temperature to high temperature and efficient heat transfer ensures that irreversibilities in the heat exchangers are relatively low.
  • the total irreversibility of the components in the continuum 120 may be represented by:
  • Irreversibilities in flow may occur due to mixing of hot and cold air streams or due to flow expansion and contraction through vents/inlets and across aisles, ceiling space, plenum, etc.
  • Irreversibilities in thermodynamic work may occur due to low isentropic efficiency of the compressor or high friction losses in the cooling cycle.
  • Irreversibilities in heat transfer may occur due to un-optimized heat exchanger design and operation.
  • Irreversibilities in heat transfer ( ⁇ ⁇ ) may also be reduced by operating the components in the continuum 120 relatively close to the heat rejection temperature or the ambient temperature. The incremental irreversibilities associated with each flow and heat transfer processes are given by:
  • m is the mass flow rate
  • R is a gas constant
  • Cp is the specific heat capacity of air
  • T ou t is the outlet temperature
  • T in is the inlet temperature
  • P out is the outlet pressure
  • Pt n is the inlet pressure
  • TQ is a reference temperature, and in some cases, the lowest temperature of heat rejection. Since irreversibility is a path variable, total irreversibility is a summation of all the combined values for every significant process in the computing environment of the continuum 120. Processes may be identified based on control volumes created around each key region of transport. A typical process may include, for instance, heat addition in a server or flow of cold air from a vent tile to an inlet of a heat generating device.
  • Another policy may be performance based, in which, manipulations of the actuators are calculated to substantially improve compute performance at the multiple levels of the continuum 120.
  • the continuum controller 102 or the controllers 152, 162, 172 may implement the control module 116 to develop control schemes for operating the actuators 118a- 118n based upon one or more of the policies evaluated through implementation of the evaluation module 114.
  • the control schemes may be developed according to various policies, such as, operational policies and sustainability policies .
  • Operational policies may be employed to govern the operation of the computational and environmental resources in the computing environment at the chip 122, system 124, and room 126 levels.
  • operational policies may prescribe required computational performance, prevent or mitigate failures in the cooling control system 100, 100% provide thermal management, meet a wide variety of potential user needs, etc.
  • operational policies may enable the selection to increase the reaction time to air conditioning failures by having redundancy or lower temperature at the expense of greater energy use.
  • Sustainability policies may be employed to affect the operational cost of the cooling control system 100, 100' or reduce the effect of the computing resources on the environment in which the computing resources are contained by substantially improving operational efficiency.
  • sustainability policies may enable the operation of cooling systems at higher temperatures to save energy at the expense of lower reaction time.
  • the policies may also be weighted according to user needs and priorities and may be dynamic.
  • the policies may further target elements in the computing environment, such as, individual chips, servers, racks, etc., or the policies may target the computing environment as a whole. For instance, the computational performance policies may have more weight at night at the expense of operational cost policies when the cost of electricity is relatively low.
  • performance policies may have less weight.
  • the weightings may change with changes in user priorities.
  • Policies may further be defined to govern the placement of computational workload within the continuum 120 or within computing environments located across the globe as described above.
  • the continuum controller 102 or the controllers 152, 162, 172 may transmit instructions to one or more of the actuators 118a-l 18nto vary one or more conditions according to the developed one or more control schemes.
  • step 214 it may be determined as to whether the method 200 is to continue. If a "no" condition is reached at step 214, the method 200 may end as indicated at step 216. The method 200 may end, for instance, following a predetermined length of time, following a predetermined number of iterations, manually discontinued, etc. If a "yes" condition is reached at step 214, the method 200 may continue beginning at step 204. As such, the method 200 may be repeated for a number of times to substantially continuously vary the conditions based upon information shared among the continuum 120.
  • the operations illustrated in the method 200 may be contained as a utility, program, or a subprogram, in any desired computer accessible medium.
  • the method 200 may be embodied by a computer program, which can exist in a variety of forms both active and inactive. For example, they can exist as software program(s) comprised of program instructions in source code, object code, executable code or other formats. Any of the above can be embodied on a computer readable medium, which include storage devices and signals, in compressed or uncompressed form.
  • Exemplary computer readable storage devices include conventional computer system RAM, ROM, EPROM, EEPROM, and magnetic or optical disks or tapes.
  • Exemplary computer readable signals are signals that a computer system hosting or running the computer program can be configured to access, including signals downloaded through the Internet or other networks. Concrete examples of the foregoing include distribution of the programs on a CD ROM or via Internet download. In a sense, the Internet itself, as an abstract entity, is a computer readable medium. The same is true of computer networks in general. It is therefore to be understood that any electronic device capable of executing the above-described functions may perform those functions enumerated above.
  • FIG.3 illustrates a computer system 300, which may be employed to perform the various functions of the continuum controller 102 or the controllers 152, 162, 172 described herein above, according to an embodiment.
  • the computer system 300 may be used as a platform for executing one or more of the functions described hereinabove with respect to the continuum controller 102 or the controllers 152, 162, 172.
  • the computer system 300 includes one or more controllers, such as a processor 302.
  • the processor 302 may be used to execute some or all of the steps described in the method 200. Commands and data from the processor 302 are communicated over a communication bus 304.
  • the computer system 300 also includes a main memory 306, such as a random access memory (RAM), where the program code for, for instance, the continuum controller 102 or the controllers 152, 162, 172, may be executed during runtime, and a secondary memory 308.
  • main memory 306 such as a random access memory (RAM)
  • the secondary memory 308 includes, for example, one or mo ⁇ e hard disk drives 310 and/or aremovable storage drive 312, representing a floppy diskette drive, a magnetic tape drive, a compact disk drive, etc., where a copy of the program code for the environmental control system may be stored.
  • the removable storage drive 310 reads from and/or writes to a removable storage unit 314 in a well-known manner.
  • User input and output devices may include a keyboard 316, a mouse 318, and a display 320.
  • a display adaptor 322 may interface with the communication bus 304 and trie display 320 and may receive display data from the processor 302 and convert the display data into display commands for the display 320.
  • the processor 302 may communicate over a network, for instance, the Internet, LAN, etc., through a network adaptor 324.
  • the computer system 300 may include a system board or blade used in a rack in a data center, a conventional
  • white box server or computing device etc.
  • one or more of the components in FIG. 3 may be optional (for instance, user input devices, secondary memory, etc.).

Abstract

A method (200) of cooling components across a continuum (120) having a plurality of levels (122-126) includes receiving and evaluating detected data related to the components across the continuum (120). A control scheme is developed based upon the evaluated data, where the control scheme is configured to manipulate one or more actuators (118a-118n, 158, 168, 178) across a plurality of levels (122-126). In addition, one or more of the actuators (118a- 118n, 158, 168, 178) across the plurality of levels (122-126) are manipulated in accordance with the developed control scheme.

Description

COOLING COMPONENTS ACROSS ACONTINUUM
BACKGROUND
A data center may be defined as a location, for instance, a room that houses computer systems arranged in a number of racks. A standard rack, for instance, an electronics cabinet, is defined as an Electronics Industry Association (EIA) enclosure, 78 in. (2 meters) wide, 24 in.
(0.61 meter) wide and 30 in. (0.76 meter) deep. These racks are configured to house a number of computer systems, about forty (40) systems, with future configurations of racks being designed to accommodate 200 or more systems. The computer systems typically dissipate relatively significant amounts of heat during the operation of the respective components. For example, a typical computer system comprising multiple microprocessors may dissipate approximately 250
W of power. Thus, a rack containing forty (40) computer systems of this type may dissipate approximately 10 KW of power.
Current approaches to provisioning cooling to dissipate the heat generated by the computer systems are typically based upon temperatures detected at the inlets of air conditioning units. Oftentimes, however, the temperatures detected at the air conditioning unit inlets are not an accurate reflection of the temperatures of the computer systems being cooled. In many instances, therefore, the provisioning of the cooling is based on the nameplate power ratings of all of the computer systems in the data center, with some slack for risk tolerance. This type of cooling provisioning oftentimes leads to excessive and inefficient cooling solutions. This problem is further exacerbated by the fact that in most data centers, the cooling is provisioned for worst-case or peak load scenarios. Since it is estimated that typical data center operations only utilize a fraction of the servers, provisioning for these types of scenarios often increases the inefficiencies found in conventional cooling arrangements.
As such, it would be beneficial to have thermal management that more effectively and efficiently cools the computer systems. SUMMARY OF THE INVENTION
A method of cooling components across a continuum having a plurality of levels is disclosed. In the method, detected data related to the components across the continuum is received and evaluated. A control scheme is developed based upon the evaluated data, where the control scheme is configured to manipulate one or more actuators across a plurality of levels. In addition, one or more of the actuators across the plurality of levels are manipulated in accordance with the developed control scheme.
BRIEF DESCRIPTION OF THE DRAWINGS
Features of the present invention will become apparent to those skilled in the art from the following description with reference to the figures, in which:
FIG. IA shows a block diagram of a cooling control system according to an embodiment of the invention;
FIG. IB shows a block diagram of a computational continuum, according to an embodiment of the invention;
FIG. 1C shows a block diagram of a cooling control system according to another embodiment of the invention;
FIG. 2 shows a flow diagram of a method for cooling components across a continuum, according to an embodiment of the invention; and
FIG. 3 illustrates a computer system, which may be employed to perform the various functions of the cooling control systems, according to an embodiment of the invention.
DETAILED DESCRIPTION OF THE INVENTION
For simplicity and illustrative purposes, the present invention is described by referring to examples thereof. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent however, to one of ordinary skill in the art, that the present invention may be practiced without limitation to these specific details. In other instances, well known methods and structures have not been described in detail so as not to unnecessarily obscure the present invention.
A holistic approach to cooling components in a room is disclosed herein. More particularly, the disclosed method for cooling the components crosses multiple levels of a continuum to achieve one or more policies. By way of example, one or more control schemes may be developed based upon evaluated data indicating that one or more policies are not being met. In addition, the one or more control schemes may be implemented across the continuum.
With reference first to FIG. IA, there is shown a block diagram of a cooling control system 100, according to an example. It should be understood that the following description of the cooling control system 100 is but one manner of a variety of different manners in which such a cooling control system 100 may be operated. In addition, it should be understood that the cooling control system 100 may include additional components and that some of the components described may be removed and/or modified without departing from a scope of the cooling control system 100.
Generally speaking, and as described in greater detail herein below, the cooling control system 100 is configured to control cooling at multiple component levels in a holistic manner. In other words, the multiple component levels may be considered as a continuum 120 (shown in FIG. 1 B) for purposes of control because the cooling control system 100 is configured to control actuators associated with each of the multiple levels under a holistic control scheme. In one respect, the cooling control system 100 may be operated in various manners to substantially increase the compaction and density of components in a room. In addition, or alternatively, the cooling control system 100 may implement one or more algorithms designed to reduce or minimize the amount of energy consumed in cooling the components at a plurality of the multiple levels.
The multiple levels in a computational environment may include, for instance, a chip level, a system level, a rack level, a row level, a zonal level, a room level, etc. In FIG. IB, only a chip level 122, a system level 124, and a room level 126 are shown for purposes of simplicity of illustration. It should, however, be understood that the computational continuum 120 shown in FIG. IB may include any number of levels as described above. In addition, the arrows 128 generally signify that information and policy assignments may be transferred among the different levels 122-126.
With reference back to FIG. IA, the cooling control system 100 includes a continuum controller 102 configured to perform evaluation and control operations in the cooling control system 100. Although the continuum controller 102 is depicted as comprising a single device, the evaluation and control operations performed by the continuum controller 102 may be performed by any number of different devices without departing from a scope of the cooling control system 100. In one regard, the continuum controller 102 may comprise a microprocessor, a micro-controller, an. application specific integrated circuit (ASIC), and the like, configured to perform the various evaluation and control operations described herein.
The continuum controller 102 is configured to receive input from a sensor network 104. The sensor network 104 includes a plurality of sensors 106a-106n, where "n" is an integer greater than one. The sensors 106a-106n may be positioned to detect one or more conditions, such as, temperature, absolute humidity, pressure, airflow direction, airflow magnitude, etc., at various locations with respect to the continuum 120. More particularly, the sensors 106a-106n may be positioned to detect the one or more conditions at multiple levels 122- 126 with respect to the continuum 120. For instance, at least one of the sensors 106a-106n may be positioned to detect a condition around a heat generating component, such as, a processor, a micro-controller, a high-speed video card, a memory, a semi-conductor device, and the like. In addition, another of the sensors 106a-106n may be positioned to detect a condition around a heat generating system, such as, a server, a hard drive, a monitor, and the like. Furthermore, another of the sensors 106a- 106n may be positioned to detect a condition at a location in the room housing the components of the continuum 120.
The data pertaining to the conditions detected by the sensors 106a-106n may be transmitted to the continuum controller 102 through a network represented by the arrow 108. The network 108 generally represents a wired or wireless structure in the computing environment for the transmission of data between the various components of the cooling control system 100.
The network 108 may comprise an existing network infrastructure or it may comprise a separate network configuration installed for the purpose of controlling cooling by the continuum controller 102. In addition, the sensors 106a- 106n and/or the continuum controller 102 may be equipped with or have access to software and/or hardware to enable these devices to transmit and/or receive data over the network 108.
The continuum controller 102 may store the data received from the sensors 106a- 106n in a memory 110. The continuum controller 102 may be in communication with the memory 110 through, for instance, a memory bus represented by the arrow 112. However, in certain instances, the memory 110 may form part of the continuum controller 102. Generally speaking, the memory 110 may be configured to provide storage of software, algorithms, and the like, that provide the functionality of the continuum controller 102. By way of example, the memory 110 may store an operating system, application programs, program data, and the like. In addition, the memory 110 may be implemented as a combination of volatile and non-volatile memory, such as DRAM, EEPROM, MRAM, flash memory, and the like. In addition, or alternatively, the memory 110 may comprise a device configured to read from and write to a removable media, such as, a floppy disk, a CD-ROM, a DVD-ROM, or other optical or magnetic media.
The memory 110 may also store an evaluation module 114 and a control module 116, which the continuum controller 102 may implement to control cooling provisioning in the continuum 120. More particularly, for instance, the evaluation module 114 may comprise one or more algorithms that the continuum controller 102 may implement in evaluating the data received from the sensors 106a- 106n. By way of example, the evaluation module 114 may be implemented to evaluate the data to determine how one or more actuators 118a- 118n, where "n" is an integer greater than one, that affect cooling provisioning may be operated to meet one or more policies.
Examples of suitable policies include, for instance, thermal management based polices, energy efficiency based policies, irreversibility based policies, and performance based policies. Thermal management based policies are generally designed to ensure that proper temperatures are maintained at maximum performance levels. Energy efficiency based policies are designed to substantially optimize energy efficiencies of the devices contained in the computing environment. Irreversibility based policies are designed to reduce the thermodynamic irreversibility of the devices by substantially optimizing flow work, thermodynamic work, and heat transfer. These policies are described in greater detail herein below.
The continuum controller 102 may implement the control module 116 to develop control schemes for operating the actuators 118a- 118n across the continuum 120 to achieve or meet one or more of the policies. The control schemes may further be developed according to various policies, such as, operational policies and sustainability policies. Operational policies may be employed to govern the operation of the computational and environmental resources in the continuum 120 at, for instance, the chip, system, and room levels 122-126. In addition, operational policies may prescribe required computational performance, prevent or mitigate failures in the cooling control system, provide thermal management, meet a wide variety of potential user needs, etc. By way of example, operational policies may enable the selection to increase the reaction time to air conditioning failures by having redundancy or lower temperature at the expense of greater energy use.
Sustainability policies may be employed to affect the operational cost of the cooling control system 100 or reduce the effect of the computing resources on the environment in which it is contained by substantially improving operational efficiency and reducing irreversibilities. By way of example, sustainability policies may enable the operation of cooling system s at higher temperatures to save energy at the expense of lower reaction time.
The policies may be weighted according to user needs and priorities and may be dynamic. In addition, or alternatively, the policies may target elements in the continuum 120, such as, individual chips, servers, racks, etc., or the policies may target the continuum 120 as a whole. For instance, the computational performance policies may have more weight at night at the expense of operational cost policies when the cost of electricity is relatively low. Conversely, in the daytime, as the cost of electricity rises, performance policies may have less weight. As another example, the weightings may change with changes in user priorities.
Policies may also be defined to govern the placement of computational workload within the continuum 120 or within computing environments located across the globe. These policies may be based upon sustainability criteria either internally or externally to the computing environments. The mechanism and structure of this type of policy may be based upon a grid computing configuration as described, for instance, in "Energy Aware GRID: Global Service Placement based on Energy Efficiency of the Cooling Infrastructure", authored by Chandrakant D. Patel et al., and published in the ASME International Mechanical Engineering Conference and Exposition, Washington, D.C., USA. An example of an implementation of computational workload placement within computing environments located at various geographic locations is described in co-pending and commonly assigned U.S. Patent Application Serial No. 10/820,786, filed on April 9, 2004 and entitled "Workload Placement Among Data Centers Based on Thermal Efficiency", the disclosure of which is hereby incorporated by reference in its entirety.
The continuum controller 102 may transmit or otherwise send instructions pertaining to the developed control schemes to one or more of the actuators 118a- 118n. More particularly, for instance, the continuum controller 102 may send instructions to one or more of the actuators 118a- 118n to vary conditions affected by the actuators 118a- 118n to meet one or more of the policies discussed above. Broadly speaking, the actuators 118a-118n may include any controllable component designed to deliver a given resource, such as, coolant, cooling airflow, cooling fluid, refrigerant, etc., or designed to produce a contaminant, such as, heat, heated airflow, etc. The actuators 1 ISa-118n may also range in size and may be operable to affect cooling and/or heating at the multiple levels of the continuum 120.
At the chip level, for instance, the sensors 106a-106n and the actuators 118a-118n associated with one or more chips may be configured as disclosed in commonly assigned U.S. Patent No. 6,612,120, entitled "Spray Cooling with Local Control of Nozzles", the disclosure of which is hereby incorporated by reference in its entirety. In addition, or alternatively, the sensors 106a- 106n and the actuators 118 a- 118n associated with one or more chips may be configured as disclosed in commonly assigned U.S. Patent No. 6,904,968, entitled "Method and Apparatus for Individually Cooling Components of Electronic Systems", the disclosure of which is hereby incorporated by reference in its entirety.
At the system level, for instance, the sensors 106a-106n may comprise temperature sensors positioned at various locations in a server. In addition, the actuators 118a-118n may comprise one or more fans positioned to direct airflow through the server as disclosed in commonly assigned U.S. Patent No. TBD (Attorney Docket No. 200312051-1, filed on December 17, 2003), entitled "Cooling System for Electronic Components", the disclosure of which is hereby incorporated by reference in its entirety. In addition, or alternatively, the sensors 106a-106n and the actuators 118a-118n may comprise refrigerated cooling components as disclosed in commonly assigned U.S. PatentNo. TBD (Attorney Docket No. 100110202-1, filed on February 5, 2002), entitled "Method and Apparatus for Cooling Heat Generating Components", the disclosure of which is hereby incorporated by reference in its entirety.
At the Toom level, for instance, the sensois 106a-106n and the actuates 11 Sa-11 Sn may be configured and operated as disclosed in commonly assigned U.S. Patent No. 6,574,104, entitled "Smart Cooling of Data Centers", the disclosure of which is hereby incorporated by reference in its entirety. As described in that patent, the actuators 118a-l 18n may comprise one or both of air conditioning units and controllable vent tiles. In addition, or alternatively, the sensors 106a-106n and the actuators 118a-l 18n may be configured and operated as disclosed in commonly assigned U.S. Patent No. TBD (Attorney Docket No. 200314965-1, filed on May 26, 2004), entitled "Energy Efficient CRAC Unit Operation", the disclosure of which is hereby incorporated by reference in its entirety.
It should be understood that the examples discussed above represent a relatively small number of possible sensor 106a-106n and actuator 118a- 118n configurations and operations that maybe used by the cooling control system 100. As such, the examples above should be viewed as merely being illustrative and should not be construed as limiting the cooling control system 100 in any respect. With reference now to FIG. 1C, there is shown a block diagram of a cooling control system 100', according to another example. As shown, the cooling control system 100' has a relatively different configuration as compared to the cooling control system 100 depicted in FIG. IA. It should be understood that the following description of the cooling control system 100' is but one manner of a variety of different manners in which such a cooling control system 100' may be operated. In addition, it should be understood that the cooling control system 100' may include additional components and that some of the components described may be removed and/or modified without departing from a scope of the cooling control system 100'.
As shown in FIG. 1C, the cooling control system 100' does not include the continuum controller 102 depicted in FIG. IA. Instead, the cooling control system 100' is depicted with each of the multiple levels 122-126 of the continuum 120 being in communication with each other. Thus, as described in greater detail herein below, in contrast to the cooling control system 100 depicted in FIG. IA, information and policies may be transmitted to each other instead of having a centralized controller, such as the continuum controller 102.
Although single ones of the multiple levels 122-126 have been portrayed in FIG. 1C, it should be understood that any reasonably suitable number of the multiple levels 122-126 may be included in the cooling control system 100' without departing from a scope of the cooling control system 100'. In this regard, it should be understood that single ones of the multiple levels 122- 126 have been depicted for purposes of simplicity and not of limitation. In addition, it should be understood that levels other than those depicted in FIG. 1C may be included in the cooling control system 100' without departing from a scope of the cooling control system 100'. These levels may include, for instance, a rack level, a row of racks level, a cluster of racks level, etc.
Each of the multiple levels 122-126 includes a respective controller 152, 162, and 172. More particularly, the chip level 122 is depicted as including a chip level controller 152, the system level 124 is depicted as including a system level controller 162, and the room level 126 is depicted as including a room level controller 172. Each of the controllers 152, 162, and 172 may comprise a microprocessor, a micro-controller, an application specific integrated circuit (ASIC), and the like, configured to perform the various evaluation and control operations described herein. In addition, the controllers 152, 162, and 172 may communicate with each other as indicated by the arrows 128.
In one regard, the controller 152, 162, 172 may communicate information pertaining to conditions detected by the sensor network 104 to each other. The sensor network 104 is depicted as being configured to detect one or more conditions at the respective levels 122-126. As shown, the chip level 122 includes a chip sensor network 154 that may comprise one or more of the sensors 106a-106n depicted in FIG. IA. In addition, the system level 124 includes a system sensor network 164 that may also include one or more of the sensors 106a-106n and the room level 126 includes a room sensor network 174 that may further include one or more of the sensors 106a-106n. Althoughnotshown, one ormore ofthe sensors l06a-106nmayformpartof more than one of the levels 122-126. In this regard, the conditions detected by one or more of the sensors 106a-106n may be used to evaluate conditions at more than one level 122-126.
Each of the levels 122-126 may also include respective memories 156, 166, 176 configured to provide storage of software, algorithms, and the like, that provide the functionalities of the controllers 152, 162, 172. By way of example, the memories 156, 166, 176 may store operating systems, application programs, program data, and the like. In addition, the memories 156, 166, 176 may each be implemented as a combination ofvolatile and non-volatile memory, such as DRAM, EEPROM, MRAM, flash memory, and the like. In addition, or alternatively, the memories 156, 166, 176 may each comprise a device configured to read from and write to a removable media, such as, a floppy disk, a CD-ROM, a DVD-ROM, or other optical or magnetic media.
In one regard, the memories 156, 166, 176 may each store algorithms designed to enable the controllers 152, 162, 172 to control respective actuators 158, 168, 178, which may include one or more of the actuators 118a- 118n depicted in FIG. IA. By way of example, the memories 156, 166, 176 may each store one or more algorithms designed to enable the cooling control system 100' to be operated in a holistic manner. In other words, the one or more algorithms stored in the memories 156, 166, 176 may be implemented by their respective controllers 152, 162, 172 based upon one or more of the policies described above, evaluated based upon information obtained from the controllers 152, 162, 172 of each of the levels 122-126. As such, the controllers 152, 162, 172 may collectively perform various operations ofthe continuum controller 102 described above. For instance, the controllers 152, 162, 172 maybe configured to implement an evaluation module 114 and a control module 116. In addition, the controllers 152, 162, 172 are configured to control their respective actuatois 158, 168, 178,based upon data pertaining to a plurality of levels in the continuum 120 and thus implement a holistic control scheme. A description of a manner in which the controllers 152, 162, 172 operate is set forth below with respect to FIG. 2.
With reference now to FIG.2, there is shown a flow diagram of a method 200 for cooling electronic components across a continuum 120, according to an example. It is to be understood that the following description of the method 200 is but one manner of a variety of different manners in which an example ofthe invention may be practiced. It should also be apparent to those of ordinary skill in the art that the method 200 represents a generalized illustration and that other steps may be added or existing steps may be removed, modified or rearranged without departing from a scope ofthe method 200.
As described above, the continuum 120 is comprised of multiple levels that may include, for instance, a chip level 122, a system level 124, a rack level, a row level, a zonal level, a room level 126, etc. The method 200 may be implemented by the continuum controller 102 or the controllers 152, 162, 172 to evaluate data across the continuum 120. More particularly, the continuum controller 102 or the controllers 152, 162, 172 may evaluate the data to develop one or more control schemes for controlling one or more actuators 118a- 118n across the continuum 120. In this regard, the continuum controller 102 or the controllers 152, 162, 172 may control the one or more actuators 118a- 118n based upon polices that extend beyond any individual level ofthe continuum 120. As such, the method 200 may be performed to substantially increase the compaction and density of computer components in a room. In addition, or alternatively, the method 200 may be implemented to substantially reduce or minimize the amount of energy consumed in cooling the components in the multiple levels ofthe continuum 120.
The description ofthe method 200 is made with reference to the cooling control systems 100, 100' illustrated in FIGS. IA and 1C, and thus makes reference to the elements cited therein. It should, however, be understood that the method 200 is not limited to the elements set forth in the cooling control systems 100, 100'. Instead, it should be understood that the method 200 may be practiced in a system having a different configuration than that set forth in the cooling control systems 100, 100'.
The method 200 may be initiated at step 202 in response to any of a number of stimuli or conditions. For instance, the method 200 may be initiated with activation of the components in the room 100, such as, air conditioning units, heat generating components, etc. In addition, or alternatively, the method 200 may be manually initiated or the continuum controller 102 or the controllers 152, 162, 172 may be programmed to initiate the method 200 at various times, for a set duration of time, substantially continuously, etc.
Once initiated, the sensors 106a-106n may detect one or more conditions and data pertaining to the detected one or more conditions may be received by the continuum controller 102, as indicated at step 204. In addition, or alternatively, conditions detected by the sensors 106a-106n ofthe sensor networks 154, 164, 174 may be communicated to each of the controllers 152, 162, 172 at step 204. The continuum controller 102 or the controllers 152, 162, 172 may implement an evaluation module 114 to evaluate the received data as indicated at step 206. The continuum controller 102 or controllers 152, 162, 172 may evaluate the received data to determine whether one or more policies are being met, as indicated at step 208. If the policies are being met, the continuum controller 102 or controllers 152, 162, 172 may continue to receive and evaluate data as indicated at steps 204 and 206.
If, however, one or more policies are not being met, a control scheme that crosses multiple levels of the continuum 120 may be developed to vary conditions in the computing environment, as indicated at step 210. More particularly, a control scheme configured to control one or more actuators 118a- 118n across the continuum 120 to achieve one or more of the desired policies may be developed at step 210.
One of the policies that may be achieved includes thermal management based policies, which are designed to substantially ensure that the heat generating components, such as, servers, computers, disk drives, etc., operate under proper temperature conditions at various performance levels. According to this policy, the provisioning of cooling resources at the multiple levels may be varied to substantially maintain temperatures at desired levels. As such, a control scheme may be developed at step 210 to manipulate one or more of the actuators 118a-118n to substantially ensure that the heat generating components are operating under desired conditions.
Another of the policies may include energy efficiency based policies, which are designed to substantially optimize energy efficiencies of cooling devices, such as, air conditioning units, condensers, fans, etc., contained in the computing environment. The energy efficiency levels of the devices may be determined according to their respective coefficients of performance and a control scheme may be developed at step 210 to manipulate one or more of the actuators 118a-
118n to substantially ensure that coefficients of performance of the cooling devices are at desired levels. In a first example, a user may select the energy efficiency needed or desired and the actuators 118a- 118n at the multiple levels may be operated accordingly. In a second example, the power on chip and system may be changed by using a power management system to obtain the desired or needed level of energy efficiency.
Another of the policies may include irreversibility based policies, which are designed to substantially minimize the overall irreversibility at the multiple levels of the continuum 120.
Irreversibility represents irreversible processes, such as, mixing of hot and cold streams of air.
By drawing finite volumes, and using temperatures at various boundaries, the level of irreversibility may be determined, for instance, the difference in temperature between the inlet of a given system and the inlet of a heat generating device, the inlet of a heat generating device to vent tile supply, etc.
Under this policy, a control scheme for the actuators 118a- 118n may be developed at step 210 to reduce the thermodynamic irreversibility of the system(s) by optimization of flow work, thermodynamic work and heat transfer. Flow work distributes air judiciously around the room, thermodynamic work compresses the refrigerant to exchange heat at low temperature to high temperature and efficient heat transfer ensures that irreversibilities in the heat exchangers are relatively low. As such, the total irreversibility of the components in the continuum 120 may be represented by:
Equation (1): ∑φ = φf + ΦYI + φτ . Irreversibilities in flow ( φf ) may occur due to mixing of hot and cold air streams or due to flow expansion and contraction through vents/inlets and across aisles, ceiling space, plenum, etc. Irreversibilities in thermodynamic work ( φw ) may occur due to low isentropic efficiency of the compressor or high friction losses in the cooling cycle. Irreversibilities in heat transfer ( φτ ) may occur due to un-optimized heat exchanger design and operation. Irreversibilities in heat transfer (φτ ) may also be reduced by operating the components in the continuum 120 relatively close to the heat rejection temperature or the ambient temperature. The incremental irreversibilities associated with each flow and heat transfer processes are given by:
Equation (2): δφf = and
Figure imgf000017_0001
Equation (3): Sφτ = mCpT0 In(^)
Where m is the mass flow rate, R is a gas constant, Cp is the specific heat capacity of air, Tout is the outlet temperature, Tin is the inlet temperature, Pout is the outlet pressure, Ptn is the inlet pressure, and TQ is a reference temperature, and in some cases, the lowest temperature of heat rejection. Since irreversibility is a path variable, total irreversibility is a summation of all the combined values for every significant process in the computing environment of the continuum 120. Processes may be identified based on control volumes created around each key region of transport. A typical process may include, for instance, heat addition in a server or flow of cold air from a vent tile to an inlet of a heat generating device.
Another policy may be performance based, in which, manipulations of the actuators are calculated to substantially improve compute performance at the multiple levels of the continuum 120.
The continuum controller 102 or the controllers 152, 162, 172 may implement the control module 116 to develop control schemes for operating the actuators 118a- 118n based upon one or more of the policies evaluated through implementation of the evaluation module 114. The control schemes may be developed according to various policies, such as, operational policies and sustainability policies . Operational policies may be employed to govern the operation of the computational and environmental resources in the computing environment at the chip 122, system 124, and room 126 levels. In addition, operational policies may prescribe required computational performance, prevent or mitigate failures in the cooling control system 100, 100% provide thermal management, meet a wide variety of potential user needs, etc. By way of example, operational policies may enable the selection to increase the reaction time to air conditioning failures by having redundancy or lower temperature at the expense of greater energy use.
Sustainability policies may be employed to affect the operational cost of the cooling control system 100, 100' or reduce the effect of the computing resources on the environment in which the computing resources are contained by substantially improving operational efficiency.
By way of example, sustainability policies may enable the operation of cooling systems at higher temperatures to save energy at the expense of lower reaction time.
The policies may also be weighted according to user needs and priorities and may be dynamic. The policies may further target elements in the computing environment, such as, individual chips, servers, racks, etc., or the policies may target the computing environment as a whole. For instance, the computational performance policies may have more weight at night at the expense of operational cost policies when the cost of electricity is relatively low.
Conversely, in the daytime, as the cost of electricity rises, performance policies may have less weight. As another example, the weightings may change with changes in user priorities.
Policies may further be defined to govern the placement of computational workload within the continuum 120 or within computing environments located across the globe as described above.
At step 212, the continuum controller 102 or the controllers 152, 162, 172 may transmit instructions to one or more of the actuators 118a-l 18nto vary one or more conditions according to the developed one or more control schemes.
At step 214, it may be determined as to whether the method 200 is to continue. If a "no" condition is reached at step 214, the method 200 may end as indicated at step 216. The method 200 may end, for instance, following a predetermined length of time, following a predetermined number of iterations, manually discontinued, etc. If a "yes" condition is reached at step 214, the method 200 may continue beginning at step 204. As such, the method 200 may be repeated for a number of times to substantially continuously vary the conditions based upon information shared among the continuum 120.
Some or all of the operations illustrated in the method 200 may be contained as a utility, program, or a subprogram, in any desired computer accessible medium. In addition, the method 200 may be embodied by a computer program, which can exist in a variety of forms both active and inactive. For example, they can exist as software program(s) comprised of program instructions in source code, object code, executable code or other formats. Any of the above can be embodied on a computer readable medium, which include storage devices and signals, in compressed or uncompressed form.
Exemplary computer readable storage devices include conventional computer system RAM, ROM, EPROM, EEPROM, and magnetic or optical disks or tapes. Exemplary computer readable signals, whether modulated using a carrier or not, are signals that a computer system hosting or running the computer program can be configured to access, including signals downloaded through the Internet or other networks. Concrete examples of the foregoing include distribution of the programs on a CD ROM or via Internet download. In a sense, the Internet itself, as an abstract entity, is a computer readable medium. The same is true of computer networks in general. It is therefore to be understood that any electronic device capable of executing the above-described functions may perform those functions enumerated above.
FIG.3 illustrates a computer system 300, which may be employed to perform the various functions of the continuum controller 102 or the controllers 152, 162, 172 described herein above, according to an embodiment. In this respect, the computer system 300 may be used as a platform for executing one or more of the functions described hereinabove with respect to the continuum controller 102 or the controllers 152, 162, 172.
The computer system 300 includes one or more controllers, such as a processor 302. The processor 302 may be used to execute some or all of the steps described in the method 200. Commands and data from the processor 302 are communicated over a communication bus 304. The computer system 300 also includes a main memory 306, such as a random access memory (RAM), where the program code for, for instance, the continuum controller 102 or the controllers 152, 162, 172, may be executed during runtime, and a secondary memory 308. The secondary memory 308 includes, for example, one or moτe hard disk drives 310 and/or aremovable storage drive 312, representing a floppy diskette drive, a magnetic tape drive, a compact disk drive, etc., where a copy of the program code for the environmental control system may be stored.
The removable storage drive 310 reads from and/or writes to a removable storage unit 314 in a well-known manner. User input and output devices may include a keyboard 316, a mouse 318, and a display 320. A display adaptor 322 may interface with the communication bus 304 and trie display 320 and may receive display data from the processor 302 and convert the display data into display commands for the display 320. In addition, the processor 302 may communicate over a network, for instance, the Internet, LAN, etc., through a network adaptor 324.
It will be apparent to one of ordinary skill in the art that other known electronic components may be added or substituted in the computer system 300. In addition, the computer system 300 may include a system board or blade used in a rack in a data center, a conventional
"white box" server or computing device, etc. Also, one or more of the components in FIG. 3 may be optional (for instance, user input devices, secondary memory, etc.).
What has been described and illustrated herein is a preferred embodiment of the invention along with some of its variations. The terms, descriptions and figures used herein are set forth by way of illustration only and are not meant as limitations. Those skilled in the art will recognize that many variations are possible within the spirit and scope of the invention, which is intended to be defined by the following claims — and their equivalents — in which all terms are meant in their broadest reasonable sense unless otherwise indicated.

Claims

Claims
1. A method (200) of cooling components across a continuum (120), wherein the continuum (120) comprises a plurality of levels (122-126), said method comprising: receiving (204) detected data related to the components across the continuum (120); evaluating (206) the detected data; developing (210) a control scheme based upon the evaluated data, said control scheme being configured to manipulate one or more actuators (118a-118n, 158, 168, 178) across a plurality of levels (122-126); and manipulating (212) one or more of the actuators (118a-l 18n, 158, 168, 178) across the plurality of levels (122-126) in accordance with the developed control scheme.
2. The method (200) according to claim 1, wherein evaluating (206) the detected data further comprises evaluating (208) the data to determine whether one or more policies are being met.
3. The method (200) according to claim 2, wherein the one or more policies comprise a thermal management based policy and wherein evaluating (206) the data further comprises evaluating (208) the data to determine whether the thermal management based policy is being met, and wherein developing (210) a control scheme based upon the evaluated data further comprises developing (210) a control scheme designed to substantially ensure that the components operate under desired temperature conditions.
4. The method (200) according to claim 2, wherein the one or more policies comprise an energy efficiency based policy and wherein evaluating (206) the data further comprises evaluating (208) the data to determine whether the energy efficiency based policy is being met, and wherein developing (210) a control scheme based upon the evaluated data further comprises developing (210) a control scheme designed to substantially optimize energy efficiency levels of one or more cooling devices configured to cool the components.
5. The method (200) according to claim 2, wherein the one or more policies comprise an irreversibility based policy and wherein evaluating (206) the data further comprises evaluating (208) the data to determine whether the irreversibility based policy is being met and wherein developing (210) a control scheme based upon the evaluated data further comprises developing (210) a control scheme designed to substantially minimize irreversibility of heat exchange at the plurality of levels (122-126) of the continuum (120).
6. The method (200) according to claim 2, wherein the one or more policies comprise a performance based policy and wherein evaluating (206) the data further comprises evaluating (208) the data to determine whether the performance based policy is being met and wherein developing (210) a control scheme based upon the evaluated data further comprises developing (210) a control scheme designed to substantially improve performance of the components at the plurality of levels (122-126) of the continuum (120).
7. A system (100, 100') for controlling cooling across a continuum (120), said continuum (120) comprising a plurality of levels (122-126), said system (100, 100') comprising: a sensor network (104) having a plurality of sensors (106a-106n, 154, 164, 174) configured to detect at least one condition at the plurality of levels (122-126); a plurality of actuators (118a-118n, 158, 168, 178) configured to vary one or more conditions at the plurality of levels (122-126); and at least one controller (102, 152, 162, 172) configured to receive condition information from the sensors (106a-106n, 154, 164, 174) and to evaluate the received condition information to determine whether one or more polices are being met, said at least one controller (102, 152, 162, 172) being further configured to develop a control scheme to control the plurality of actuators (118a-118n, 158, 168, 178) based upon the evaluated condition information to substantially ensure that the one or more policies are met, and wherein the at least one controller (102, 152, 162, 172) is further configured to control the plurality of actuators (118a-l 18n, 158, 168, 178) at the plurality of levels (122-126).
8. The system (100, 100') according to claim 7, wherein the one or more policies comprise a thermal management based policy and wherein the at least one controller (102, 152, 162, 172) is configured to develop a control scheme to substantially ensure that components across the continuum (120) operate under desired temperature conditions.
9. The system (10O3 100') according to claim 7, wherein the one or more policies comprise an energy efficiency based policy and wherein the at least one controller (102, 152, 162, 172) is configured to develop a control scheme to substantially optimize energy efficiency levels of one or more cooling devices configured to cool components across the continuum (120).
10. A computer readable storage medium on which is embedded one or more computer programs, said one or more computer programs implementing a method (200) of cooling components across a continuum (120), wherein the continuum (120) comprises a plurality of levels (122-126), said one or more computer programs comprising a set of instructions for: receiving (204) detected data related to the components across the continuum (120); evaluating (206) the detected data to determine whether one or more policies are being met; developing (210) a control scheme in response to a determination that the one or more policies are not being met, said control scheme being configured to manipulate one or more actuators (118a-118n, 158, 168, 178) across a plurality of levels (122-126); and manipulating (212) one or more of the actuators (118a-118n, 158, 168, 178) across the plurality of levels (122-126) in accordance with the developed control scheme.
PCT/US2006/042927 2005-11-01 2006-11-01 Cooling components across a continuum WO2007053766A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP06836867A EP1943579A2 (en) 2005-11-01 2006-11-01 Cooling components across a continuum
CN2006800501865A CN101356485B (en) 2005-11-01 2006-11-01 Cooling components across a continuum

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/264,786 2005-11-01
US11/264,786 US7620480B2 (en) 2005-11-01 2005-11-01 Cooling components across a continuum

Publications (2)

Publication Number Publication Date
WO2007053766A2 true WO2007053766A2 (en) 2007-05-10
WO2007053766A3 WO2007053766A3 (en) 2007-11-08

Family

ID=37769361

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/042927 WO2007053766A2 (en) 2005-11-01 2006-11-01 Cooling components across a continuum

Country Status (4)

Country Link
US (1) US7620480B2 (en)
EP (1) EP1943579A2 (en)
CN (1) CN101356485B (en)
WO (1) WO2007053766A2 (en)

Families Citing this family (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7640760B2 (en) * 2005-03-25 2010-01-05 Hewlett-Packard Development Company, L.P. Temperature control using a sensor network
US7881910B2 (en) * 2005-05-02 2011-02-01 American Power Conversion Corporation Methods and systems for managing facility power and cooling
US7885795B2 (en) * 2005-05-02 2011-02-08 American Power Conversion Corporation Methods and systems for managing facility power and cooling
US9568206B2 (en) 2006-08-15 2017-02-14 Schneider Electric It Corporation Method and apparatus for cooling
US8327656B2 (en) 2006-08-15 2012-12-11 American Power Conversion Corporation Method and apparatus for cooling
US8322155B2 (en) 2006-08-15 2012-12-04 American Power Conversion Corporation Method and apparatus for cooling
US7681404B2 (en) 2006-12-18 2010-03-23 American Power Conversion Corporation Modular ice storage for uninterruptible chilled water
US8425287B2 (en) 2007-01-23 2013-04-23 Schneider Electric It Corporation In-row air containment and cooling system and method
DK2123140T3 (en) 2007-01-24 2016-12-05 Schneider Electric It Corp System and method for evaluation of cooling conditions of an equipment rack
US7676280B1 (en) 2007-01-29 2010-03-09 Hewlett-Packard Development Company, L.P. Dynamic environmental management
US20090138313A1 (en) 2007-05-15 2009-05-28 American Power Conversion Corporation Methods and systems for managing facility power and cooling
US8909384B1 (en) * 2007-08-27 2014-12-09 Hewlett-Packard Development Company, L.P. Computing apparatus operable under multiple operational policies
US8260928B2 (en) * 2008-05-05 2012-09-04 Siemens Industry, Inc. Methods to optimally allocating the computer server load based on the suitability of environmental conditions
US20090299544A1 (en) * 2008-05-30 2009-12-03 Minebea Co., Ltd. System and method for fan tray control and monitoring system
JP4575977B2 (en) * 2008-09-25 2010-11-04 株式会社日立製作所 Air conditioning equipment control system, air conditioning equipment control method, computer room power management system, and power management method
US8209056B2 (en) * 2008-11-25 2012-06-26 American Power Conversion Corporation System and method for assessing and managing data center airflow and energy usage
US8174829B1 (en) * 2009-01-29 2012-05-08 Hewlett-Packard Development Company, L.P. Cooling electronic devices provided in rows of racks
US9778718B2 (en) 2009-02-13 2017-10-03 Schneider Electric It Corporation Power supply and data center control
US8560677B2 (en) 2009-02-13 2013-10-15 Schneider Electric It Corporation Data center control
US9519517B2 (en) 2009-02-13 2016-12-13 Schneider Electtic It Corporation Data center control
US8086359B2 (en) * 2009-02-23 2011-12-27 Novell, Inc. Dynamic thermal load balancing
US9904331B2 (en) * 2009-04-01 2018-02-27 Schneider Electric It Corporation Method for computing cooling redundancy at the rack level
US8249825B2 (en) * 2009-05-08 2012-08-21 American Power Conversion Corporation System and method for predicting cooling performance of arrangements of equipment in a data center
US8219362B2 (en) 2009-05-08 2012-07-10 American Power Conversion Corporation System and method for arranging equipment in a data center
US8355890B2 (en) * 2009-05-08 2013-01-15 American Power Conversion Corporation System and method for predicting maximum cooler and rack capacities in a data center
US8397088B1 (en) 2009-07-21 2013-03-12 The Research Foundation Of State University Of New York Apparatus and method for efficient estimation of the energy dissipation of processor based systems
US8972217B2 (en) 2010-06-08 2015-03-03 Schneider Electric It Corporation System and method for predicting temperature values in a data center
US8509959B2 (en) 2010-08-12 2013-08-13 Schneider Electric It Corporation System and method for predicting transient cooling performance for a data center
US8996180B2 (en) 2010-09-17 2015-03-31 Schneider Electric It Corporation System and method for predicting perforated tile airflow in a data center
US8825451B2 (en) 2010-12-16 2014-09-02 Schneider Electric It Corporation System and methods for rack cooling analysis
US8688413B2 (en) 2010-12-30 2014-04-01 Christopher M. Healey System and method for sequential placement of cooling resources within data center layouts
US9223905B2 (en) 2011-03-25 2015-12-29 Schneider Electric It Corporation Systems and methods for predicting fluid dynamics in a data center
US8725307B2 (en) 2011-06-28 2014-05-13 Schneider Electric It Corporation System and method for measurement aided prediction of temperature and airflow values in a data center
CN104137660B (en) 2011-12-22 2017-11-24 施耐德电气It公司 System and method for the predicting temperature values in electronic system
EP2795489A4 (en) 2011-12-22 2016-06-01 Schneider Electric It Corp Analysis of effect of transient events on temperature in a data center
US9606586B2 (en) 2012-01-23 2017-03-28 Microsoft Technology Licensing, Llc Heat transfer device
US10228668B2 (en) 2012-07-06 2019-03-12 Hewlett Packard Enterprise Development Lp Management of airflow provisioning to meet a cooling influence redundancy level
US20140041827A1 (en) * 2012-08-08 2014-02-13 Edward C. Giaimo, III Heat Transfer Device Management
US9311909B2 (en) 2012-09-28 2016-04-12 Microsoft Technology Licensing, Llc Sensed sound level based fan speed adjustment
US10012409B2 (en) 2012-10-31 2018-07-03 Hewlett Packard Enterprise Development Lp Managing airflow distribution through adaptive vent tiles
JP6020115B2 (en) * 2012-12-11 2016-11-02 富士通株式会社 Information processing apparatus, information processing system, information processing method, and program
WO2014105014A1 (en) 2012-12-27 2014-07-03 Schneider Electric It Corporation Systems and methods of visualizing airflow
US9348380B2 (en) 2013-12-28 2016-05-24 Samsung Electronics Co., Ltd. Dynamic thermal budget allocation for memory array
US10001761B2 (en) 2014-12-30 2018-06-19 Schneider Electric It Corporation Power consumption model for cooling equipment
US10102313B2 (en) 2014-12-30 2018-10-16 Schneider Electric It Corporation Raised floor plenum tool
CN106468940B (en) * 2015-08-20 2021-01-08 鸿富锦精密电子(天津)有限公司 Server cooling system
US11076509B2 (en) 2017-01-24 2021-07-27 The Research Foundation for the State University Control systems and prediction methods for it cooling performance in containment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004051156A1 (en) * 2002-12-04 2004-06-17 Hewlett-Packard Development Company, L.P. Cooling system with evaporators distributed in parallel
US20040163001A1 (en) * 2003-02-14 2004-08-19 Bodas Devadatta V. Enterprise power and thermal management
US6834811B1 (en) * 2003-04-01 2004-12-28 Hewlett-Packard Development Company, L.P. Market-based temperature control system and method
US20050024828A1 (en) * 2003-07-31 2005-02-03 Ricardo Espinoza-Ibarra Heat sink fan management based on performance requirements
US6925828B1 (en) * 1999-06-30 2005-08-09 Fujitsu Siemens Computers Gmbh Device for cooling and electrical appliance

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6484521B2 (en) * 2001-02-22 2002-11-26 Hewlett-Packard Company Spray cooling with local control of nozzles
US6904968B2 (en) * 2001-09-14 2005-06-14 Hewlett-Packard Development Company, L.P. Method and apparatus for individually cooling components of electronic systems
US6574104B2 (en) * 2001-10-05 2003-06-03 Hewlett-Packard Development Company L.P. Smart cooling of data centers
US6868682B2 (en) * 2003-01-16 2005-03-22 Hewlett-Packard Development Company, L.P. Agent based control method and system for energy management
US7051946B2 (en) * 2003-05-29 2006-05-30 Hewlett-Packard Development Company, L.P. Air re-circulation index

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6925828B1 (en) * 1999-06-30 2005-08-09 Fujitsu Siemens Computers Gmbh Device for cooling and electrical appliance
WO2004051156A1 (en) * 2002-12-04 2004-06-17 Hewlett-Packard Development Company, L.P. Cooling system with evaporators distributed in parallel
US20040163001A1 (en) * 2003-02-14 2004-08-19 Bodas Devadatta V. Enterprise power and thermal management
US6834811B1 (en) * 2003-04-01 2004-12-28 Hewlett-Packard Development Company, L.P. Market-based temperature control system and method
US20050024828A1 (en) * 2003-07-31 2005-02-03 Ricardo Espinoza-Ibarra Heat sink fan management based on performance requirements

Also Published As

Publication number Publication date
WO2007053766A3 (en) 2007-11-08
EP1943579A2 (en) 2008-07-16
CN101356485B (en) 2012-07-04
CN101356485A (en) 2009-01-28
US20070100494A1 (en) 2007-05-03
US7620480B2 (en) 2009-11-17

Similar Documents

Publication Publication Date Title
US7620480B2 (en) Cooling components across a continuum
US8794017B2 (en) Cooling medium distribution through a network of passages having a plurality of actuators
US7640760B2 (en) Temperature control using a sensor network
US7669431B2 (en) Cooling provisioning for heat generating devices
US7373268B1 (en) Method and system for dynamically controlling cooling resources in a data center
US7596431B1 (en) Method for assessing electronic devices
US7962769B1 (en) Balancing of renewable power usage and workload performance between cooling system and electronic components
US6886353B2 (en) Cooling system
US8626918B2 (en) Workload allocation based upon heat re-circulation causes
US7117129B1 (en) Commissioning of sensors
US7461273B2 (en) Power distribution among servers
US7031870B2 (en) Data center evaluation using an air re-circulation index
US6772604B2 (en) Cooling of data centers
US7426453B2 (en) Workload placement based upon CRAC unit capacity utilizations
US7644148B2 (en) Historical data based workload allocation
US8939824B1 (en) Air moving device with a movable louver
US9009061B2 (en) Cooling resource capacity allocation based on optimization of cost function with lagrange multipliers
US7682234B1 (en) Correlation of airflow delivery devices and air movers
US20050228618A1 (en) Workload placement among data centers based on thermal efficiency
WO2003090505A2 (en) Data center energy management system
US7057506B2 (en) Cooling fluid provisioning with location aware sensors
US8352085B2 (en) Distribution of cooling resources using hierarchically identified cooling microgrids
US8392157B2 (en) System synthesis to meet exergy loss target value
US8630739B2 (en) Exergy based evaluation of an infrastructure
Patel et al. Smart chip, system and data center enabled by advanced flexible cooling resources

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2006836867

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 200680050186.5

Country of ref document: CN