Publication number | US20020100031 A1 |

Publication type | Application |

Application number | US 09/760,129 |

Publication date | Jul 25, 2002 |

Filing date | Jan 12, 2001 |

Priority date | Jan 14, 2000 |

Also published as | US8024718, US20060080645 |

Publication number | 09760129, 760129, US 2002/0100031 A1, US 2002/100031 A1, US 20020100031 A1, US 20020100031A1, US 2002100031 A1, US 2002100031A1, US-A1-20020100031, US-A1-2002100031, US2002/0100031A1, US2002/100031A1, US20020100031 A1, US20020100031A1, US2002100031 A1, US2002100031A1 |

Inventors | Miguel Miranda, Francky Catthoor, Martin Janssen, Hugo Man |

Original Assignee | Miguel Miranda, Francky Catthoor, Martin Janssen, Man Hugo De |

Export Citation | BiBTeX, EndNote, RefMan |

Patent Citations (8), Referenced by (29), Classifications (7), Legal Events (1) | |

External Links: USPTO, USPTO Assignment, Espacenet | |

US 20020100031 A1

Abstract

One aspect of the invention includes a method of address expression optimization of source-level code. The source-level code describes the functionality of an application to be executed on a digital device. The method comprises first inputting first source-level code that describes the functionality of the application into optimization system. The optimization system then transforms the first source-level into a second source level that has fewer nonlinear operations than the first source-level code.

Claims(37)

inputting a first source-level code that describes the functionality of the application, the first source-level code comprising address computation code and a plurality of arrays with address expressions, wherein the address computation code or one of the address expressions has nonlinear operations; and

transforming the first source-level code into a second source-level code that describes substantially the same functionality as the first source-level code, wherein the second source-level code has fewer nonlinear operations than the first source-level code, and

wherein the digital device comprises at least one programmable instruction set processor.

means for inputting a first source-level code that describes the functionality of the application, the first source-level code comprising address computation code and a plurality of arrays with address expressions, wherein at least the address computation code or one of the address expressions has nonlinear operations; and

means for transforming the first source-level code into a second source-level code that describes substantially the same functionality as the first source-level code, wherein the second source-level code has fewer nonlinear operations than the first source-level code.

an optimizing system for receiving a first source-level code that describes the functionality of the application, wherein the first source-level code has nonlinear operations, and wherein the optimizing system transforms the first source-level code into a second source-level code that has fewer nonlinear operations than the first source-level code, and wherein the digital device comprises at least one programmable instruction set processor.

transforming first source-level code that defines the operation of the executable code into a second source-level code that describes substantially the same functionality as the first source-level code, wherein the second source-level code has fewer nonlinear operations than the first source-level code, and wherein the second source-level code has been compiled for subsequent execution on a programmable instruction set processor.

Description

- [0001]The present application claims priority to and incorporates by reference, in its entirety, U.S. Provisional Application No. 60/176,248, filed Jan. 14 2000, titled “An Apparatus and Method For Address Expression Optimisation.”
- [0002]1. Field of the Invention
- [0003]The field of the invention relates to digital devices. More particularly, the field of the invention relates to optimizing high-level source code for digital devices comprising programmable processors.
- [0004]2. Description of the Related Technology
- [0005]As is known in the art, a software application can be described by a high-level programming language or code, e.g., Pascal, Fortran, C++. Although there has been some research in the field of high-level programming language optimization, there has been little work done in the field of optimizing code that is targeted for programmable processors. For example, the article, Miranda M., Catthoor F., Janssen M. and De Man H., “High-level address optimization and synthesis techniques for data-transfer intensive applications”, IEEE Transactions on VLSI systems, Vol. 6., No. 4, pp. 677-686, December 1998, describes a system for optimizing source code that is targeted for custom processors design or synthesis. However, this article fails to describe how address optimization can be applied in a context wherein resources are fixed or are predetermined.
- [0006]Furthermore, the article, Liem C., Paulin P., Jerraya A., “Address calculation of retargetable compilation and exploration of instruction-set architectures”, Proceedings 33
^{rd }Design Automation Conference, describes an approach for rewriting code for instruction-set architectures which uses detailed knowledge of a particular target architecture. Disadvantageously, this approach optimizes instruction-level code which is machine specific. - [0007]For example, in Liem, address expression optimization is performed on pointer types, which masks the actual address expression. Since instruction level code is typically longer than source code, pointer type optimization is typically limited to smaller blocks of the code. In instruction level optimization, a block of code typically relates to a branch of the code that is induced by a conditional statement. In Lien, since only parts of the code are examined in the optimization and due to the masking of the address expression, global optimization opportunities are overlooked. Furthermore, this approach does not describe how to provide optimization methods for partly programmable processors wherein the optimization method is processor-independent.
- [0008]Thus, there is a need for examining address expression optimization for source code as opposed to instruction code. There is also a need for a system and method of optimizing high-level source code wherein the optimization is machine-independent.
- [0009]One aspect of the invention includes a method of address expression optimization of source-level code, the source code describing the functionality of an application to be executed on a digital device, the method comprising: inputting a first source-level code that describes the functionality of the application, the first source-level code comprising address computation code and a plurality of arrays with address expressions, wherein at least the address computation code or one of the address expressions has nonlinear operations, and transforming the first source-level code into a second source-level code describing the same functionality as the first source-level code, wherein the second source-level code having fewer nonlinear operations than the first source-level code, and wherein the digital device comprises at least one programmable instruction set processor.
- [0010]Another aspect of the invention includes a method of address expression optimization of source-level code, wherein the source-level code describes the functionality of an application to be executed on a digital device, the method comprising: inputting a first source-level code, describing the functionality of the application, the first source-level code, comprising arithmetic computation code and a plurality of arithmetic expressions in one or more algorithm statements, wherein the arithmetic computation code or one of the arithmetic expressions has nonlinear operations; and transforming the first source-level code into a second source-level code describing the same functionality as the first source-level code, wherein the second source-level code has fewer nonlinear operations than the first source-level code, and wherein the digital device comprises at least one programmable instruction set processor.
- [0011][0011]FIG. 1 is a dataflow diagram showing an optimization system for optimizing source-level code.
- [0012][0012]FIG. 2 is a flowchart illustrating an optimization process that is performed by the optimization system of FIG. 1.
- [0013][0013]FIG. 3 is a diagram showing exemplary source-level code that may be processed by the optimization system of FIG. 1.
- [0014][0014]FIG. 4 is a diagram showing the exemplary source code of FIG. 1 subsequent to an algebraic transformation and common subexpression elimination process of the optimization system of FIG. 1.
- [0015][0015]FIG. 5 is a diagram illustrating exemplary algebraic transformations that may be performed by the optimization system of FIG. 1.
- [0016]FIGS.
**6**-**8**are each diagrams of the source-level code of FIG. 4 subsequent to code “hoisting”, respectively across inner conditionals (FIG. 6), outer conditionals, (FIG. 7) and iterator loops (FIG. 8). - [0017][0017]FIG. 9 is a diagram showing the source code of FIG. 8 subsequent to performing a second iteration of algebraic transformations and common subexpression elimination.
- [0018][0018]FIG. 10 is a diagram showing the source code of FIG. 9 subsequent to applying a second iteration of code hoisting.
- [0019][0019]FIG. 11 is a diagram illustrating another piece of exemplary source code.
- [0020][0020]FIG. 12 is a diagram illustrating the source code of FIG. 11 subsequent to the optimization system of FIG. 1 reducing the operator strength of the source code.
- [0021][0021]FIG. 13 shows a decision tree that may be used to decide for given expressions in two different conditional scopes whether it is beneficial to perform code hoisting.
- [0022]The following detailed description is directed to certain specific embodiments of the invention. However, the invention can be embodied in a multitude of different ways as defined and covered by the claims.
- [0023][0023]FIG. 1 is a dataflow diagram illustrating a process of optimizing a first high-level source code
**100**into a second high-level source code**108**using an optimization system**104**. The optimization system**104**may comprise hardware, software, or a combination thereof. - [0024]The high-level source code
**100**describes an application that is targeted to be executed on a digital device having at least one programmable processor. The source code**100**can be in any high-level programming language such as: C, C++, BASIC, Pascal, Java, and Fortran. In one embodiment of the invention, the second high-level source code**100**is in the same language as the second high-level source code**100**. Typically, the source-level code**100**typically has variables having address expressions. - [0025]Source-level descriptions are to be distinguished from instruction level descriptions. Instruction level descriptions include single operation instructions, each instruction having one or two operands and at most one operation per line of code. In source-level code, a line of code can have multiple operands and multiple operations. Before source code can be executed, it needs to be converted into compiled code.
- [0026]By rewriting source code under the constraint that the functionality of the application is maintained, better execution of the application can be achieved. Better execution can include a reduction in power consumption or faster execution in term of run-cycles.
- [0027]One aspect of the present invention relates to code rewriting for relatively fixed hardware resources, such as is found in general purpose programmable processors, e.g., general purpose RISC machines or more domain specific digital signal processors or ASIP. As part of the optimization process, the first source-level code
**100**is transformed into a second source-level code**108**. The transformation modifies address expressions and the address related arithmetic in the source code. Although, in the art, transformations limited to linear address expressions are known with respect to other types of technology, the optimization system**104**is not limited thereto as it can deal with nonlinear operations, such as modulo operations, integer divisions, power operations and multiplication operations. - [0028]In one embodiment of the invention, the optimization that is performed by the optimization system
**104**is performed in a preprocessing step. A further compilation step, being hardware or software compilation is used, to turn the second high-level source code**108**into an executable software program, a hardware description, or combination thereof. - [0029]As an example, the optimization system
**104**may be advantageously used with respect to high-level source code that defines multimedia applications. The addressing behavior of multimedia applications is dominated by a large amount of deeply nested loops where the loop iterators become variables in the expressions arithmetic within the loops. Therefore, because nested loops share common iterators, optimization is possible. - [0030][0030]FIG. 2 is a flowchart illustrating in overview one embodiment of an optimization process of the optimization system
**104**(FIG. 1). It is noted that depending on the embodiment, selected or all of the steps in FIG. 2 may be performed manually instead of being performed by the optimization system**104**. Starting at a state**200**, the first high-level source code is input into the optimization system**104**. - [0031]Next, the optimization system
**104**performs algebraic transformations (state**204**and**208**) on the source code. Algebraic transformation converts a piece of code into another algebraic equivalent piece of code. In one embodiment of the invention, algebraic transformations includes factorization exploration (state**204**) and common subexpression elimination**208**(state**208**). - [0032]Proceeding to a state
**204**, the optimization system**104**performs factorization exploration. The process of performing factorization exploration is described in further detail below. However, in general, the process is as follows. In source code, address or index expressions often share common factors. When this is the case, one can represent a common factor in the sharing expressions with a single variable, also called a literal, which can be computed higher within the code. By performing arithmetic transformations on the expressions, commonality between factors can be exploited to open up opportunities for the common subexpression elimination. One goal of factorization exploration is to find a representation which allows the reuse common expressions as much as possible. After this, the total number of nonlinear operations remains the same but now some expressions are identical. Hence, factorization exploration facilitates subsequent common subexpression elimination. - [0033]Continuing to a state
**208**, the optimization system**104**(FIG. 1) performs common subexpression elimination. The method of performing common subexpression elimination is described in further detail below. However, in general, the process of common subexpression elimination is as follows. Because of factorization exploration performed previously, many identical expressions are now present in the code. Common subexpression elimination stores the result of a computation in a variable in order to reuse it and hence to avoid redoing the same computation later. In one embodiment of the invention, this optimization is only performed if a respective computation appears several times. - [0034]Next, at the state
**212**, the optimization system**104**performs code hoisting. The method of performing code hoisting is set forth in further detail below. However, in general, the process of code hoisting is as follows. Code hoisting moves a piece of code from one place in the source code to another place in the source code without changing the function of the application. Code hoisting reduces the number of times the arithmetic operations, in particular in the address expressions, are executed. This reduction can be achieved by moving code operations to a higher “scope” where their number of executions is smaller, hence the step is also called a global scope code motion step. - [0035]In one embodiment of the invention, a range analysis step is used before applying code hoisting. In one embodiment of the invention, code hoisting is never applied to expressions which do not have overlapping ranges. Furthermore, code hoisting is only applied on expressions having at least one common factor.
- [0036]The factorization (state
**204**) and common subexpression elimination (state**208**) steps focus separately on expressions within a selected scope. However, because of the similarity between address expressions, there can be opportunities to apply again a factorization/elimination step on expressions within larger scopes, i.e., code in different loop constructs or conditionals. However, this requires an analysis of the ranges of the iterators of each of the loop constructs and conditionals. - [0037]In one embodiment, the first iteration of the code hoisting step (state
**212**) is only performed with respect to expressions in conditional scopes. The later code hoisting steps perform code hoisting across loop constructs, whereby expressions are moved up in the loop hierarchy when possible, to reduce the number of times these are executed. - [0038]Proceeding to a state
**216**, the optimization system**104**determines the extent of the optimization that was performed in the states**204**-**212**. Next, at a decision state**220**, it determined whether the source code has been modified sufficiently depending on the cost of the resulting transformation. - [0039]The cost minimization problem can use any kind of optimization approach. As the actual cost associated with a source-level code is the cost in terms of power consumption, speed and other measures of performance of a digital device executing the source-level code, or even measures of performance of a digital device still to be designed, it is to be understood that only cost estimates are used within the cost minimization approach.
- [0040]The efficiency of a cost minimization problem can be increased by selecting basic transformation steps which have a large impact. It is an aspect of the invention to use composite transformations which are each finite sequences of elementary transformations. The composite transformations have look-ahead local minima avoiding capabilities (described below). Elementary transformations are applied when a single set of preconditions are satisfied. The preconditions can be formulated at the level of the source code on which the elementary transformation will be applied but preferably an alternative representation of the source code is used as is explained further. A composite transformation is applied when one of a plurality of sets of preconditions are satisfied.
- [0041]Local minima avoiding capabilities allow the optimization engine
**104**to transform the first source-level code**100**having a first cost into the second source-level code**108**having a second cost, the second cost being lower than the first cost, and while executing the elementary transformation of which the composite transformation is composed of, intermediate source-level codes are generated, at least one of the intermediate source-level codes having a cost being larger than the first cost. - [0042]If the source code has not been modified sufficiently, the process proceeds to a state
**224**wherein the scope of the optimization process is enlarged to cover greater portions of the code. The process then returns to the state**204**to perform another iteration of optimization. - [0043]Referring again to the decision state
**220**, if the source code has improved sufficiently, the process proceeds to a state**228**wherein linear variable induction analysis is performed. By using linear induction variable analysis, any remaining piece-wise linear operations (like modulo or integer divisions) in the code are replaced by less costly arithmetic. The process of performing linear induction analysis is described in further detail below. - [0044]One particularly advantageous feature of the optimization system
**104**is in the ordering of the above states that are performed by the optimization system**104**. In custom hardware design, first induction analysis, then code hoisting and thereafter algebraic transformations are performed. In one embodiment of the optimization system**104**, it is recognized that the ordering of the optimizations that are performed with respect to custom hardware design do not work well for programmable processors. In one embodiment of the invention, the optimization advantageously performs the optimization steps in the following order: first algebraic transformations, thereafter code hoisting and thereafter induction analysis. Using these steps, it has been observed that greater optimizations are achieved with respect to code that to that is targeted for programmable processors. It has been observed that performing induction analysis first with respect to programmable processors leads to many more pointers than there are resources for such processors. - [0045]Data Model
- [0046]Because source-level code is not a suitable format for automatic handling by a computing device, an alternative efficient representation of source-level code is used. In one embodiment of the invention, the optimization system
**104**exploits a shared data-flow graph. The shared data-flow graph is used to represent the first, second and all intermediate source-level codes. The shared data-flow graph is a directed acyclic graph with homogeneous synchronous data-flow behavior. The graph is comprised of nodes, each of the nodes representing operations and signals that connect the node with other nodes. In one embodiment, no cycling of signals is allowed. In a homogeneous synchronous data-flow graph, on activation, a node reads one data value from each incoming edge and writes one data value to each outgoing edge. The data-flow graph is also referred to as a shared data-flow graph because multiple address (sub)expressions within the source-level code can be mapped to a single piece of the data-flow graph. This is implemented by using a select operation within the data-flow graph representation. The process of mapping source code to data-flow graphs is well known in the art. For example, see William B. Ackerman. “Data-Flow Languages”, IEEE Computer, pages 15-23, February, 1982, which is incorporated by reference, in its entirety. - [0047]The use of a shared data-flow graph enables the joining of intrinsically disjunct graphs within a common graph, hence enabling larger optimization opportunities. A (sub)graph is disjunct when the related expressions have no iterators in common. When the related expressions have only a few iterators in common sharing can be beneficial. The concept of a shared data-flow graph allows for time-multiplexing of address calculations
- [0048]The transformations can be subdivided into two categories: (i) elementary transformations, and (ii) composite transformations.
- [0049]Elementary transformations are simple shared data-flow graph transformations having strict preconditions that check the validity of a transformation. Elementary transformations are the lowest level of transformations that are executed on a shared data-flow graph. In one embodiment of the invention, the elementary transformations are the only transformations that change the structure of a shared data-flow graph. Composite transformations compose sequences of elementary transformations. Composite transformations do not change the structure of a shared data-flow graph directly. For example, certain elementary transformations are shown in FIG. 5. It is noted that there are a number of other commonly known elementary transformations that may also be performed, e.g., replacing a multiply operation that includes a power-of-two constant with a shift operation with a constant.
- [0050]Each elementary transformation is characterized by: (i) a source and target subgraph, (ii) handles, (iii) preconditions, (iv) postconditions, and (v) relationships. The source subgraph is the subgraph wherein a transformation is to be applied. The target graph is the subgraph resulting subgraph from a transformation. The handles specify the starting point for finding transformation candidates. The preconditions of a transformation define the conditions that have to be satisfied before the transformation can be executed. The postconditions of a transformation define the conditions that hold after the transformation has been executed. The relationships of a transformation define a mapping of characteristics between the subgraph defined by the transformation before being executed and the subgraph defined by the transformation after being executed.
- [0051]The source and target subgraphs of an elementary transformation are parameterized, i.e., several aspects are allowed to vary, such as the type of an operation. The amount of variation is defined by the preconditions of an elementary transformation. Preconditions can be seen as patterns, which can be matched against parts of a shared data-flow graph to verify if the transformation can be applied there. The handles define a unique starting point for pattern matching. In case pattern matching is successful, the result is a set of valid values for the parameters of the source subgraph. To be able to create the appropriate target subgraph instance, these values are used in the relationships of the transformation to compute the set of valid values for the parameters of the target subgraph. The postconditions of an elementary transformation describe the situation in the target subgraph instance. This information is used when sequences of elementary transformations are composed.
- [0052]Due to the strict preconditions of the elementary transformations, their applicability to many instruction sequences is very low. Thus, certain composite transformations are executed to improve their applicability. Composite transformations help determine which transformations should be performed and in which order. Composite transformations perform a limited look-ahead to determine when transformations should be performed.
- [0053]Composite transformations work as follows. The strict preconditions of an elementary transformation are made more flexible by detecting “failures.” A failure is detected when a precondition is not satisfied. For each non-fatal failure there exists a short sequence of transformations, which effectively repairs the failure such that the associated precondition is satisfied. Transformations can have several preconditions, and hence many combinations of failures can occur.
- [0054]These combinations result in a dynamic composition of sequences of transformations. This approach provides a flexible and powerful approach to ordering transformations.
- [0055]Factorization Exploration
- [0056]The following text describes in further detail the factorization exploration steps that occur in state
**204**of FIG. 2 for one embodiment of the optimization system**108**. At this step, each of the operations in a selected scope of the code is analyzed so as to identify expressions that contain common factors. - [0057]The factorization exploration step is applied to those operations containing modulo arithmetic. FIG. 5 shows two examples of transformations that may be made with respect to expressions that are affected by a modulo operation.
- [0058]As can be seen in FIGS. 5A and 5B, after this step, the total number of modulo operations in
**5**A and**5**B remains the same but now the expressions are identical. Code that has been transformed by modulo expansion can be further optimized during code hoisting (described below). - [0059]Furthermore, for example, the following code segment
for (x=0; ...) { A=(x + k1) %M; B=(x + k2) %M; } - [0060]can be transformed in following code segment
B=k2 − 1; for (x=0; ...) { if (B<=k2 − k1 − 2) A=B − k2 + k1 + 1 + M; else A=B − k2 + k1 + 1; B=(x + k2) %M; ) - [0061])
- [0062]The expression A=(x+k
**1**)%M can be expressed by another expression B=(x+k**2**)%M together with a conditional, where x is a loop iterator incremented by 1 and k**1**, k**2**are two constant values positive (or negative if the first value of x is greater than −k**1**and −k**2**). Both expressions have a piece-wise linear behavior. They are both incremented at the same time by one. The absolute difference between expressions A and B can take only two values, one equal to k**1**−k**2**+1 (when B has reached M and not A) and one equal to k**1**−k**2**+1+M (in the opposite case). Therefore, after the transformation, B remains the same, A is derived from B and the if and else branches give the two possible values of difference between A and B, depending on the value of B. - [0063]Common Subexpression Elimination
- [0064]The following text describes in further detail the common subexpression elimination steps that occur in state
**208**of FIG. 2 for one embodiment of the optimization system**204**. Common sub-expression elimination (CSE) stores the result of a computation in a variable in order to reuse it and hence to avoid redoing the same computation later. This optimization typically is used only if a selected computation appears several times in the code. Common subexpression elimination reduces the number of costly operations, e.g., modulo arithmetic, in the source code. - [0065][0065]FIG. 4 is a diagram showing the source code of FIG. 3 subsequent to common subexpression elimination. As part of CSE, a variable has been defined for each common subexpression and each subexpression has been replaced with the respective variable. The variable is assigned to the value of the subexpression prior to the first of operation that uses the variable. For example, in FIG. 4, the expression “(y-4)% 3” is assigned to the variable “cseymin4mod3”, and this variable is used later by the operations instead of the expression. It is noted that the common subexpression elimination only occurs with respect to expressions having the same scope. However, subsequent to code hoisting and in later iterations, there may opportunities to apply again a factorization/CSE step on a larger scope.
- [0066]Code Hoisting
- [0067]The following text describes in further detail the process for code hoisting that occurs in state
**208**of FIG. 2. Code hoisting reduces the number of times the arithmetic operations are executed. A reduction in arithmetic operations can be achieved by moving operations in a higher scope where their number of executions is smaller. Code hoisting includes two steps. First, code hoisting is performed with respect to conditionals. After an evaluation of the conditional ranges, code hoisting across conditionals per loop nest allows to move expressions out of conditionals scopes. Secondly, code hoisting across loops is performed, where expressions are moved up in the loop hierarchy when possible, to reduce the number of times these are executed. Each of these two types of code hoisting is discussed below. - [0068]Code hoisting across conditionals can lead to either a gain or loss in performance. The result depends on the way conditional ranges are overlapping and on the amount of common factors between the considered expressions.
- [0069][0069]FIG. 13 shows a decision tree that may be used to decide for given expressions in two different conditional scopes whether it is beneficial to do code hoisting. It is to be appreciated by the skilled technologist that other criteria may be used.
- [0070]As a first decision (branch
**1**), it is determined whether the conditional ranges are overlapping. In one embodiment of the invention, conditional ranges of a loop iteration that they are contained within are overlapping if they are both true for any percentage of the loop iteration. In another embodiment of the invention, conditional ranges are considered overlapping if they are both true for a substantial, e.g., 50-100%, percentage of the loop that they are contained within. In another embodiment of the invention, the percentage may be input into the optimization system**104**by a programmer before or during the optimization process. If the two conditionals are not overlapping, the optimization does not perform code hoisting. However, if the conditional ranges are overlapping, the optimization system**104**decides whether the expressions have common factors (branch**2**). If expressions in the conditional do not have common factors, then no code hoisting is performed. However if expressions in the conditional have common factors, the optimization system**104**determines whether the expressions are equal (branch**3**). If the branches are equal, the optimization system**104**determines whether the range of the first conditional plus the range of the second conditional is greater than the whole range. The whole range is defined as the absolute difference between the loop iterator start and ending values where the conditionals are contained within. - [0071]If the sum of the ranges of each of the conditionals is not less than the whole range, no code hoisting is performed. However, if the sum of the ranges of each of the conditionals is greater than the whole range, code hoisting is preformed with respect to those common expressions.
- [0072]Referring again to branch
**3**, if the expressions are not equal, a calculation is made to determine whether to perform code hoisting. In one embodiment of the invention, the calculation is as follows: -
*c***1**+*c***2**<(1+S)*(*c***1****k***1**+*c***2****k***2**), - [0073]wherein
- [0074]S is a similarity coefficient (between 0 and 1);
- [0075]c
**1**is the cost of the first conditional; - [0076]c
**2**is the cost of the second conditional; - [0077]k
**1**=range of first conditional/whole range (between 0 and 1); and - [0078]k
**2**=range of second conditional/whole range (between 0 and 1). - [0079]A discussion of how to estimate the cost of the conditionals, e.g., c
**1**and c**2**, is set forth below. The search space for factorization and for code hoisting can be large. The decision tree of FIG. 13 may be advantageously used to prune away non-interesting possibilities. - [0080]For example, in FIG. 4, certain expressions in both scopes have common factor in the sense that they all have the form (x-constant)%3*3 or (y-constant)% 3. In this example, as part of the optimization process, the decision tree of FIG. 13 is traversed to decide on which expressions code hoisting are to be applied. Since the conditional ranges surrounding these expressions can for one embodiment of the invention said to be overlapping (branch (
**2**)) and since expressions show common factors (branch (**3**)), the tree is traversed until branch (**4**). - [0081]FIGS.
**6**-**8**are each diagrams of the source-level code of FIG. 4 subsequent to code “hoisting”, respectively across inner conditionals (FIG. 6), outer conditionals, (FIG. 7) and iterator loops (FIG. 8). FIG. 9 is a diagram showing the source code of FIG. 8 subsequent to performing a second iteration of algebraic transformations and common subexpression elimination. FIG. 10 is a diagram showing the source code of FIG. 9 subsequent to applying a second iteration of code hoisting. - [0082]One advantage of code hoisting across loops is that it reduces the number of times a certain operation is executed. As part of this process, the optimization system
**104**analyzes the dependencies between the loop iterators and the expressions. For example, take for example two nested loop, the outer loop having an iterator y, the inner loop having an iterator x. In this example, some sub-expressions depend only on an iterator x and other ones only on an iterator y. Since y is the iterator of the outer loop, the expressions that reference iterator y do not change during the execution of x loop. - [0083]Therefore, these operations that do not change can be moved outside the scope of the x loop and thereby remove unnecessary computations. The code shown in FIG. 8 shows the code of FIG. 7 subsequent to code hoisting across loops.
- [0084]Subsequent to code hoisting, the arithmetic in address expressions is now exposed for further factorization exploration and common subexpression elimination on more global scope.
- [0085]Linear Induction Analysis
- [0086]The following text describes in further detail the steps that occur in state
**228**of FIG. 2. In one embodiment of the invention, before linear induction analysis is performed, the optimization system**104**(FIG. 1) has already performed algebraic transformations and common subexpression elimination on the code. - [0087]At this point, the number of executed operations is significantly reduced and in particular, the number of modulo operations. But often there still remaining non-linear operations present in the code. One goal of this step is to replace the remaining piece-wise linear operations (like modulo or integer divisions) by a less costly arithmetic. Furthermore, it is noted that this step is at the boundary between the processor independent and processor specific stages. In a first step, an analysis of all expressions containing modulo or division operations is performed. This analysis is part of the processor independent stage. At this first step, the optimization system
**104**determines which expressions can be substituted by cheaper arithmetic. In a second step, the identified expressions are substituted. The code generation for this substitution is now processor specific since different ways of writing the same substitution are possible and the choice depends on the processor used. For example, many expressions are of the form “expression % value”. If “value” is a power of two, well-known transformations may be used to remove the piece-wise linear operation. - [0088]If “value” is not a power of two, a more efficient solution for executing modulo/division operations can be still applied. If the right hand-side of the operator is a constant value and if the expression is a linear or a piece-wise linear function of a loop iterator in a loop construct, the expression can be transformed. To perform this transformation, several code instructions are introduced in the code to replace the selected operation. For each operator, one pointer (“variable”) increment per loop and per operation is inserted into the source code. Each pointer created is incremented at the beginning of the loop where the operation takes place and it is initialized in the previous loop of the nest. A test per pointer and per loop is also introduced to reset the pointer for the modulo or to increment the pointer in case of the division operation. This test is used the pointer that is associated with the modulo operation reaches the modulo value. The initialization value for the pointer is the one taken by the considered expression for the first value of the iterator. The amount of the increment is determined by the slope of the affine expression. Therefore, each expression affected by a modulo operation is transformed by an auto-incremented variable and a conditional. An expression affected by an integer division can also be transformed by using a pointer. Note that because of the relation between modulo and division (both gets reset or incremented at the same time as shown, only one conditional is required to follow their evolution, hence saving one conditional. When essentially all modulo and division operations have been transformed, the conditionals and increments related to each expression remains in the scope where they have been placed during the code hoisting step. In most cases, expressions affected by modulo or division operations are affine functions of the loop iterators and a straight-forward application of the technique can be done. This approach is applicable to nested operations.
- [0089]For example, using the above approach, the code segment:
- [0090]for(i=0; i<20; i++)
- [0091]B[i %3];
- [0092]can be converted into the following code segment:
ptr = −1; for(i=0; i<20; i++) if(ptr>=3) ptr −=3; else ptr++; B[ptr]; - [0093]Furthermore for example, FIG. 11 illustrates certain exemplary source code. FIG. 12 illustrates the source of FIG. 11 subsequent to performing linear induction analysis.
- [0094]Cost Calculation
- [0095]Address expression optimization is formulated as a cost minimization problem. During the optimization step, transformations are selected and executed based on the resulting reduction in cost. In one embodiment of the invention, the cost is defined by the cost of a shared data-flow graph. For instruction-set based ACUs, the cost measures used by the cost functions of the different node types are based on a estimate of the number of cycles for a given instruction-set processor “family” (i.e., RISC, VLIW, etc.) and weighted by the execution rate of the corresponding application code scope. The cost of a shared data-flow graph is an estimate of the area of the cheapest possible implementation on a not multiplexed or a lowly-multiplexed custom data-path, and is defined as the sum of the cost of each node (v) in the shared data-flow graph. Signal type information can be used for calculating the cost of a shared data-flow graph. For some node in the graph, the cost is calculated based on the signal types of its input and output signals.
- [0096]Using a small set of abstract operations to model both a larger set of arithmetic operations and operation sharing, means that a direct mapping of operations in a shared data-flow graph to operators in a custom data-path is not always possible for cost calculation. In most cases, the cost of an operation depends on its context. This is also the case for constants.
- [0097]A distinction can be made between signal type context and node context. The signal type context of a node v includes the input and output signal types of v. The signal type context does not change when transformations are applied in the neighbourhood of v. The node context of a node v consists of the nodes in the neighbourhood of v. The node context does change when transformations are applied in the neighbourhood of v. As us used below, a context-dependent cost (function) is defined as a cost (function) that depends on the node context. Context-dependent or not, each cost (function) depends on the signal type context:
- [0098]The cost of a constant is context-dependent. In those situations where a constant is used as ‘control input’, the cost of the constant is zero. An example is a constant multiplication, which is expanded into an add/sub/shift network depending on the value of the constant. Another example is a delay operation, whose size, i.e., number of registers in a register file) is given by the value of the constant. In all other situations, the cost of a constant is the cost of storing the constant in a (index) register file.
- [0099]The cost of an input and output is zero. The cost of an addition is not context-dependent. If an addition has more than two input ports, the best possible, i.e., minimum cost) expansion into binary additions among all modes is chosen. For a binary addition, the maximal cost among all modes is chosen. For one mode, the cost is calculated as follows: (i) the cost of an addition with two constants (c
**1**+c**2**) is zero; (ii) the cost of an addition with a constant equal to zero (a+0) is zero; (iii) the cost of an addition with a constant equal to one (a+1) is the cost of executing the operation in an half adder in a programmable processor; (iv) otherwise the cost of an addition is the cost of a full adder in the programmable processor. - [0100]The cost of a multiplication is context-dependent. If a multiplication has more than two input ports, the best possible, i.e., minimum cost expansion into binary multiplication among all modes is chosen. For a binary multiplication, the maximal cost among all modes is chosen.
- [0101]For one mode, the cost is calculated as follows: (i) the cost of a multiplication with two constants (c
**1**×c**2**) is zero; (ii) the cost of a multiplication with a constant equal to zero (a×0) or one (a×1) is zero; (iii) the cost of a multiplication with a constant equal to minus one (a×(−1)) is either the cost of an n-bit invertion if the output signal is used only by additions, or the cost of an n-bit invertion plus the cost of executing the resulting operation in a half adder in the programmable processor; (iv) the cost of a multiplication with a positive power-of-two constant (a×2^ m) is the cost of a shifting operation; (v) the cost of a multiplication with a negative power-of-two constant (a×−2^ m) is either the cost of a shifting operation plus the cost of an n-bit invertion if the output signal is used only by additions, or the cost of a shifting operation, plus the cost of an n-bit invertion, plus the cost of executing the resulting operation in a half adder otherwise; (vi) the cost of a multiplication with any other constant (a×c**1**) is the cost of the expanded add/sub/shift network operation that can perform the multiplication; (vii) the cost of a multiplication with two variables (a×b) is the cost of executing the operation in a multiplier. - [0102]The cost of a delay is not context-dependent. A delay can occur only in a shared data-flow graph with one mode, because a delay cannot be shared. For one mode, the cost is calculated as follows: (i) the cost of a delay with a constant at the first input port (c
**1**@b}) is zero; (ii) otherwise the cost of a delay is the cost of storing the signal in a register (file) with the number of register stores equal to the value of the constant at the second input port. - [0103]The cost of a select operation is context-dependent. In one embodiment of the invention, it is calculated as follows. The worst-case wordlength at each input port is determined among all signal types whose mode is in the demand set of that input port. Next, except for the smallest wordlength, all wordlengths are added up. The number obtained is the total number of multiplexing bits that are required for all select operations.
- [0104]The motivation behind this calculation is that the cheapest expansion of an n-ary select operation is obtained by iteratively splitting off the two input ports with the smallest wordlengths. The cost in bits of the select operation split off is the largest of the two wordlengths. This wordlength is also the one to use for the new input port of the (n−1)-ary select operation that remains. In other words, the smallest wordlength is removed from the set of wordlengths of the select operation, and the cost is increased with the second smallest wordlength, which becomes the new smallest wordlength.
- [0105]Execution of Compiled Code
- [0106]The compiled code is optimized for execution on an essentially digital device, either an existing programmable one, a plurality of programmable processors, possibly having certain custom hardware.
- [0107]The compiled code can be optimally executed on such digital devices when certain features within the calculation units, such as auto-increment, are used. The above optimizations reduce the amount of overhead for controlling the calculation units, also called local control overhead, and minimize the number of accesses to the registers. The optimization process of the optimizing system
**104**advantageously minimizes index register allocation and local control overhead. Since after optimization there are fewer operations, less intermediate variables are needed. These variables are typically allocated by compiler in a register file. By having to allocate less variables in registers, register allocation is minimized. Similarly, when less operations are required to execute due to optimizing address arithmetic, the decoder needs decode less instructions. - [0108]While the above detailed description has shown, described, and pointed out novel features of the invention as applied to various embodiments, it will be understood that various omissions, substitutions, and changes in the form and details of the device or process illustrated may be made by those skilled in the art without departing from the spirit of the invention. The scope of the invention is indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.

Patent Citations

Cited Patent | Filing date | Publication date | Applicant | Title |
---|---|---|---|---|

US4953084 * | Nov 16, 1987 | Aug 28, 1990 | Hewlett-Packard Company | Method and apparatus using variable ranges to support symbolic debugging of optimized code |

US5491823 * | Jan 25, 1994 | Feb 13, 1996 | Silicon Graphics, Inc. | Loop scheduler |

US5577253 * | Mar 6, 1995 | Nov 19, 1996 | Digital Equipment Corporation | Analyzing inductive expressions in a multilanguage optimizing compiler |

US5586020 * | Feb 23, 1995 | Dec 17, 1996 | Nec Corporation | Program transformation processing system and method |

US5613117 * | Apr 20, 1994 | Mar 18, 1997 | Digital Equipment Corporation | Optimizing compiler using templates corresponding to portions of an intermediate language graph to determine an order of evaluation and to allocate lifetimes to temporary names for variables |

US5692169 * | Oct 18, 1994 | Nov 25, 1997 | Hewlett Packard Company | Method and system for deferring exceptions generated during speculative execution |

US5836014 * | May 16, 1994 | Nov 10, 1998 | Digital Equipment Corporation | Method of constructing a constant-folding mechanism in a multilanguage optimizing compiler |

US6588009 * | Nov 29, 1999 | Jul 1, 2003 | Adelante Technologies Nv | Method and apparatus for compiling source code using symbolic execution |

Referenced by

Citing Patent | Filing date | Publication date | Applicant | Title |
---|---|---|---|---|

US7194736 * | Dec 10, 2002 | Mar 20, 2007 | Intel Corporation | Dynamic division optimization for a just-in-time compiler |

US7240338 | May 29, 2003 | Jul 3, 2007 | Itt Manufacturing Enterprises, Inc. | Computer language translation system and method of converting procedural computer language software to object-oriented computer language software |

US7493609 | Aug 30, 2004 | Feb 17, 2009 | International Business Machines Corporation | Method and apparatus for automatic second-order predictive commoning |

US7739696 | Sep 8, 2005 | Jun 15, 2010 | Honeywell International Inc. | Message translation systems and methods |

US7779049 * | Dec 9, 2005 | Aug 17, 2010 | Tw Vericept Corporation | Source level optimization of regular expressions |

US7937172 * | Jul 26, 2005 | May 3, 2011 | Mitsubishi Electric Corporation | Program creating device for programmable controller, program creating method for programmable controller, and recording medium having program recorded thereon |

US8132163 | Jan 30, 2009 | Mar 6, 2012 | International Business Machines Corporation | Method and apparatus for automatic second-order predictive commoning |

US8150816 * | Dec 22, 2006 | Apr 3, 2012 | Nextlabs, Inc. | Techniques of optimizing policies in an information management system |

US8661003 | Apr 3, 2012 | Feb 25, 2014 | Nextlabs, Inc. | Policy performance in an information management system |

US8732680 * | Feb 19, 2009 | May 20, 2014 | International Business Machines Corporation | Intermediate form for bitwidth sensitive applications and uses thereof |

US9298431 * | Jan 27, 2013 | Mar 29, 2016 | Simpulse | Method of compilation, computer program and computing system |

US9389842 * | Jun 26, 2014 | Jul 12, 2016 | New York University | Configuration-preserving preprocessor |

US9489181 * | Oct 9, 2014 | Nov 8, 2016 | National Instruments Corporation | Correlation analysis of program structures |

US9542162 * | Jul 6, 2016 | Jan 10, 2017 | New York University | Configuration-preserving preprocessor |

US20020120915 * | Oct 12, 2001 | Aug 29, 2002 | Khan Shoab A. | Combined scheduling and mapping of digital signal processing algorithms on a VLIW processor |

US20040111714 * | Dec 10, 2002 | Jun 10, 2004 | Xiaohua Shi | Dynamic division optimization for a just-in-time compiler |

US20060048115 * | Aug 30, 2004 | Mar 2, 2006 | International Business Machines Corporation | Method and apparatus for automatic second-order predictive commoning |

US20070067471 * | Sep 8, 2005 | Mar 22, 2007 | Honeywell International Inc. | Message translation systems and methods |

US20070156670 * | Dec 22, 2006 | Jul 5, 2007 | Blue Jungle | Techniques of optimizing policies in an information management system |

US20070168984 * | Nov 1, 2006 | Jul 19, 2007 | Matsushita Electric Industrial Co., Ltd. | Compiling system, debugging system and program development system |

US20080028381 * | Oct 10, 2007 | Jan 31, 2008 | International Business Machines Corporation | Optimizing source code for iterative execution |

US20090064092 * | Aug 29, 2007 | Mar 5, 2009 | Microsoft Corporation | Visual programming language optimization |

US20090138864 * | Jan 30, 2009 | May 28, 2009 | International Business Machines Corporation | Method and Apparatus for Automatic Second-Order Predictive Commoning |

US20090192635 * | Jul 26, 2005 | Jul 30, 2009 | Mitsubishi Electric Corporation | Program creating device for programmable contoller, program creating method for programmable controller, and recording medium having program recorded thereon |

US20100211937 * | Feb 19, 2009 | Aug 19, 2010 | International Business Machines Corporation | intermediate form for bitwidth sensitive applications and uses thereof |

US20140365995 * | Jun 26, 2014 | Dec 11, 2014 | New York University | Configuration-preserving preprocessor |

US20150007152 * | Jan 27, 2013 | Jan 1, 2015 | Simpulse | Method of compilation, computer program and computing system |

US20170083299 * | Sep 27, 2016 | Mar 23, 2017 | National Instruments Corporation | Correlation Analysis of Program Structures |

WO2013110801A1 * | Jan 27, 2013 | Aug 1, 2013 | Simpulse | Method of compilation, computer program and computing system |

Classifications

U.S. Classification | 717/152, 717/137 |

International Classification | G06F9/45 |

Cooperative Classification | G06F8/51, G06F8/443 |

European Classification | G06F8/51, G06F8/443 |

Legal Events

Date | Code | Event | Description |
---|---|---|---|

Aug 24, 2001 | AS | Assignment | Owner name: INTERUNIVERSITAIR MICROELEKTRONICA CENTRUM (IMEC), Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MIRANDA, MIGUEL;CATTHOOR, FRANCKY;JANSSEN, MARTIN;AND OTHERS;REEL/FRAME:012089/0993;SIGNING DATES FROM 20010326 TO 20010813 |

Rotate