WO2001048595A1 - Processing multiply-accumulate operations in a single cycle - Google Patents

Processing multiply-accumulate operations in a single cycle Download PDF

Info

Publication number
WO2001048595A1
WO2001048595A1 PCT/US2000/032887 US0032887W WO0148595A1 WO 2001048595 A1 WO2001048595 A1 WO 2001048595A1 US 0032887 W US0032887 W US 0032887W WO 0148595 A1 WO0148595 A1 WO 0148595A1
Authority
WO
WIPO (PCT)
Prior art keywords
mac
wallace tree
adder
operands
receiving
Prior art date
Application number
PCT/US2000/032887
Other languages
French (fr)
Inventor
Yuyun Liao
Tom M. Hameenanttila
David B. Roberts
Original Assignee
Intel Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corporation filed Critical Intel Corporation
Priority to JP2001549181A priority Critical patent/JP3869269B2/en
Priority to AU20594/01A priority patent/AU2059401A/en
Priority to GB0208937A priority patent/GB2371657B/en
Publication of WO2001048595A1 publication Critical patent/WO2001048595A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F7/00Methods or arrangements for processing data by operating upon the order or content of the data handled
    • G06F7/38Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation
    • G06F7/48Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices
    • G06F7/544Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices for evaluating functions by calculation
    • G06F7/5443Sum of products
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F7/00Methods or arrangements for processing data by operating upon the order or content of the data handled
    • G06F7/38Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation
    • G06F7/48Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices
    • G06F7/52Multiplying; Dividing

Definitions

  • This invention relates to processor-based systems and, more particularly, to multiply- accumulate units.
  • a multiply-accumulate unit is a unit designed to perform multiplication operations. In a processor-based system, for example, such operations may be plentiful.
  • MACs may be implemented using a variety of logic. Because of the abundance of multiplication operations in some applications, the fastest performing MAC is generally preferred. The success of any MAC design may depend upon the power requirements, the available space which may be allocated to MAC circuitry, and the intended use for the MAC, among other considerations.
  • a tradeoff between speed and cost makes the design of an optimally performing MAC difficult.
  • the cost may come in the form of additional hardware, the chip space necessary to accommodate that hardware, or in the power needed to drive the hardware.
  • DSP digital signal processing
  • some critical operations may involve a series of multiplications and or accumulations. Accordingly, a high-throughput MAC is essential to achieving high performance.
  • many DSP applications today require low power consumption, particularly in the portable electronics market.
  • a method includes receiving a first set of operands in a first portion of a unit, performing a plurality of operations on the first set of operands to arrive at a first intermediate result and receiving a second set of operands in the first portion of the unit. Following these, a second plurality of operations is performed on the first intermediate result to arrive at a first final result while the first plurality of operations is performed on the second set of operands to arrive at a second intermediate result.
  • Figure 1 is a block diagram of a multiply accumulate unit according to one embodiment of the invention.
  • Figures 2A and 2B are flow diagrams of a multiply operation performed using the MAC of Figure 1 according to one embodiment of the invention
  • Figure 3 is a chart of the performance time for 16-bit multiplication operations using the MAC of Figure 1 according to one embodiment of the invention
  • Figures 4A - 4C are flow diagrams of an implicit multiply operation performed using the MAC of Figure 1 according to one embodiment of the invention.
  • Figure 5 is a flow diagram of a multiply operation using packed data instructions performed using the MAC of Figure 1 according to one embodiment of the invention.
  • a MAC typically includes a Booth encoder, also called a Booth recoder or Booth multiplier.
  • a Booth encoder may reduce the number of stages used to perform the multiplication. The number of partial products that are added together thus may be reduced.
  • the number of partial products may be reduced from sixteen to eight, a factor of two.
  • Wallace trees are structures for performing multiple addition operations. Wallace trees typically include features, such as adders, to help perform the addition of multiple partial products.
  • a Wallace tree may include a group of carry-save adders.
  • the output carry is "saved" for the next operation, thus, the name.
  • Wallace trees may organize carry-save adders or similar logic such that a number of input values typically produces two results, a sum value and a carry value.
  • a four-stage Wallace tree may include four stages of 3-to-2 carry-save adders. The four-stage
  • Wallace tree may receive nine input vectors, and produce a sum vector and a carry vector as its result.
  • a carry look-ahead adder is one such logic device.
  • the CLA may efficiently perform the addition of two multi-bit operands.
  • the ability of the MAC to multiply 16-bit signed integers at a very fast rate is a paramount concern.
  • the MAC could include additional circuitry. For example, each component of the MAC could be duplicated, such that multiple operations run simultaneously. Control logic to keep track of the parallel operations would be part of the MAC as well.
  • the additional hardware may be costly, the available space may be limited, and additional power to support the new hardware may be used.
  • Another MAC design may pipeline the operations, such that a new multiply operation may be processed while a prior operation is not yet completed by the MAC hardware, somewhere down the pipeline.
  • Pipelining may involve a number of stages of the operation being performed, each stage operating independently from the others.
  • Pipelining may thus utilize additional control logic and hardware, such as registers, for temporarily storing the state of the two, three, or more, independent operations being conducted simultaneously by the MAC hardware.
  • additional control logic may add to development cost and diminish available board or chip space.
  • a MAC which supports pipelining may run more slowly.
  • a higher throughput MAC may be implemented using conventional architectural features, without excessively impacting the cost or power requirements of the hardware.
  • a MAC design provides a single-cycle throughput for 16-bit multiplication operations by simultaneously operating two functional units of the
  • a MAC 100 includes a Booth encoder 10, a multiplexer, or MUX, array
  • the MAC 100 may receive two input values, a multiplicand,
  • the input values A, B, and C may be 16-bit, 32-bit, or larger signed integer values, for example.
  • the Booth encoder receives up to sixteen bits of the multiplier, B, at a time, and thus produces up to eight control signals 12a - 12h.
  • the MUX array 14 receives the eight control signals 12a - 12h from the Booth encoder 10 as well as receiving the multiplicand, A.
  • the MUX array 14 produces up to eight partial products,
  • the Wallace tree 20 is a four-stage unit, including a plurality of carry-save adders (not shown).
  • the Wallace tree 20 thus receives nine input signals and produces two output signals, a sum vector 22a and a carry vector 22b.
  • the sum vector 22a and the carry vector 22b may subsequently be fed into the CLA 30, to be added together. Alternatively or simultaneously, the sum vector 22a and the carry vector 22b may be routed back to the MUX array 14, for further processing.
  • the MAC 100 includes three banks of flip-flops 6a - 6c.
  • the flip-flops 6 enable portions of the multiplicand A, the multiplier B, and the accumulate data C to be sent to the other logic of the MAC 100 for processing. For example, if a 32-bit multiplier, B[31 :0], is sent to the MAC 100 as part of a multiplication operation, the flip-flops 6b may toggle between two 16-bit portions, B [31 :16] or B[15:0], controlling which portion of the multiplier
  • the MAC 100 also includes MUXs 8a - 8e.
  • the MUXs 8 may control the receipt of a signal by a subsequent unit of the MAC 100.
  • the MUXs 8a - 8c work in conjunction with the flip-flops 6a - 6c to control which portion of the multiplicand A, the multiplier B, or the accumulator C may be received by the MUX array 14, the Booth encoder
  • the MUXs 8d control receipt of the sum vector 22a and the carry vector 22b by the CLA 30.
  • the MUXs 8e enable the output value 34 from the
  • the MAC 100 includes two banks of MUXs and flip-flops units 24a and 24b which receive the output signals 22a and 22b from the Wallace tree 20.
  • the MUXs and flip-flops unit 24a is used to feed part of the sum vector 22a and the carry vector 22b back to the MUX array 14.
  • the portion 26a fed back to the MUX array 14 depends upon the type of operation being performed. Such feedback is a feature common to multi-stage MAC operations, such as for performing a 32-bit multiplication.
  • the MAC 100 includes a second MUXs and flip-flops unit 24b, to which the sum vector 22a and the carry vector 22b are also sent. Subsequently, these values may be sent to the CLA 30 via the MUXs 8d. In one embodiment of the invention, the sum vector 22a and the carry vector 22b are sent to both units 24a and 24b simultaneously.
  • the MAC 100 includes architectural enhancements which may improve throughput for multiplication operations.
  • the MAC 100 includes two registers, an accumulator A 32a and an accumulator B 32b.
  • the accumulators 32 may receive the result vector 34 from the CLA 30.
  • the result vector 34 is alternatively stored in the accumulators 32. For example, in a first operation, the result vector, which may be an intermediate result, is stored in the accumulator A 32a. In a subsequent operation, the subsequent result vector is stored in the accumulator B 32b.
  • the accumulators 32 are each connected to the MUXs 8c, for submission to the Wallace tree 20.
  • the configuration allows the values stored in either accumulator 32 to be submitted to the Wallace tree 20 as the accumulate data instead of receiving the accumulated data from a source (C) external to the MAC 100.
  • the accumulators 32 may facilitate the throughput of operations performed in the MAC 100 in one embodiment of the invention.
  • the MAC 100 may support implicit instructions such as an implicit multiply instruction.
  • An implicit instruction is one where one or more intermediate results may be stored internally to the MAC, such as in a register. Including a register in the MAC circuitry may allow the MAC to avoid sending intermediate results to a storage location outside the MAC over an external bus, for example.
  • a MAC which supports implicit operations may process instructions more quickly than a MAC with no such support.
  • the MAC circuitry may provide multiple intermediate results before arriving at the final result.
  • the conventional MAC design typically receives an intermediate result, an intermediate sum vector and an intermediate carry vector, from the Wallace tree and feeds the results back into the MUX array for subsequent processing. This scheme is repeated as necessary. Eventually, the sum vector and the carry vector produced by the Wallace tree represent the final result. These values are subsequently sent to the CLA, where they are added together and sent out of the MAC circuitry as the final result.
  • the intermediate sum vector 22a and the intermediate carry vector 22b may be sent to the CLA 30 in each cycle, if desired.
  • the CLA 30 may then add the intermediate sum vector 22a and the intermediate carry vector 22b, to produce an intermediate result 34, which may then be stored in one of the accumulators 32.
  • Feedback logic in the MAC 100 design permits the intermediate result 34 to be fed from one of the accumulators 32 back into the Wallace tree 20, via the MUXs 8c, as accumulate data 18.
  • the Wallace tree 20 includes an input line 18 for the accumulator C.
  • the MUXs 8c permit the source of the accumulate data 18 to include the accumulators 32.
  • the MAC 100 provides circuitry which allows simultaneous operation of both the Wallace tree 20 and the CLA 30.
  • This circuitry includes early termination logic 50 and MAC control logic 52, in one embodiment of the invention.
  • This circuitry may control the simultaneous processing of more than one multiplication operation or of more than one portion of a single multiplication operation by the MAC 100.
  • a MAC may receive signed binary values as operands.
  • a two's complement notation may be used.
  • the most significant bit of the value may represent the sign: zero for positive values, one for negative values.
  • the 16-bit operand FFClh may represent -63d and the operand 003Fh may represent +63d.
  • 16-bit values may be represented as 32-bit values, for some applications.
  • the sign bit (bit fifteen) may thus be "extended” or duplicated in the upper sixteen bits.
  • the sign-extended operand FFFFFFClh may thus again represent -63d while the operand 0000003 Fh may represent +63d.
  • the upper seventeen bits of both operands are identical, as the sign bit (bit fifteen) is extended. Likewise, for either value, the upper sixteen bits are not needed to perform a multiplication operation.
  • the early termination logic 50 uses this feature of signed binary values to the advantage of the MAC 100.
  • the early termination logic 50 receives a signal from the multiplier B.
  • the early termination logic 50 may be invoked when the upper seventeen bits of a 32-bit multiplier B are identical. In such a case, the upper sixteen bits of the multiplier B are not used in the multiplication operation.
  • the early termination logic 50 sends a signal to the MAC control logic 52.
  • the MAC control logic 52 controls the flip-flops 6, the MUXs 8, and the MUXs and flip- flops 24, as well as the accumulators 32.
  • the MAC control logic 52 thus may enable the next multiplicand A to be latched by the flip-flops 6a and the MUXs 8a, the next multiplier B to be latched by the flip-flops 6b and the MUXs 8b, or the next accumulate data C to be latched by the flip-flops 6c and the MUXs 8c.
  • the MAC control logic 52 may control the routing of the intermediate sum vector 22a and the intermediate carry vector 22b, received from the Wallace tree 30.
  • the MAC control logic 52 may enable the MUXs and flip-flops 24a, the MUXs and flip- flops 24b, and the MUXs 8d, as needed.
  • the MAC control logic 52 further controls the accumulator A register 32a and the accumulator B register 32b, permitting the values contained therein to be routed back to the Wallace tree 20 as accumulate input 18. Finally, the MAC control logic 52 may control the MUXs 8e such that the final output vector 34 may be sign-extended, if desired, and produce the output value 40.
  • the MAC control unit 52 may receive control signals from a source external to the MAC 100, such as an instruction decoder (not shown). The MAC control unit 52 may also submit control signals to another source external to the MAC 100. Depending upon the operation being performed, the MAC 100 may produce intermediate vector values.
  • the Booth encoder 10 receives a 16-bit value from the multiplier, B. Accordingly, to multiply two 32- bit numbers, or a 16-bit multiplicand and a 32-bit multiplier, the Booth encoder 10 may receive the lower sixteen bits of the multiplier in a first cycle and then receive the upper sixteen bits of the multiplier in a second cycle.
  • the other circuitry of the MAC 100 may receive data in both a first and a second cycle.
  • the multiplication operation thus takes, at a minimum, two cycles to complete.
  • the MAC 100 may achieve single-cycle throughput.
  • the MAC 100 achieves single-cycle throughput in performing 16-bit multiplication operations.
  • the Wallace tree 66 and the CLA 68 may simultaneously process all subsequent operands.
  • the Wallace tree 66 may be processing data for cycle n, while, at the same time, the CLA 68 is processing data for cycle n-1.
  • FIG. 2 A a flow diagram illustrates how the MAC 100 logic processes a multiply or multiply/accumulate operation.
  • two 16-bit operands are sign-extended as 32-bit values.
  • Such operands are common in DSP applications and may particularly illustrate performance of the early termination logic 50 in the MAC 100.
  • the MAC 100 may perform multiply or multiply/accumulate operations on operands with other characteristics.
  • a first cycle, cycle 0, begins (block 200).
  • the lower sixteen bits of the multiplier B[15:0] are sent to the Booth encoder 10 (block 202).
  • the MUX array 14 receives eight control signals 12 from the Booth encoder 10 as well as the multiplicand A[31 :0] (block 204).
  • the MUX array 14 processes these signals such that the Wallace tree 20 receives eight partial product vectors 16 from the MUX array 14.
  • the Wallace tree 20 receives accumulate data C[31 :0] (block 206). From this data, the Wallace tree 20 produces an intermediate sum vector (ISV) 22a and an intermediate carry vector (ICV) 22b (block 208).
  • the intermediate sum vector 22a and the intermediate carry vector 22b are sent to the MUXs and flip-flops 24a and 24b (block 210).
  • the early termination logic 50 may receive the 32-bit multiplier B[31 :0] (block 212). Because the operands are sign-extended 16-bit values, the upper seventeen bits of the multiplier B are identical. Accordingly, the early termination logic 50 sends a signal to the MAC control logic 52 (block 214). The MAC control logic 52 then sends a signal to latch the flip-flops 6a, 6b and 6c as well as the MUXs 8a, 8b and 8c (block 216). In this manner, the MAC control logic 52 enables the circuitry to latch the next MAC operands A, B and C.
  • the second cycle, cycle one is a continuation of the operations of Figure 2A.
  • the MAC control logic 52 sends a signal to the MUXs 8d to release the intermediate sum vector 22a and the intermediate carry vector 22b (block 232).
  • the intermediate sum vector 22a and the intermediate carry vector 22b are sent to the CLA 30 (block 234).
  • the CLA 30 adds the intermediate sum vector 22a and the intermediate carry vector 22b together (block 236).
  • the result 40 is then sent out of the MAC 100 (block 238).
  • cycle one is completed.
  • FIG 3 the single-cycle throughput of 16-bit multiplication operations using the MAC 100 according to one embodiment of the invention may be demonstrated using a chart.
  • a chart At the top of the chart, a numbered series of 16-bit multiplication operations performed by the MAC 100 is depicted.
  • the cycle in which an operation was performed is specified.
  • the chart tracks operations performed by the Wallace tree 20, indicated as "W”, and the CLA 30, indicated as "C” according to one embodiment of the invention.
  • the Wallace tree 20 For the first 16-bit multiplication operation, the Wallace tree 20 is executed in cycle zero while the CLA 30 is executed in cycle one.
  • the Wallace tree 20 For the second 16-bit multiplication operation, the Wallace tree 20 is executed in cycle one and the CLA 30 is executed in cycle two.
  • the execution of the CLA 30 for the first multiplication operation occurs simultaneously with the execution of the Wallace tree 20 for the second 16-bit multiplication operation.
  • the subsequent 16-bit multiplication operations proceed like the two already described.
  • fifteen 16-bit multiplication operations At the end of the fifteenth cycle, fifteen 16-bit multiplication operations have been completed.
  • the MAC 100 thus provides a single-cycle throughput.
  • the accumulators 32 allow the MAC 100 to perform implicit multiply and multiply/accumulate operations.
  • the MAC 100 may include a single accumulator.
  • the accumulators 32 may be implicitly referenced by several implicit instructions. Those implicit multiply/accumulate instructions reference the accumulators 32 instead of a register-specified accumulator.
  • MAR or MRA may be received by the MAC control logic 52 in order for the accumulators 32 to be read from or written to, respectively.
  • Figure 4A a flow diagram illustrates the implicit multiply/accumulate operation in which early termination is invoked. Recall that, in order for early termination to be invoked, the other seventeen bits of the multiplier B are all zeros or all ones.
  • cycle zero begins (block 300)
  • the multiplier B[15:0] is sent to the Booth encoder 10 (block 302).
  • the MUX array 14 then receives eight control signals 12 from the Booth encoder 10 as well as the multiplicand A[31 :0] (block 304).
  • the Wallace tree 20 receives eight partial product vectors from the MUX array 14. Additionally, the Wallace tree 20 receives an accumulate value from either accumulator A 32a or accumulator B 32b (block 306). The Wallace tree 20 subsequently produces an intermediate sum vector 22a and an intermediate carry vector 22b (block 308).
  • the carry look-ahead adder 30 is a 40-bit CLA, which may perform 16-bit DSP operations.
  • the accumulator A register 32a and the accumulator B register 32b are 40-bit registers.
  • the entire 32-bit multiplier B is sent to the early termination logic (ETL) 50 (block 312). Because the upper seventeen bits of the multiplier B are identical, the early termination logic 50 sends a signal to the MAC control logic 52 (block 312).
  • the MAC control logic 52 then sends a signal to latch the flip-flops 6a, 6b, and 6c as well as the MUXs 8a, 8b, and 8c (block 316). This indicates that the Wallace tree 20 will be available to accept the next implicit multiply/accumulate instruction in the next cycle (block 316).
  • cycle 1 begins (block 330).
  • the MAC control logic 52 sends a signal to the MUXs 8d to release the intermediate sum vector 22a and the intermediate carry vector
  • the MAC 100 may receive implicit instructions which reference the accumulators. These instructions may be received from the MAC control logic 52, which ultimately controls the accumulator A 32a and the accumulator B 32b.
  • the MAC control logic 52 may receive an implicit instruction for reading the accumulator A 32a (block 350).
  • the values stored in the accumulator A 32a and the accumulator B 32b are sent to the CLA 30 (block 352).
  • the CLA 30 then adds the values 36a and 36b together (block 354).
  • the CLA 30 then sends the result 40 as output data (block 356).
  • the result 40 may then be sent to a register file external to the MAC 100.
  • a multiply with implicit accumulate operation uses packed data instructions.
  • the MAC 100 may receive four different packed data instructions. These four packed data instructions operate on sixteen bits or half of two 32-bit operands. For example, one instruction may operate on the lower sixteen bits of both the multiplier B and the multiplicand A. Another may operate on the upper sixteen bits of the multiplicand A and the lower sixteen bits of the multiplier B. Ultimately, each packed- data instruction thus performs a 16-bit multiply operation on two 16-bit operands.
  • a 32-bit multiplicand A[31 :0] and a 32-bit multiplier B[31 :0] are sent to the MAC 100 (block 402).
  • the MAC control logic 52 also receives a packed-data instruction (block 404).
  • Sixteen bits of the multiplicand A are extended to 32 bits. For example, if the packed- data instruction is operating on the lower sixteen bits of the multiplicand A, then the upper sixteen bits of the multiplicand A are replaced with the contents of the 16th bit of the multiplicand A. In essence, the sign is extended from the 16th to the 32nd bit. Likewise, if the packed-data instruction is operating on the upper sixteen bits of the multiplicand A, then the upper sixteen bits are shifted to the lower 16 bits and the upper sixteen bits are filled with the value of the sign bit. Sixteen bits of the multiplier B are sent to the Booth encoder 10 (block 408).
  • the MAC 100 is simultaneously determining whether the early termination logic 50 will be invoked. That is, the multiplier B[31 :0] is sent to the early termination logic 50 (block 420). Because the upper seventeen bits of the multiplier B are identical, the early termination logic 50 sends a signal to the MAC control logic 52 (block 422). The MAC control logic 52 then sends a signal to latch the flip-flops 6a, 6b, and 6c as well as the MUXs 8a, 8b and 8c (block 424). This allows a new MAC instruction to be processed in the next cycle (block 426).
  • a multiply-accumulate unit may provide single-cycle throughput for certain operations.
  • the MAC avoids using redundant hardware, which may consume additional power, and includes no pipelining circuitry, which may run more slowly. Instead, the Wallace tree and the carry look-ahead adder which are part of the MAC may simultaneously operate. Where such simultaneous operations occur, a higher throughput may be possible.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Complex Calculations (AREA)
  • Silver Salt Photography Or Processing Solution Therefor (AREA)
  • Inks, Pencil-Leads, Or Crayons (AREA)

Abstract

A multiply-accumulate unit, or MAC (100), may achieve high throughput. The MAC (100) need not use redundant hardware, such as multiple Wallace trees, or pipelining logic, yet may perform Wallace tree and carry look-ahead adder functions simultaneously for different operations.

Description

Processing Multiply- Accumulate Operations In A Single Cycle Background
This invention relates to processor-based systems and, more particularly, to multiply- accumulate units.
A multiply-accumulate unit, or MAC, is a unit designed to perform multiplication operations. In a processor-based system, for example, such operations may be plentiful.
MACs may be implemented using a variety of logic. Because of the abundance of multiplication operations in some applications, the fastest performing MAC is generally preferred. The success of any MAC design may depend upon the power requirements, the available space which may be allocated to MAC circuitry, and the intended use for the MAC, among other considerations.
Usually, however, a tradeoff between speed and cost makes the design of an optimally performing MAC difficult. The cost may come in the form of additional hardware, the chip space necessary to accommodate that hardware, or in the power needed to drive the hardware. For example, in many digital signal processing, or DSP, applications, some critical operations may involve a series of multiplications and or accumulations. Accordingly, a high-throughput MAC is essential to achieving high performance. However, many DSP applications today require low power consumption, particularly in the portable electronics market.
Thus, there is a continuing need for a MAC which may achieve high throughput without excessively consuming power.
Summary
In one embodiment of the invention, a method includes receiving a first set of operands in a first portion of a unit, performing a plurality of operations on the first set of operands to arrive at a first intermediate result and receiving a second set of operands in the first portion of the unit. Following these, a second plurality of operations is performed on the first intermediate result to arrive at a first final result while the first plurality of operations is performed on the second set of operands to arrive at a second intermediate result.
Advantages and other features of the invention will become apparent from the following description, the drawings, and the claims. Brief Description of the Drawings
Figure 1 is a block diagram of a multiply accumulate unit according to one embodiment of the invention;
Figures 2A and 2B are flow diagrams of a multiply operation performed using the MAC of Figure 1 according to one embodiment of the invention;
Figure 3 is a chart of the performance time for 16-bit multiplication operations using the MAC of Figure 1 according to one embodiment of the invention;
Figures 4A - 4C are flow diagrams of an implicit multiply operation performed using the MAC of Figure 1 according to one embodiment of the invention; and Figure 5 is a flow diagram of a multiply operation using packed data instructions performed using the MAC of Figure 1 according to one embodiment of the invention.
Detailed Description
At the most basic level, a MAC may receive two integer values, multiply the values together and send out the result of the operation. For some applications, an additional constant value, an accumulate value, may be added to the result. So, the MAC may produce a result, d, from the multiplication of a multiplicand, a, and a multiplier, b, plus the accumulation of c, as shown in the following equation: d = (a x b) + c Multiplication operations may essentially be performed as a series of additions of partial products. To achieve optimum performance, MACs may include features which perform addition operations more quickly or which reduce the number of necessary addition operations.
For example, a MAC typically includes a Booth encoder, also called a Booth recoder or Booth multiplier. A Booth encoder may reduce the number of stages used to perform the multiplication. The number of partial products that are added together thus may be reduced.
For example, for a 16-bit word, the number of partial products may be reduced from sixteen to eight, a factor of two.
Another feature which may be found in a MAC is known as a Wallace tree. Wallace trees are structures for performing multiple addition operations. Wallace trees typically include features, such as adders, to help perform the addition of multiple partial products. For example, a Wallace tree may include a group of carry-save adders. A 3-to-2 carry-save adder, for example, receives three inputs, a, b, and c, and produces two outputs, a sum, y, and a carry, z, as illustrated by the following equation: a + b + c = y + z * 2 The output carry is "saved" for the next operation, thus, the name.
Wallace trees may organize carry-save adders or similar logic such that a number of input values typically produces two results, a sum value and a carry value. For example, a four-stage Wallace tree may include four stages of 3-to-2 carry-save adders. The four-stage
Wallace tree may receive nine input vectors, and produce a sum vector and a carry vector as its result.
Another feature of many MAC designs is logic for adding all the bits of two vectors, to produce a final result, for example. A carry look-ahead adder, or CLA, is one such logic device. The CLA may efficiently perform the addition of two multi-bit operands.
Especially for digital signal processing and other applications, the ability of the MAC to multiply 16-bit signed integers at a very fast rate is a paramount concern. To speed up the multiplication of 16-bit and even larger integer operations, the MAC could include additional circuitry. For example, each component of the MAC could be duplicated, such that multiple operations run simultaneously. Control logic to keep track of the parallel operations would be part of the MAC as well. However, the additional hardware may be costly, the available space may be limited, and additional power to support the new hardware may be used.
Another MAC design may pipeline the operations, such that a new multiply operation may be processed while a prior operation is not yet completed by the MAC hardware, somewhere down the pipeline. Pipelining may involve a number of stages of the operation being performed, each stage operating independently from the others. Pipelining may thus utilize additional control logic and hardware, such as registers, for temporarily storing the state of the two, three, or more, independent operations being conducted simultaneously by the MAC hardware. Although less costly than providing parallel hardware, the additional control logic may add to development cost and diminish available board or chip space. Further, a MAC which supports pipelining may run more slowly. A higher throughput MAC may be implemented using conventional architectural features, without excessively impacting the cost or power requirements of the hardware. In some embodiments of the invention, a MAC design provides a single-cycle throughput for 16-bit multiplication operations by simultaneously operating two functional units of the
MAC.
In Figure 1, a MAC 100 includes a Booth encoder 10, a multiplexer, or MUX, array
14, a Wallace tree 20, and a carry look-ahead adder, or CLA, 30, according to one embodiment of the invention. The MAC 100 may receive two input values, a multiplicand,
A, and a multiplier, B, as well as an accumulate data value, C. The input values A, B, and C may be 16-bit, 32-bit, or larger signed integer values, for example.
In one embodiment of the invention, the Booth encoder receives up to sixteen bits of the multiplier, B, at a time, and thus produces up to eight control signals 12a - 12h. The MUX array 14 receives the eight control signals 12a - 12h from the Booth encoder 10 as well as receiving the multiplicand, A. The MUX array 14 produces up to eight partial products,
16a - 16h, which are then sent to the Wallace tree 20.
In one embodiment of the invention, the Wallace tree 20 is a four-stage unit, including a plurality of carry-save adders (not shown). The Wallace tree 20 thus receives nine input signals and produces two output signals, a sum vector 22a and a carry vector 22b. The sum vector 22a and the carry vector 22b may subsequently be fed into the CLA 30, to be added together. Alternatively or simultaneously, the sum vector 22a and the carry vector 22b may be routed back to the MUX array 14, for further processing.
The MAC 100 includes three banks of flip-flops 6a - 6c. The flip-flops 6 enable portions of the multiplicand A, the multiplier B, and the accumulate data C to be sent to the other logic of the MAC 100 for processing. For example, if a 32-bit multiplier, B[31 :0], is sent to the MAC 100 as part of a multiplication operation, the flip-flops 6b may toggle between two 16-bit portions, B [31 :16] or B[15:0], controlling which portion of the multiplier
B is sent to the Booth encoder 10. The MAC 100 also includes MUXs 8a - 8e. The MUXs 8 may control the receipt of a signal by a subsequent unit of the MAC 100. For example, the MUXs 8a - 8c work in conjunction with the flip-flops 6a - 6c to control which portion of the multiplicand A, the multiplier B, or the accumulator C may be received by the MUX array 14, the Booth encoder
10, or the Wallace tree 20, respectively. The MUXs 8d control receipt of the sum vector 22a and the carry vector 22b by the CLA 30. The MUXs 8e enable the output value 34 from the
CLA 30 to be sign-extended, if needed. The MAC 100 includes two banks of MUXs and flip-flops units 24a and 24b which receive the output signals 22a and 22b from the Wallace tree 20. The MUXs and flip-flops unit 24a is used to feed part of the sum vector 22a and the carry vector 22b back to the MUX array 14. The portion 26a fed back to the MUX array 14 depends upon the type of operation being performed. Such feedback is a feature common to multi-stage MAC operations, such as for performing a 32-bit multiplication.
The MAC 100 includes a second MUXs and flip-flops unit 24b, to which the sum vector 22a and the carry vector 22b are also sent. Subsequently, these values may be sent to the CLA 30 via the MUXs 8d. In one embodiment of the invention, the sum vector 22a and the carry vector 22b are sent to both units 24a and 24b simultaneously.
In some embodiments of the invention, the MAC 100 includes architectural enhancements which may improve throughput for multiplication operations. For example, in one embodiment of the invention, the MAC 100 includes two registers, an accumulator A 32a and an accumulator B 32b. The accumulators 32 may receive the result vector 34 from the CLA 30. In one embodiment of the invention, the result vector 34 is alternatively stored in the accumulators 32. For example, in a first operation, the result vector, which may be an intermediate result, is stored in the accumulator A 32a. In a subsequent operation, the subsequent result vector is stored in the accumulator B 32b.
The accumulators 32 are each connected to the MUXs 8c, for submission to the Wallace tree 20. The configuration allows the values stored in either accumulator 32 to be submitted to the Wallace tree 20 as the accumulate data instead of receiving the accumulated data from a source (C) external to the MAC 100. As will be shown below, the accumulators 32 may facilitate the throughput of operations performed in the MAC 100 in one embodiment of the invention. The MAC 100 may support implicit instructions such as an implicit multiply instruction. An implicit instruction is one where one or more intermediate results may be stored internally to the MAC, such as in a register. Including a register in the MAC circuitry may allow the MAC to avoid sending intermediate results to a storage location outside the MAC over an external bus, for example. Thus, a MAC which supports implicit operations may process instructions more quickly than a MAC with no such support.
For many multiplication operations, the MAC circuitry may provide multiple intermediate results before arriving at the final result. The conventional MAC design typically receives an intermediate result, an intermediate sum vector and an intermediate carry vector, from the Wallace tree and feeds the results back into the MUX array for subsequent processing. This scheme is repeated as necessary. Eventually, the sum vector and the carry vector produced by the Wallace tree represent the final result. These values are subsequently sent to the CLA, where they are added together and sent out of the MAC circuitry as the final result.
In the embodiment of Figure 1, the intermediate sum vector 22a and the intermediate carry vector 22b may be sent to the CLA 30 in each cycle, if desired. The CLA 30 may then add the intermediate sum vector 22a and the intermediate carry vector 22b, to produce an intermediate result 34, which may then be stored in one of the accumulators 32.
Feedback logic in the MAC 100 design permits the intermediate result 34 to be fed from one of the accumulators 32 back into the Wallace tree 20, via the MUXs 8c, as accumulate data 18. Recall that the Wallace tree 20 includes an input line 18 for the accumulator C. In Figure 1, the MUXs 8c permit the source of the accumulate data 18 to include the accumulators 32.
In one embodiment of the invention, the MAC 100 provides circuitry which allows simultaneous operation of both the Wallace tree 20 and the CLA 30. This circuitry includes early termination logic 50 and MAC control logic 52, in one embodiment of the invention.
This circuitry may control the simultaneous processing of more than one multiplication operation or of more than one portion of a single multiplication operation by the MAC 100.
In a typical implementation, a MAC may receive signed binary values as operands.
For example, a two's complement notation may be used. In two's complement notation, the most significant bit of the value may represent the sign: zero for positive values, one for negative values. Accordingly, in two's complement notation, the 16-bit operand FFClh may represent -63d and the operand 003Fh may represent +63d.
Additionally, 16-bit values may be represented as 32-bit values, for some applications. The sign bit (bit fifteen) may thus be "extended" or duplicated in the upper sixteen bits. The sign-extended operand FFFFFFClh may thus again represent -63d while the operand 0000003 Fh may represent +63d. The upper seventeen bits of both operands are identical, as the sign bit (bit fifteen) is extended. Likewise, for either value, the upper sixteen bits are not needed to perform a multiplication operation. In one embodiment of the invention, the early termination logic 50 uses this feature of signed binary values to the advantage of the MAC 100. In Figure 1, the early termination logic 50 receives a signal from the multiplier B. The early termination logic 50 may be invoked when the upper seventeen bits of a 32-bit multiplier B are identical. In such a case, the upper sixteen bits of the multiplier B are not used in the multiplication operation.
Once invoked, the early termination logic 50 sends a signal to the MAC control logic 52. The MAC control logic 52 controls the flip-flops 6, the MUXs 8, and the MUXs and flip- flops 24, as well as the accumulators 32. The MAC control logic 52 thus may enable the next multiplicand A to be latched by the flip-flops 6a and the MUXs 8a, the next multiplier B to be latched by the flip-flops 6b and the MUXs 8b, or the next accumulate data C to be latched by the flip-flops 6c and the MUXs 8c.
Additionally, the MAC control logic 52 may control the routing of the intermediate sum vector 22a and the intermediate carry vector 22b, received from the Wallace tree 30. The MAC control logic 52 may enable the MUXs and flip-flops 24a, the MUXs and flip- flops 24b, and the MUXs 8d, as needed.
The MAC control logic 52 further controls the accumulator A register 32a and the accumulator B register 32b, permitting the values contained therein to be routed back to the Wallace tree 20 as accumulate input 18. Finally, the MAC control logic 52 may control the MUXs 8e such that the final output vector 34 may be sign-extended, if desired, and produce the output value 40.
In one embodiment of the invention, the MAC control unit 52 may receive control signals from a source external to the MAC 100, such as an instruction decoder (not shown). The MAC control unit 52 may also submit control signals to another source external to the MAC 100. Depending upon the operation being performed, the MAC 100 may produce intermediate vector values. For example, in one embodiment of the invention, the Booth encoder 10 receives a 16-bit value from the multiplier, B. Accordingly, to multiply two 32- bit numbers, or a 16-bit multiplicand and a 32-bit multiplier, the Booth encoder 10 may receive the lower sixteen bits of the multiplier in a first cycle and then receive the upper sixteen bits of the multiplier in a second cycle. Likewise, the other circuitry of the MAC 100 may receive data in both a first and a second cycle. The multiplication operation thus takes, at a minimum, two cycles to complete. For some operations, the MAC 100 may achieve single-cycle throughput. In one embodiment of the invention, the MAC 100 achieves single-cycle throughput in performing 16-bit multiplication operations. Following receipt of the first set of operands into the MAC 100, the Wallace tree 66 and the CLA 68 may simultaneously process all subsequent operands. For example, the Wallace tree 66 may be processing data for cycle n, while, at the same time, the CLA 68 is processing data for cycle n-1.
In Figure 2 A, a flow diagram illustrates how the MAC 100 logic processes a multiply or multiply/accumulate operation. In this example, two 16-bit operands are sign-extended as 32-bit values. Such operands are common in DSP applications and may particularly illustrate performance of the early termination logic 50 in the MAC 100. The MAC 100, however, may perform multiply or multiply/accumulate operations on operands with other characteristics.
A first cycle, cycle 0, begins (block 200). In one embodiment of the invention, the lower sixteen bits of the multiplier B[15:0] are sent to the Booth encoder 10 (block 202). The MUX array 14 receives eight control signals 12 from the Booth encoder 10 as well as the multiplicand A[31 :0] (block 204). The MUX array 14 processes these signals such that the Wallace tree 20 receives eight partial product vectors 16 from the MUX array 14. Additionally, the Wallace tree 20 receives accumulate data C[31 :0] (block 206). From this data, the Wallace tree 20 produces an intermediate sum vector (ISV) 22a and an intermediate carry vector (ICV) 22b (block 208). The intermediate sum vector 22a and the intermediate carry vector 22b are sent to the MUXs and flip-flops 24a and 24b (block 210).
Independently from the preceding operations, at the beginning of cycle 0 (block 200), the early termination logic 50 may receive the 32-bit multiplier B[31 :0] (block 212). Because the operands are sign-extended 16-bit values, the upper seventeen bits of the multiplier B are identical. Accordingly, the early termination logic 50 sends a signal to the MAC control logic 52 (block 214). The MAC control logic 52 then sends a signal to latch the flip-flops 6a, 6b and 6c as well as the MUXs 8a, 8b and 8c (block 216). In this manner, the MAC control logic 52 enables the circuitry to latch the next MAC operands A, B and C.
In Figure 2B, the second cycle, cycle one, is a continuation of the operations of Figure 2A. After cycle one begins (block 230), the MAC control logic 52 sends a signal to the MUXs 8d to release the intermediate sum vector 22a and the intermediate carry vector 22b (block 232). The intermediate sum vector 22a and the intermediate carry vector 22b are sent to the CLA 30 (block 234). Accordingly, the CLA 30 adds the intermediate sum vector 22a and the intermediate carry vector 22b together (block 236). The result 40 is then sent out of the MAC 100 (block 238). Thus, cycle one is completed.
In Figure 3, the single-cycle throughput of 16-bit multiplication operations using the MAC 100 according to one embodiment of the invention may be demonstrated using a chart. At the top of the chart, a numbered series of 16-bit multiplication operations performed by the MAC 100 is depicted. On the left side of the chart, the cycle in which an operation was performed is specified. The chart tracks operations performed by the Wallace tree 20, indicated as "W", and the CLA 30, indicated as "C" according to one embodiment of the invention.
For the first 16-bit multiplication operation, the Wallace tree 20 is executed in cycle zero while the CLA 30 is executed in cycle one. For the second 16-bit multiplication operation, the Wallace tree 20 is executed in cycle one and the CLA 30 is executed in cycle two. The execution of the CLA 30 for the first multiplication operation occurs simultaneously with the execution of the Wallace tree 20 for the second 16-bit multiplication operation. As the chart demonstrates, the subsequent 16-bit multiplication operations proceed like the two already described. At the end of the fifteenth cycle, fifteen 16-bit multiplication operations have been completed. For some multiplication operations according to one embodiment of the invention, the MAC 100 thus provides a single-cycle throughput.
The accumulators 32 allow the MAC 100 to perform implicit multiply and multiply/accumulate operations. In a second embodiment, the MAC 100 may include a single accumulator. The accumulators 32 may be implicitly referenced by several implicit instructions. Those implicit multiply/accumulate instructions reference the accumulators 32 instead of a register-specified accumulator.
For example, the instructions in one embodiment of the invention, MAR or MRA may be received by the MAC control logic 52 in order for the accumulators 32 to be read from or written to, respectively. In Figure 4A, a flow diagram illustrates the implicit multiply/accumulate operation in which early termination is invoked. Recall that, in order for early termination to be invoked, the other seventeen bits of the multiplier B are all zeros or all ones. When cycle zero begins (block 300), the multiplier B[15:0] is sent to the Booth encoder 10 (block 302). The MUX array 14 then receives eight control signals 12 from the Booth encoder 10 as well as the multiplicand A[31 :0] (block 304).
The Wallace tree 20 receives eight partial product vectors from the MUX array 14. Additionally, the Wallace tree 20 receives an accumulate value from either accumulator A 32a or accumulator B 32b (block 306). The Wallace tree 20 subsequently produces an intermediate sum vector 22a and an intermediate carry vector 22b (block 308).
In one embodiment of the invention, the carry look-ahead adder 30 is a 40-bit CLA, which may perform 16-bit DSP operations. Likewise, the accumulator A register 32a and the accumulator B register 32b are 40-bit registers. Thus, in the next operation, the lower 40 bits of the intermediate sum vector 22a and the intermediate carry vector 22b are sent to the
MUXs and flip-flops 24a and 24b (block 310).
Also at the beginning of cycle zero, the entire 32-bit multiplier B is sent to the early termination logic (ETL) 50 (block 312). Because the upper seventeen bits of the multiplier B are identical, the early termination logic 50 sends a signal to the MAC control logic 52 (block
314). The MAC control logic 52 then sends a signal to latch the flip-flops 6a, 6b, and 6c as well as the MUXs 8a, 8b, and 8c (block 316). This indicates that the Wallace tree 20 will be available to accept the next implicit multiply/accumulate instruction in the next cycle (block
318). In Figure 4B, cycle 1 begins (block 330). The MAC control logic 52 sends a signal to the MUXs 8d to release the intermediate sum vector 22a and the intermediate carry vector
22b (block 332). The CLA 30 then adds the two values 22 together to produce an intermediate result 34 (block 334). Because this is an implicit instruction, the result 34 is next stored in either accumulator A 32a or accumulator B 32b (block 336). This completes the end of cycle one (block 338).
In one embodiment of the invention, the MAC 100 may receive implicit instructions which reference the accumulators. These instructions may be received from the MAC control logic 52, which ultimately controls the accumulator A 32a and the accumulator B 32b.
For example, in Figure 4C, the MAC control logic 52 may receive an implicit instruction for reading the accumulator A 32a (block 350). The values stored in the accumulator A 32a and the accumulator B 32b are sent to the CLA 30 (block 352). The CLA
30 then adds the values 36a and 36b together (block 354). The CLA 30 then sends the result 40 as output data (block 356). The result 40 may then be sent to a register file external to the MAC 100.
In Figure 5, a multiply with implicit accumulate operation uses packed data instructions. In one embodiment of the invention, the MAC 100 may receive four different packed data instructions. These four packed data instructions operate on sixteen bits or half of two 32-bit operands. For example, one instruction may operate on the lower sixteen bits of both the multiplier B and the multiplicand A. Another may operate on the upper sixteen bits of the multiplicand A and the lower sixteen bits of the multiplier B. Ultimately, each packed- data instruction thus performs a 16-bit multiply operation on two 16-bit operands. At the beginning of cycle zero (block 400), a 32-bit multiplicand A[31 :0] and a 32-bit multiplier B[31 :0] are sent to the MAC 100 (block 402). The MAC control logic 52 also receives a packed-data instruction (block 404).
Sixteen bits of the multiplicand A are extended to 32 bits. For example, if the packed- data instruction is operating on the lower sixteen bits of the multiplicand A, then the upper sixteen bits of the multiplicand A are replaced with the contents of the 16th bit of the multiplicand A. In essence, the sign is extended from the 16th to the 32nd bit. Likewise, if the packed-data instruction is operating on the upper sixteen bits of the multiplicand A, then the upper sixteen bits are shifted to the lower 16 bits and the upper sixteen bits are filled with the value of the sign bit. Sixteen bits of the multiplier B are sent to the Booth encoder 10 (block 408). For example, if the packed-data instruction operates on the lower half of the multiplier B, then B[15:0] are sent to the Booth encoder 10. Likewise, for a packed-data instruction which operates on the upper half of the multiplier B, the B[31 :16] bits are sent to the Booth encoder 10. From this point, the packed-data instructions are operated upon just as any other implicit instruction would be. Accordingly, the next operation to be performed by the MAC 100 is in Figure 4 A (block 304).
Just as for other operations, the MAC 100 is simultaneously determining whether the early termination logic 50 will be invoked. That is, the multiplier B[31 :0] is sent to the early termination logic 50 (block 420). Because the upper seventeen bits of the multiplier B are identical, the early termination logic 50 sends a signal to the MAC control logic 52 (block 422). The MAC control logic 52 then sends a signal to latch the flip-flops 6a, 6b, and 6c as well as the MUXs 8a, 8b and 8c (block 424). This allows a new MAC instruction to be processed in the next cycle (block 426).
Thus, a multiply-accumulate unit may provide single-cycle throughput for certain operations. In one embodiment of the invention, the MAC avoids using redundant hardware, which may consume additional power, and includes no pipelining circuitry, which may run more slowly. Instead, the Wallace tree and the carry look-ahead adder which are part of the MAC may simultaneously operate. Where such simultaneous operations occur, a higher throughput may be possible.
While the present invention has been described with respect to a limited number of embodiments, those skilled in the art will appreciate numerous modifications and variations therefrom. It is intended that the appended claims cover all such modifications and variations as fall within the true spirit and scope of this present invention.

Claims

What is claimed is: L A method comprising: receiving a first set of operands into a multiply-accumulate unit; performing a first operation on the first set of operands to arrive at a first intermediate result; receiving a second set of operands into the multiply-accumulate unit; and performing the first operation on the second set of operands to arrive at a second intermediate result while performing a second operation on the first intermediate result.
2. The method of claim 1, wherein receiving a first set of operands further comprises: receiving a multiplier into a Booth encoder; and receiving a multiplicand into an array of multiplexers.
3. The method of claim 2, wherein performing a first operation on the first set of operands further comprises sending a plurality of control signals from the Booth encoder to the array of multiplexers.
4. The method of claim 2, wherein performing a first operation on the first set of operands further comprises sending a plurality of partial products from the array of multiplexers to a Wallace tree.
5. The method of claim 4, wherein receiving a first set of operands further comprises receiving an accumulate value into the Wallace tree.
6. The method of claim 5, wherein performing a first operation on the first set of operands further comprises invoking a plurality of carry-save adders in the Wallace tree upon receipt of the plurality of partial products and the accumulate value.
7. The method of claim 1, wherein performing a second operation on the first intermediate result further comprises: receiving the first intermediate result as a first portion and a second portion; and adding the first portion and the second portion together.
8. The method of claim 7, wherein performing a second operation on the first intermediate result further comprises: sending the first portion and the second portion to a carry look-ahead adder; and invoking the carry look-ahead adder.
9. An apparatus, comprising: a structure for performing multiple addition operations; an adder; and a controller which permits a first operation to be performed on a portion of a first operand using the structure while the adder is performing a second operation on another portion of the first operand.
10. The apparatus of claim 9, further comprising an internal storage medium coupled to the adder.
11. The apparatus of claim 9, wherein the structure for performing multiple addition operations comprises a Wallace tree.
12. The apparatus of claim 11, wherein the Wallace tree comprises a plurality of carry-save adders.
13. The apparatus of claim 12, wherein the Wallace tree is a four-stage Wallace tree.
14. The apparatus of claim 9, wherein the adder is a carry look-ahead adder.
15. The apparatus of claim 9, further comprising a Booth encoder coupled to the structure for performing multiple addition operations.
16. The apparatus of claim 12, wherein the Wallace tree receives nine input vectors and produces two output vectors.
17. The apparatus of claim 10, wherein the internal storage medium comprises one or more accumulators.
18. The apparatus of claim 17, wherein one or more accumulators are coupled to the output of the adder.
19. An apparatus comprising: a Wallace tree; an adder; and a controller that sends a plurality of signals to cause the Wallace tree to execute a part of an instruction while the adder executes another part of the instruction.
20. The apparatus of claim 19, wherein the adder is a carry look-ahead adder.
PCT/US2000/032887 1999-12-23 2000-12-04 Processing multiply-accumulate operations in a single cycle WO2001048595A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2001549181A JP3869269B2 (en) 1999-12-23 2000-12-04 Handling multiply accumulate operations in a single cycle
AU20594/01A AU2059401A (en) 1999-12-23 2000-12-04 Processing multiply-accumulate operations in a single cycle
GB0208937A GB2371657B (en) 1999-12-23 2000-12-04 Processing multiply-accumulate operations in a single cycle

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/470,836 US6611856B1 (en) 1999-12-23 1999-12-23 Processing multiply-accumulate operations in a single cycle
US09/470,836 1999-12-23

Publications (1)

Publication Number Publication Date
WO2001048595A1 true WO2001048595A1 (en) 2001-07-05

Family

ID=23869256

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/032887 WO2001048595A1 (en) 1999-12-23 2000-12-04 Processing multiply-accumulate operations in a single cycle

Country Status (8)

Country Link
US (2) US6611856B1 (en)
JP (1) JP3869269B2 (en)
KR (1) KR100470299B1 (en)
CN (1) CN1230735C (en)
AU (1) AU2059401A (en)
GB (1) GB2371657B (en)
TW (1) TW588281B (en)
WO (1) WO2001048595A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003032187A2 (en) * 2001-10-05 2003-04-17 Intel Corporation Multiply-accumulate (mac) unit for single-instruction/multiple-data (simd) instructions
CN100363885C (en) * 2004-11-19 2008-01-23 浙江大学 Multiply and accumulate device

Families Citing this family (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6724220B1 (en) 2000-10-26 2004-04-20 Cyress Semiconductor Corporation Programmable microcontroller architecture (mixed analog/digital)
US7765095B1 (en) 2000-10-26 2010-07-27 Cypress Semiconductor Corporation Conditional branching in an in-circuit emulation system
US8176296B2 (en) 2000-10-26 2012-05-08 Cypress Semiconductor Corporation Programmable microcontroller architecture
US6957242B1 (en) * 2000-10-26 2005-10-18 Cypress Semiconductor Corp. Noninterfering multiply-MAC (multiply accumulate) circuit
US8103496B1 (en) 2000-10-26 2012-01-24 Cypress Semicondutor Corporation Breakpoint control in an in-circuit emulation system
US8149048B1 (en) 2000-10-26 2012-04-03 Cypress Semiconductor Corporation Apparatus and method for programmable power management in a programmable analog circuit block
US8160864B1 (en) 2000-10-26 2012-04-17 Cypress Semiconductor Corporation In-circuit emulator and pod synchronized boot
US7406674B1 (en) 2001-10-24 2008-07-29 Cypress Semiconductor Corporation Method and apparatus for generating microcontroller configuration information
US8078970B1 (en) 2001-11-09 2011-12-13 Cypress Semiconductor Corporation Graphical user interface with user-selectable list-box
US8042093B1 (en) 2001-11-15 2011-10-18 Cypress Semiconductor Corporation System providing automatic source code generation for personalization and parameterization of user modules
US6971004B1 (en) 2001-11-19 2005-11-29 Cypress Semiconductor Corp. System and method of dynamically reconfiguring a programmable integrated circuit
US7770113B1 (en) 2001-11-19 2010-08-03 Cypress Semiconductor Corporation System and method for dynamically generating a configuration datasheet
US7774190B1 (en) 2001-11-19 2010-08-10 Cypress Semiconductor Corporation Sleep and stall in an in-circuit emulation system
US7844437B1 (en) 2001-11-19 2010-11-30 Cypress Semiconductor Corporation System and method for performing next placements and pruning of disallowed placements for programming an integrated circuit
US8069405B1 (en) 2001-11-19 2011-11-29 Cypress Semiconductor Corporation User interface for efficiently browsing an electronic document using data-driven tabs
US8103497B1 (en) 2002-03-28 2012-01-24 Cypress Semiconductor Corporation External interface for event architecture
US7308608B1 (en) 2002-05-01 2007-12-11 Cypress Semiconductor Corporation Reconfigurable testing system and method
US7761845B1 (en) 2002-09-09 2010-07-20 Cypress Semiconductor Corporation Method for parameterizing a user module
US7043517B2 (en) * 2003-03-07 2006-05-09 Faraday Technology Corp. Multiply accumulator for two N bit multipliers and an M bit addend
US7266580B2 (en) * 2003-05-12 2007-09-04 International Business Machines Corporation Modular binary multiplier for signed and unsigned operands of variable widths
US7043518B2 (en) * 2003-07-31 2006-05-09 Cradle Technologies, Inc. Method and system for performing parallel integer multiply accumulate operations on packed data
US7295049B1 (en) 2004-03-25 2007-11-13 Cypress Semiconductor Corporation Method and circuit for rapid alignment of signals
US8069436B2 (en) 2004-08-13 2011-11-29 Cypress Semiconductor Corporation Providing hardware independence to automate code generation of processing device firmware
US8286125B2 (en) 2004-08-13 2012-10-09 Cypress Semiconductor Corporation Model for a hardware device-independent method of defining embedded firmware for programmable systems
US7332976B1 (en) 2005-02-04 2008-02-19 Cypress Semiconductor Corporation Poly-phase frequency synthesis oscillator
EP1710691A1 (en) * 2005-04-07 2006-10-11 STMicroelectronics (Research & Development) Limited MAC/MUL unit
US7400183B1 (en) 2005-05-05 2008-07-15 Cypress Semiconductor Corporation Voltage controlled oscillator delay cell and method
US8089461B2 (en) 2005-06-23 2012-01-03 Cypress Semiconductor Corporation Touch wake for electronic devices
US8085067B1 (en) 2005-12-21 2011-12-27 Cypress Semiconductor Corporation Differential-to-single ended signal converter circuit and method
US8067948B2 (en) 2006-03-27 2011-11-29 Cypress Semiconductor Corporation Input/output multiplexer bus
US9564902B2 (en) 2007-04-17 2017-02-07 Cypress Semiconductor Corporation Dynamically configurable and re-configurable data path
US7737724B2 (en) 2007-04-17 2010-06-15 Cypress Semiconductor Corporation Universal digital block interconnection and channel routing
US8516025B2 (en) 2007-04-17 2013-08-20 Cypress Semiconductor Corporation Clock driven dynamic datapath chaining
US8130025B2 (en) 2007-04-17 2012-03-06 Cypress Semiconductor Corporation Numerical band gap
US8040266B2 (en) 2007-04-17 2011-10-18 Cypress Semiconductor Corporation Programmable sigma-delta analog-to-digital converter
US8092083B2 (en) 2007-04-17 2012-01-10 Cypress Semiconductor Corporation Temperature sensor with digital bandgap
US8026739B2 (en) 2007-04-17 2011-09-27 Cypress Semiconductor Corporation System level interconnect with programmable switching
US9720805B1 (en) 2007-04-25 2017-08-01 Cypress Semiconductor Corporation System and method for controlling a target device
US8266575B1 (en) 2007-04-25 2012-09-11 Cypress Semiconductor Corporation Systems and methods for dynamically reconfiguring a programmable system on a chip
US8065653B1 (en) 2007-04-25 2011-11-22 Cypress Semiconductor Corporation Configuration of programmable IC design elements
US8049569B1 (en) 2007-09-05 2011-11-01 Cypress Semiconductor Corporation Circuit and method for improving the accuracy of a crystal-less oscillator having dual-frequency modes
US9448964B2 (en) 2009-05-04 2016-09-20 Cypress Semiconductor Corporation Autonomous control in a programmable system
CN101706712B (en) * 2009-11-27 2011-08-31 北京龙芯中科技术服务中心有限公司 Operation device and method for multiplying and adding floating point vector
US8478969B2 (en) 2010-09-24 2013-07-02 Intel Corporation Performing a multiply-multiply-accumulate instruction
US9753695B2 (en) 2012-09-04 2017-09-05 Analog Devices Global Datapath circuit for digital signal processors
CN105849690B (en) * 2014-07-02 2019-03-15 上海兆芯集成电路有限公司 Merge product-accumulating operation processor and method
US9519460B1 (en) * 2014-09-25 2016-12-13 Cadence Design Systems, Inc. Universal single instruction multiple data multiplier and wide accumulator unit
US9411726B2 (en) * 2014-09-30 2016-08-09 Samsung Electronics Co., Ltd. Low power computation architecture
RU2625528C1 (en) * 2016-05-17 2017-07-14 Федеральное государственное бюджетное образовательное учреждение высшего образования "Кубанский государственный технологический университет" (ФГБОУ ВО "КубГТУ") Arithmetic unit
US10140090B2 (en) * 2016-09-28 2018-11-27 International Business Machines Corporation Computing and summing up multiple products in a single multiplier
US10693469B2 (en) 2018-08-31 2020-06-23 Flex Logic Technologies, Inc. Multiplier-accumulator circuit, logic tile architecture for multiply-accumulate, and IC including logic tile array
US11194585B2 (en) 2019-03-25 2021-12-07 Flex Logix Technologies, Inc. Multiplier-accumulator circuitry having processing pipelines and methods of operating same
US11314504B2 (en) 2019-04-09 2022-04-26 Flex Logix Technologies, Inc. Multiplier-accumulator processing pipelines and processing component, and methods of operating same
US11288076B2 (en) 2019-09-13 2022-03-29 Flex Logix Technologies, Inc. IC including logic tile, having reconfigurable MAC pipeline, and reconfigurable memory
US11455368B2 (en) 2019-10-02 2022-09-27 Flex Logix Technologies, Inc. MAC processing pipeline having conversion circuitry, and methods of operating same
US11693625B2 (en) 2019-12-04 2023-07-04 Flex Logix Technologies, Inc. Logarithmic addition-accumulator circuitry, processing pipeline including same, and methods of operation
US11960856B1 (en) 2020-01-15 2024-04-16 Flex Logix Technologies, Inc. Multiplier-accumulator processing pipeline using filter weights having gaussian floating point data format
US20210255861A1 (en) * 2020-02-07 2021-08-19 Micron Technology, Inc. Arithmetic logic unit
US11442881B2 (en) 2020-04-18 2022-09-13 Flex Logix Technologies, Inc. MAC processing pipelines, circuitry to control and configure same, and methods of operating same
US11604645B2 (en) 2020-07-22 2023-03-14 Flex Logix Technologies, Inc. MAC processing pipelines having programmable granularity, and methods of operating same
CN114237550B (en) * 2021-11-10 2023-10-13 电子科技大学 Wallace tree-based multi-input shift sum accumulator

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0316036A2 (en) * 1987-11-09 1989-05-17 Lsi Logic Corporation Digital multiplier circuit and a digital multiplier-accumulator circuit which preloads and accumulates subresults
US4852037A (en) * 1986-08-16 1989-07-25 Nec Corporation Arithmetic unit for carrying out both multiplication and addition in an interval for the multiplication
EP0377837A2 (en) * 1989-01-13 1990-07-18 International Business Machines Corporation Floating point unit having simultaneous multiply and add

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4041292A (en) * 1975-12-22 1977-08-09 Honeywell Information Systems Inc. High speed binary multiplication system employing a plurality of multiple generator circuits
US4547862A (en) * 1982-01-11 1985-10-15 Trw Inc. Monolithic fast fourier transform circuit
US4809212A (en) * 1985-06-19 1989-02-28 Advanced Micro Devices, Inc. High throughput extended-precision multiplier
US4754421A (en) * 1985-09-06 1988-06-28 Texas Instruments Incorporated Multiple precision multiplication device
JPS6284335A (en) 1985-10-09 1987-04-17 Hitachi Ltd Multiplier circuit
US4841468A (en) * 1987-03-20 1989-06-20 Bipolar Integrated Technology, Inc. High-speed digital multiplier architecture
US6463453B1 (en) * 1998-01-12 2002-10-08 Motorola, Inc. Low power pipelined multiply/accumulator with modified booth's recoder

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4852037A (en) * 1986-08-16 1989-07-25 Nec Corporation Arithmetic unit for carrying out both multiplication and addition in an interval for the multiplication
EP0316036A2 (en) * 1987-11-09 1989-05-17 Lsi Logic Corporation Digital multiplier circuit and a digital multiplier-accumulator circuit which preloads and accumulates subresults
EP0377837A2 (en) * 1989-01-13 1990-07-18 International Business Machines Corporation Floating point unit having simultaneous multiply and add

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"MULTIPLY-ADDITION - AN ULTRA HIGH PERFORMANCE DATAFLOW", IBM TECHNICAL DISCLOSURE BULLETIN,US,IBM CORP. NEW YORK, vol. 30, no. 3, 1 August 1987 (1987-08-01), pages 982 - 987, XP000714456, ISSN: 0018-8689 *
"PRACTICAL TWO-CYCLE FORWARDING MECHANISM FOR FLOATING POINT UNITS", IBM TECHNICAL DISCLOSURE BULLETIN,US,IBM CORP. NEW YORK, vol. 38, no. 8, 1 August 1995 (1995-08-01), pages 225 - 236, XP000534497, ISSN: 0018-8689 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003032187A2 (en) * 2001-10-05 2003-04-17 Intel Corporation Multiply-accumulate (mac) unit for single-instruction/multiple-data (simd) instructions
WO2003032187A3 (en) * 2001-10-05 2004-06-10 Intel Corp Multiply-accumulate (mac) unit for single-instruction/multiple-data (simd) instructions
US7107305B2 (en) 2001-10-05 2006-09-12 Intel Corporation Multiply-accumulate (MAC) unit for single-instruction/multiple-data (SIMD) instructions
KR100834178B1 (en) * 2001-10-05 2008-05-30 인텔 코포레이션 Multiply-accumulate mac unit for single-instruction/multiple-data simd instructions
CN100363885C (en) * 2004-11-19 2008-01-23 浙江大学 Multiply and accumulate device

Also Published As

Publication number Publication date
GB0208937D0 (en) 2002-05-29
JP2003518690A (en) 2003-06-10
GB2371657A (en) 2002-07-31
US6611856B1 (en) 2003-08-26
CN1230735C (en) 2005-12-07
JP3869269B2 (en) 2007-01-17
GB2371657B (en) 2004-09-15
KR20030011063A (en) 2003-02-06
CN1402843A (en) 2003-03-12
AU2059401A (en) 2001-07-09
US20030172101A1 (en) 2003-09-11
KR100470299B1 (en) 2005-02-05
TW588281B (en) 2004-05-21

Similar Documents

Publication Publication Date Title
US6611856B1 (en) Processing multiply-accumulate operations in a single cycle
EP1446728B1 (en) Multiply-accumulate (mac) unit for single-instruction/multiple-data (simd) instructions
US3787673A (en) Pipelined high speed arithmetic unit
US7395298B2 (en) Method and apparatus for performing multiply-add operations on packed data
US5983256A (en) Apparatus for performing multiply-add operations on packed data
US7516307B2 (en) Processor for computing a packed sum of absolute differences and packed multiply-add
US6256655B1 (en) Method and system for performing floating point operations in unnormalized format using a floating point accumulator
JPH07200261A (en) Logic unit
EP0847552B1 (en) An apparatus for performing multiply-add operations on packed data
US7028066B2 (en) Vector SIMD processor
US5835392A (en) Method for performing complex fast fourier transforms (FFT's)
JPH10124484A (en) Data processor and data processing system
US5253195A (en) High speed multiplier
US7519646B2 (en) Reconfigurable SIMD vector processing system
US6324638B1 (en) Processor having vector processing capability and method for executing a vector instruction in a processor
US9372665B2 (en) Method and apparatus for multiplying binary operands
US6493817B1 (en) Floating-point unit which utilizes standard MAC units for performing SIMD operations
US5721697A (en) Performing tree additions via multiplication
EP0534760A2 (en) High speed multiplier device
GB2397674A (en) Multiplier accumulator unit with a Wallace tree coupled to an adder and a controller
EP0142913B1 (en) Signed multiplier
GB2379759A (en) Method and circuit for alignment of floating point significands by right shifting or setting to zero of a second register
CN117492969A (en) Method for rapidly solving reciprocal of positive number based on SIMD instruction
JPH07160672A (en) Sum of products operation circuit
JPH08180040A (en) Digital signal processor

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
ENP Entry into the national phase

Ref country code: GB

Ref document number: 200208937

Kind code of ref document: A

Format of ref document f/p: F

WWE Wipo information: entry into national phase

Ref document number: 1020027006508

Country of ref document: KR

ENP Entry into the national phase

Ref country code: JP

Ref document number: 2001 549181

Kind code of ref document: A

Format of ref document f/p: F

WWE Wipo information: entry into national phase

Ref document number: 008144435

Country of ref document: CN

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
WWP Wipo information: published in national office

Ref document number: 1020027006508

Country of ref document: KR

WWG Wipo information: grant in national office

Ref document number: 1020027006508

Country of ref document: KR