|Publication number||US6691216 B2|
|Application number||US 10/004,492|
|Publication date||Feb 10, 2004|
|Filing date||Oct 24, 2001|
|Priority date||Nov 8, 2000|
|Also published as||DE60139109D1, EP1239374A1, EP1239374B1, US20020056030|
|Publication number||004492, 10004492, US 6691216 B2, US 6691216B2, US-B2-6691216, US6691216 B2, US6691216B2|
|Inventors||Kenneth C. Kelly, Irvinderpal S. Ghai, Jay B. Reimer, Tai Huu Nguyen, Harland Glenn Hopkins, Yi Luo, Jason A. T. Jones, Dan K. Bui, Patrick J. Smith, Kevin A. McGonagle|
|Original Assignee||Texas Instruments Incorporated|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (11), Referenced by (39), Classifications (23), Legal Events (4)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This application claims priority under 35 USC §119(e)(1) of Provisional Application No. 60/246,648, filed Nov. 8, 2000.
The present invention generally relates to digital signal processors. More particularly, the invention relates to memory in digital signal processors. Still more particularly, the invention relates to a program memory that is shared between multiple central processing unit (CPU) cores and that can fetch instructions for multiple CPU cores in the same clock cycle.
Microprocessors generally include a variety of logic circuits fabricated on a single semiconductor chip. Such logic circuits typically include a central processing unit (CPU) core, memory, and numerous other components. Some microprocessors, such as digital signal processors (DSPs) provided by Texas Instruments, may include more than one CPU core on the same chip. For such multi-core DSP devices, typically each CPU core has an associated memory in which it stores data and program instructions. In other words, for every CPU core in a multi-core DSP device, there is a corresponding memory reserved for use by that CPU core.
It is generally desirable for microprocessors such as DSPs to be compact, consume very little power, and generate as little heat as possible. This is especially true for DSPs that reside in small, battery-powered devices such as cellular telephones, pagers, and the like. Accordingly, any improvement in DSP technology that results in smaller and lighter devices that require less power is highly desirable.
The invention disclosed may advantageously provide a compact, low power design by eliminating redundancy of on-board memory in multi-core DSP devices. In one embodiment, the multi-core DSP device has a shared program memory. As each of the program cores may execute the same software program, memory requirements may be reduced by having multiple processor cores share only a single copy of the software. Accordingly, a program memory is coupled to each of the processor cores by a corresponding instruction bus. Preferably the program memory services two or more instruction requests in each clock cycle. Data, however, is preferably stored in separate memory arrays local to the processor core subsystems. The processor cores each access their data via a dedicated data bus.
According to a preferred implementation, the program memory includes a “wrapper” that can perform one memory access in the first half of each clock cycle and a second memory access in the second half of the clock cycle. A designated set of instruction buses is allowed to arbitrate for only the first access, and the remaining instruction buses are allowed to arbitrate for only the second access. In this manner, a reduction in on-board memory requirements and associated power consumption advantageously may be achieved.
For a detailed description of the preferred embodiments of the invention, reference will now be made to the accompanying drawings in which:
FIG. 1 shows a preferred embodiment of the invention in which two processor cores share one program memory;
FIG. 2A shows one embodiment of a shared program memory wrapper;
FIG. 2B shows an alternate embodiment of a shared program memory wrapper; and
FIGS. 3 and 4 show timing diagrams illustrating how two memory accesses may be serviced in a single clock cycle.
Certain terms are used throughout the following description and claims to refer to particular system components. As one skilled in the art will appreciate, semiconductor companies may refer to a component by different names. This document does not intend to distinguish between components that differ in name but not function. In the following discussion and in the claims, the terms “including” and “comprising” are used in an open-ended fashion, and thus should be interpreted to mean “including, but not limited to . . . ”. Also, the term “couple” or “couples” is intended to mean either an indirect or direct electrical connection. Thus, if a first device couples to a second device, that connection may be through a direct electrical connection, or through an indirect electrical connection via other devices and connections.
The preferred embodiment of the present invention is discussed below in the context of a multi-core, fixed-point, digital signal processor (DSP) chip. This embodiment, however, is not intended to limit the scope of this disclosure to this context, rather, the preferred embodiment may have applicability to any multiple core DSP device that would benefit from sharing resources.
Turning now to the figures, FIG. 1 shows a DSP chip 100 that includes multiple DSP subsystems 101, 102, a shared program memory (PRAM) 10, and two host port interfaces (HPI) 17, 27 that allow the DSP 100 to be accessed by a host processor (not shown) or other external device as a memory-mapped peripheral device. The DSP subsystems 101, 102 are preferably capable of core-to-core communications.
Each DSP subsystem 101, 102 (generally separated by the dashed line in FIG. 1) preferably includes a DSP core 11, 21, a dual-access, random access memory (DARAM) 12, 22 for data or software, a single-access, random access memory (SARAM) 13, 23 for data, a read-only memory (ROM) 14, 24 for boot-up, one or more external interfaces 16, 26, direct memory access (DMA) logic (also referred to as a DMA controller) 15, 25, and other miscellaneous support circuitry. The DARAM 12, 22 preferably includes four memory blocks, each of which support two memory accesses per clock cycle. The DARAM 12, 22 is intended primarily for data storage, but may be used to store program instructions as well. A register (not shown) in the DSP core 11, 21 determines whether the DARAM 12, 22 is mapped into program memory space or data memory space. The SARAM 13, 23, preferably also includes four memory blocks, each of which support one memory access per clock cycle. Each SARAM preferably is reserved for data storage.
The shared program memory (PRAM) 10 preferably is reserved for program instructions, and includes 16 blocks of dual-access RAM. Each block comprises 16 kilobytes of storage, although the block size and number of blocks can be varied as desired. The PRAM 10 may be physically implemented in pieces 10A, 10B, with each subsystem having a piece. Each DSP subsystem 101, 102 is preferably capable of executing an instruction fetch from any location in the PRAM 10 during each clock cycle. According to the preferred embodiment, the DSP cores 11, 21 are not permitted to write to the PRAM 10. Instead, the DMA logic 15, 25 stores the software in the PRAM 10. The software may be provided by a host processor via HPI 17, 27.
Referring still to FIG. 1, instruction buses P1, P2 couple together the DSP core 11, 21, the local DARAM 12, 22, the local ROM 14, 24, and the shared PRAM 10. Each DSP core 11, 21 preferably has an associated data bus D1, D2 that facilitates data transfers between the local DSP core 11, 21 and its associated data storage devices DARAM 12, 22 and SARAM 13, 23. Each DSP core 11, 21 preferably retrieves instructions via its associated instruction bus P1, P2 from the PRAM 10. The processor cores 11, 21 concurrently fetch and execute distinct instructions from a single program stored in the PRAM 10, and the order in which program instructions are executed by a processor core depends on the data on which the processor core operates. For example, the data on which the cores operate may represent telephone communications. Each core could be responsible for a different set of channels, and as those channels independently initiate and terminate communications, the processors will independently execute the appropriate software instructions. The data will determine the order in which instructions are executed.
Each DMA logic 15, 25 moves data and instructions to and from local data storage devices and to shared PRAM 10 via associated memory buses M1, M2. Each DMA logic 15, 25 also couples to various external interfaces 16, 26, and to host processor interfaces 17, 27. The HPI 17, 27, allows an external host processor to access all internal memory via DMA logic 15, 25.
To keep the overall system design simple, the host processor interface 17, 27 is designed to mimic a memory interface. That is, the host processor can “view” the contents of any memory location internal to the DSP 100 and many of the DSP core registers by sending an address to the HPI 17, 27 indicating the desired location. One of the HPIs 17, 27, causes the associated DMA logic 15, 25 to retrieve the desired information, and then provides the information as data in the same way that a memory device would. The HPI 17, 27 preferably acts as a slave device to the host processor, but generates a signal to the host processor to stall the host processor during an access if the DMA logic 15, 25 is busy with other tasks.
External interface ports 16, 26 preferably each include one or more multi-channel serial interfaces. The multi-channel serial ports provide high-speed, full-duplex, double-buffered serial communications for direct interfacing with other DSP chips. The configuration of these ports is preferably programmable by a host computer to allow direct interfacing with existing standard protocols. Each port 16, 26 preferably supports multi-channel transmit and receive of up to 128 channels. The multi-channel serial ports perform time division multiplexing and de-multiplexing when multiple channels are enabled. Each data frame that is sent or received represents a time-division multiplexed (TDM) data stream, so that the content of one channel is interleaved with the contents of the other channels.
The DMA controllers 15, 25 perform data transfers independent of the DSP cores 11, 21. The DMA controllers control access to internal memory (PRAM 10, DARAM 12, 22, and SARAM 13, 23) and to external I/O and memory (via external interfaces 16, 26). The DMA controllers 15, 25 can perform background movement of data between internal memory, external memory, and internal peripherals such as the serial ports 16, 26 and HPIs 17, 27. Each DMA controller preferably provides multiple “channels” for the independent, concurrent management of multiple block transfers. DMA transfers are accomplished by first reading the data into memory internal to the DMA controller, and then writing the data from the DMA controller memory to the desired destination. When DSP core memory accesses to internal memory conflict with DMA controller accesses, the DMA controller accesses preferably are given higher priority. The M1 and M2 buses are coupled by a bus interface (not shown) so that the DSP cores can communicate by DMA data transfers between local data memories (DARAM 12, 22 or SARAM 13, 23).
Turning now to FIG. 2A, the shared PRAM 10 preferably includes a random access memory (RAM) 40 having a memory array and well-known supporting circuitry such as address decoders and read/write circuitry (not specifically shown). In addition, the PRAM 10 preferably includes a memory “wrapper” 30 as shown in FIG. 2A. The memory wrapper 30 comprises the supporting circuitry that provides the RAM 40 with the desired functionality of permitting multiple DSP core accesses in the same clock cycle. Wrapper 30 includes a first arbitration unit 31 with an associated multiplexer 32, a second arbitration unit 33 with its associated multiplexer 34, a third arbitration unit 38 with its associated multiplexer 39, a time division multiplexer 35, a delay latch 36, and an output register 37.
In the embodiment of FIGS. 1 and 2A, the DSP chip 100 includes only two DSP subsystems 101, 102. As one skilled in the art will appreciate, there may be more than two DSP subsystems, each having a corresponding processor core. The DSP subsystems will be separated into two sets. For the current discussion, the first set consists of subsystem 101, and the second set consists of subsystem 102. Instruction buses from processor cores in the first set (P1) couple to the first arbitration unit 31, and the instruction buses from processor cores in the second set (P2) couple to the second arbitration unit 33. The memory buses M1, M2 from all subsystems are coupled to both arbitration units 31, 33 via the third arbitration unit 38 and associated multiplexer 39.
Each arbitration unit 31, 33, 38 receives requests for access to RAM 40. If more than one request is received by an arbitration unit, that unit will select one of the requests and stall the rest. In resolving conflicts, arbitration units 31, 33 preferably give priority to access requests from the moemory buses M1, M2. DMA read requests are serviced only by the first arbitration unit 31, and DMA write requests are serviced only by the second arbitration unit 33. Only one memory bus M1 or M2 is granted access by arbitration unit 38 in a given cycle. If at least one request is received by an arbitration unit, the arbitration unit sets the associated multiplexer 32, 34, 39 to pass the selected request onward.
The time division multiplexer 35 receives the access requests selected by the arbitration units 31, 33. An inverter 41 receives and inverts a clock signal. The clock signal (CLK) may be generated elsewhere in DSP 100 via clock generation circuitry not specifically shown in FIG. 1. The inverted clock signal functions as the select signal for the time division multiplexer 35. When the inverted clock signal is low the time division multiplexer 35 forwards the memory access selected by the first arbitration unit 31 to the RAM 40. The forwarded memory access includes address A as shown. During this first half-cycle of the clock, the RAM 40 services the access request and provides any output Q to delay register 36. A positive-going (i.e., low to high) transition of the inverted clock signal causes the delay register 36 to latch and forward the output value to the output register 37. While the inverted clock signal is high, the time division multiplexer 35 forwards the memory access selected by the second arbitration unit 33 to RAM 40, which services the access request and provides any output Q to output register 37. A positive-going transition of the non-inverted clock signal causes the output register 37 to latch and forward the output Q of the RAM 40 and the output of the delay register 36. In this manner, two processor cores can independently retrieve program instructions from the shared PRAM 10 in one clock cycle.
In systems with more than two processor cores, one or more of the processor cores' instruction buses may be coupled to the first arbitration unit 31, and the remaining processor cores' instruction buses may be coupled to the second arbitration unit 33. The processor cores having memory access requests that are not granted during the current clock cycle preferably are forced to wait at least until the next clock cycle to have their accesses serviced. These requesters may be stalled by holding a commonly known bus acknowledge signal low until the request is serviced. Preferably, access conflicts between processor cores cause arbitration priorities to shift in a systematic fashion to prevent discrimination against any one processor core. It is preferred to give the memory bus accesses the highest priority at all times to avoid stalling DMA transfers. Typically, DMA accesses to the shared PRAM 10 are performed only during initial program load as explained above. During normal operation, these accesses would typically not occur.
It is noted that when coupling processor cores to arbitration units, it may be desirable to couple the cores that are physically furthest away from the PRAM to the second arbitration unit 33. Since accesses made via arbitration unit 33 are performed in the second half of the clock cycle, this will allow more time for signal propagation from the more distant processor cores, thereby somewhat easing timing constraints.
FIGS. 3 and 4 illustrate the signal timing on the instruction buses P1 and P2 and in the memory wrapper 30. The processor cores 11, 21 request memory accesses by asserting the selection signals P1SEL, P2SEL of the instruction buses P1, P2, and providing the desired instruction address on their corresponding instruction buses P1, P2. The memory wrapper 30 forwards the P1 instruction bus address P1ADD as address A to the RAM 40 during the first half of the clock cycle, and forwards the P2 instruction bus address P2ADD as address A to the RAM 40 during the second half of the clock cycle. (Compare FIGS. 3 and 4). The output data Q requested on instruction bus P1 is supplied by the RAM 40 to the wrapper 30 during the second half of the clock cycle, and the output data Q requested by instruction bus P2 is supplied after the second half of the clock cycle (beginning of the next clock cycle). The output data Q is latched as P1DAT and P2DAT, and held by the wrapper 30 for a complete clock cycle before being forwarded to the individual processor cores 11, 21.
FIG. 2B shows an alternate embodiment in which a memory wrapper 30A is provided for only a portion 10A of shared program memory 10. The other portion 10B has a similar memory wrapper. Components numbered identically to those in FIG. 2B perform similar functions. Note that only the local memory bus M1 is coupled to portion 10A, so that memory wrapper 30A does not require a third arbiter to arbitrate between memory buses M1 and M2. Portion 10B will be similarly coupled to memory bus M2. In digital signal processor systems having more processor subsystems, the shared program memory may be implemented in more portions, and each portion will be coupled to the local memory bus.
The above discussion is meant to be illustrative of the principles and various embodiments of the present invention. Numerous variations and modifications will become apparent to those skilled in the art once the above disclosure is fully appreciated. It is intended that the following claims be interpreted to embrace all such variations and modifications.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4447877 *||Aug 6, 1981||May 8, 1984||Data General Corporation||Memory bus interface system|
|US5659688||Jun 7, 1995||Aug 19, 1997||Zilog, Inc.||Technique and circuit for providing two or more processors with time multiplexed access to a shared system resource|
|US5838934 *||Jun 7, 1995||Nov 17, 1998||Texas Instruments Incorporated||Host port interface|
|US5890013||Sep 30, 1996||Mar 30, 1999||Intel Corporation||Paged memory architecture for a single chip multi-processor with physical memory pages that are swapped without latency|
|US6058458||Dec 4, 1997||May 2, 2000||Samsung Electronics Co., Ltd.||Multi-processor system having a shared program memory and related method|
|US20020004877 *||Apr 14, 1999||Jan 10, 2002||Brian Boles||Method and system for updating user memory in emulator systems|
|US20020059393 *||Nov 8, 2001||May 16, 2002||Reimer Jay B.||Multicore DSP device having coupled subsystem memory buses for global DMA access|
|US20020059502 *||Nov 8, 2001||May 16, 2002||Reimer Jay B.||Multicore DSP device having shared program memory with conditional write protection|
|US20030018859 *||Feb 15, 2002||Jan 23, 2003||Smith Patrick J.||Arbitration in local system for access to memory in a distant subsystem|
|EP1239374A1 *||Nov 7, 2001||Sep 11, 2002||Texas Instruments Incorporated||Shared program memory for use in multicore DSP devices|
|WO1994009437A1||Oct 14, 1993||Apr 28, 1994||Telefonaktiebolaget Lm Ericsson||Signal handling system with a shared data memory|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US6862640||Feb 15, 2002||Mar 1, 2005||Texas Instruments Incorporated||Arbitration in local system for access to memory in a distant subsystem|
|US6976141 *||Nov 2, 2001||Dec 13, 2005||Broadcom Corporation||Pipelined multi-access memory apparatus and method|
|US7117389 *||Sep 18, 2003||Oct 3, 2006||International Business Machines Corporation||Multiple processor core device having shareable functional units for self-repairing capability|
|US7131114 *||Jul 15, 2002||Oct 31, 2006||Texas Instruments Incorporated||Debugger breakpoint management in a multicore DSP device having shared program memory|
|US7237071 *||Sep 27, 2002||Jun 26, 2007||Texas Instruments Incorporated||Embedded symmetric multiprocessor system with arbitration control of access to shared resources|
|US7356680||Jan 22, 2005||Apr 8, 2008||Telefonaktiebolaget L M Ericsson (Publ)||Method of loading information into a slave processor in a multi-processor system using an operating-system-friendly boot loader|
|US7664970||Dec 30, 2005||Feb 16, 2010||Intel Corporation||Method and apparatus for a zero voltage processor sleep state|
|US7699021||Jan 30, 2006||Apr 20, 2010||Sokudo Co., Ltd.||Cluster tool substrate throughput optimization|
|US7870365||Jul 7, 2008||Jan 11, 2011||Ovics||Matrix of processors with data stream instruction execution pipeline coupled to data switch linking to neighbor units by non-contentious command channel / data channel|
|US7953993||Nov 8, 2007||May 31, 2011||Intel Corporation||Method and apparatus for a zero voltage processor sleep state|
|US7958341||Jun 7, 2011||Ovics||Processing stream instruction in IC of mesh connected matrix of processors containing pipeline coupled switch transferring messages over consecutive cycles from one link to another link or memory|
|US7966511||Jun 21, 2011||Intel Corporation||Power management coordination in multi-core processors|
|US8131975||Jul 7, 2008||Mar 6, 2012||Ovics||Matrix processor initialization systems and methods|
|US8145880||Jul 7, 2008||Mar 27, 2012||Ovics||Matrix processor data switch routing systems and methods|
|US8327114||Dec 4, 2012||Ovics||Matrix processor proxy systems and methods|
|US8381006||Apr 8, 2010||Feb 19, 2013||International Business Machines Corporation||Reducing power requirements of a multiple core processor|
|US8550031||Jun 15, 2012||Oct 8, 2013||Applied Materials, Inc.||Cluster tool architecture for processing a substrate|
|US8707062||Feb 16, 2010||Apr 22, 2014||Intel Corporation||Method and apparatus for powered off processor core mode|
|US8707066||May 31, 2011||Apr 22, 2014||Intel Corporation||Method and apparatus for a zero voltage processor sleep state|
|US8726048||Jun 21, 2011||May 13, 2014||Intel Corporation||Power management coordination in multi-core processors|
|US8911193||Nov 28, 2011||Dec 16, 2014||Applied Materials, Inc.||Substrate processing sequence in a cartesian robot cluster tool|
|US9081575||Apr 16, 2014||Jul 14, 2015||Intel Corporation||Method and apparatus for a zero voltage processor sleep state|
|US9141180||Feb 25, 2015||Sep 22, 2015||Intel Corporation||Method and apparatus for a zero voltage processor sleep state|
|US9223389||Sep 25, 2014||Dec 29, 2015||Intel Corporation||Method and apparatus for a zero voltage processor|
|US9223390||Sep 25, 2014||Dec 29, 2015||Intel Corporation||Method and apparatus for a zero voltage processor|
|US9235258||Apr 16, 2014||Jan 12, 2016||Intel Corporation||Method and apparatus for a zero voltage processor|
|US9280513||Oct 2, 2012||Mar 8, 2016||Ovics||Matrix processor proxy systems and methods|
|US9442559||Mar 14, 2013||Sep 13, 2016||Intel Corporation||Exploiting process variation in a multicore processor|
|US20020056032 *||Nov 2, 2001||May 9, 2002||Madar Lawrence J.||Pipelined multi-access memory apparatus and method|
|US20030014736 *||Jul 15, 2002||Jan 16, 2003||Nguyen Tai H.||Debugger breakpoint management in a multicore DSP device having shared program memory|
|US20030018859 *||Feb 15, 2002||Jan 23, 2003||Smith Patrick J.||Arbitration in local system for access to memory in a distant subsystem|
|US20030120877 *||Sep 27, 2002||Jun 26, 2003||Jahnke Steven R.||Embedded symmetric multiprocessor system|
|US20050066079 *||Sep 18, 2003||Mar 24, 2005||International Business Machines Corporation||Multiple processor core device having shareable functional units for self-repairing capability|
|US20060168435 *||Jan 22, 2005||Jul 27, 2006||Mats Svensson||Operating-system-friendly bootloader|
|US20070157036 *||Dec 30, 2005||Jul 5, 2007||Intel Corporation||Method and apparatus for a zero voltage processor sleep state|
|US20080072088 *||Nov 8, 2007||Mar 20, 2008||Jose Allarey||Method and Apparatus for a Zero Voltage Processor Sleep State|
|US20090106544 *||Jun 17, 2008||Apr 23, 2009||Hon Hai Precision Industry Co., Ltd.||Function management system and method|
|US20100146311 *||Feb 16, 2010||Jun 10, 2010||Intel Corporation||Method and Apparatus for a Zero Voltage Processor Sleep State|
|US20110231681 *||Sep 22, 2011||Jose Allarey||Method and apparatus for a zero voltage processor sleep state|
|U.S. Classification||711/167, 710/305, 713/502, 709/212, 712/E09.07, 712/E09.055, 711/152|
|International Classification||G06F15/167, G06F15/16, G06F12/00, G06F15/78, G06F9/38|
|Cooperative Classification||G06F9/3891, Y02B60/1225, G06F9/3802, G06F9/3877, G06F9/3879, G06F15/786|
|European Classification||G06F9/38S, G06F9/38T6C, G06F9/38B, G06F9/38S1, G06F15/78P1S|
|Oct 24, 2001||AS||Assignment|
Owner name: TEXAS INSTRUMENTS INCORPORATED, TEXAS
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KELLY, KENNETH C.;GHAI, IRVINDERPAL S.;REIMER, JAY B.;AND OTHERS;REEL/FRAME:012360/0574;SIGNING DATES FROM 20001110 TO 20001115
|Jun 21, 2007||FPAY||Fee payment|
Year of fee payment: 4
|Jul 21, 2011||FPAY||Fee payment|
Year of fee payment: 8
|Jul 28, 2015||FPAY||Fee payment|
Year of fee payment: 12