WO2000052484A2 - Interface independent test system - Google Patents

Interface independent test system Download PDF

Info

Publication number
WO2000052484A2
WO2000052484A2 PCT/US2000/005444 US0005444W WO0052484A2 WO 2000052484 A2 WO2000052484 A2 WO 2000052484A2 US 0005444 W US0005444 W US 0005444W WO 0052484 A2 WO0052484 A2 WO 0052484A2
Authority
WO
WIPO (PCT)
Prior art keywords
transaction
class
test
interface independent
classes
Prior art date
Application number
PCT/US2000/005444
Other languages
French (fr)
Other versions
WO2000052484A3 (en
Inventor
Glenn A. Dearth
George R. Plouffe, Jr.
David M. Kaffine
Janet Y. Zheng
Original Assignee
Sun Microsystems, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sun Microsystems, Inc. filed Critical Sun Microsystems, Inc.
Priority to EP00915989A priority Critical patent/EP1171774A2/en
Priority to AU37165/00A priority patent/AU3716500A/en
Publication of WO2000052484A2 publication Critical patent/WO2000052484A2/en
Publication of WO2000052484A3 publication Critical patent/WO2000052484A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/30Circuit design
    • G06F30/32Circuit design at the digital level
    • G06F30/33Design verification, e.g. functional simulation or model checking

Definitions

  • the present invention relates generally to computer systems and more particularly to methods and apparatus for facilitating the testing and verification of integrated circuit designs using simulation tools.
  • HDL hardware description language
  • the design engineers use an HDL to generate a detailed functional description of the circuitry including, for example, the input signals to be provided to the circuitry and the output signals which are produced in response thereto.
  • the description of the circuitry may comprise descriptions of sub-components or "cells" and the interrelationships between these components.
  • the resulting model can be used to simulate the behavior of the circuitry.
  • the HDL model of the circuitry is implemented in a simulation system to verify the proper functioning of the circuitry.
  • the simulation system may comprise any one of a number of such systems, one example being the Verilog system, which is well known to those in the art. "Verilog” also refers to a particular HDL.
  • the simulation system accepts data which defines the behavior of the circuitry as well as the signals to be input to the circuitry and, in response, generates data corresponding to simulated output signals.
  • HDL High-Demand Language
  • ASICs Application-Specific Integrated Circuits
  • HDL is used to form a detailed functional description of circuitry such as ASICs (Application-Specific Integrated Circuits)
  • ASICs Application-Specific Integrated Circuits
  • verification of functionality at the gate level is often insufficient because of the difficulty of observing the internal state of the circuitry at its I/O interface.
  • generating a set of tests for this circuitry can be a daunting task since HDL does not have many of the features which are found in higher-level languages and which make it easier for programmers to handle large software projects. It is therefore desirable to have an interface mechanism which allows tests written in higher-level languages to control a simulation written in HDL.
  • test procedure for each of the different interfaces.
  • Each of these test procedures is given the same name, but is compiled separately and is saved in a separate library module.
  • the test writer must be able to identify and select the appropriate library from the multiple copies which must be maintained for the different interfaces. Even if the number of libraries is small, a mistake in choosing the correct library will introduce errors which may be difficult to identify and time- consuming to correct. This approach is also somewhat inconvenient because it is difficult to dynamically change the interface or to allow the use of several interfaces within the same test.
  • Interface independent tests could be written once to verify a particular sub-chip level functionality and then reused to test this functionality in the integrated ASIC. Although some tests (e.g. tests of the interface itself) cannot be written in an interface independent manner, many tests can be written this way. A generalized technique for writing interface independent tests would therefore be very beneficial and could provide considerable savings in the time required to test an ASIC. It would be useful to develop a class structure which would allow test writers to develop test code which is portable between several different ASIC interfaces without having to make substantial changes to the code.
  • CVI interface system which allow tests to be written in high-level languages such as C and C++ instead of writing the entire simulation/test system in HDL.
  • One such interface system is called CVI.
  • the basis for CVI is described in U.S. Patent No. 5,732,247 to Dearth, et al.
  • CVI serves as an interface between a Verilog HDL simulation system and test system which is written in C++.
  • CVI translates the C++ test statements into simulated bus activity in the simulation system.
  • CVI is particularly useful in the development of simulation systems because the verification engineers who write the test procedures normally are not the same engineers who write the functional description of the new circuitry.
  • the CVI mechanism allows the design of device objects which present a low-level register interface to the test writer. This is useful because it presents the test writer with a consistent interface style shared by all transactors and provides a consistent documentation format.
  • Transactor refers to a mechanism for executing a transaction, such as an implementation of a class or object as described in more detail below.
  • the low-level register interface is also intuitively appealing because the register model mimics modern computer system operation and is well understood by programmers.
  • the CVI mechanism introduces a device driver abstraction which shields users from the low-level details of complex circuitry. This level of abstraction again provides test writers with a consistent view of many similar devices.
  • the device drivers in the simulation system maintain state information regarding the devices in order to simplify control and scheduling of the operations of the device.
  • One embodiment of the invention comprises a simulation system configured to model a circuit design and a test system configured to operate in cooperation with the simulation system.
  • the systems comprise one or more software applications which may be stored on computer-readable media such as magnetic disks or tape, and which may be executed on a suitable computer system.
  • a mechanism is provided to facilitate testing of both prototyped and finalized circuitry designs in a device simulation environment.
  • the mechanism is implemented in a test system written in a high-level programming language.
  • the test system is used in conjunction with a simulation system, which is written in an HDL, and a simulation system interface.
  • the mechanism simplifies test writing by performing a function similar to that of an operating system device driver and abstracting away details of the device's operation which are needed by the test writer.
  • the mechanism allows portions of the circuit design to be prototyped and later replaced with finalized designs, while at the same time allowing most of the test code to be retained.
  • the mechanism may provide consistent high-level interfaces to device objects, device object information hiding, simplification of random environment testing, effective parallel operation without threading, state driven test writing style, encapsulation/aggregation of convenience routines, simplification of device object configuration management and storage of parameters for convenience routines in class member variables.
  • One embodiment of the invention comprises a hierarchical set of transaction classes.
  • the uppermost class defines a base transaction. All transaction classes inherit from this class.
  • Below the base transaction class are a device transaction class, an interface independent device transaction class and a system transaction class.
  • the device transaction class is associated with a device through an object reference.
  • the interface independent device transaction class is associated with a device transaction class through a subclass of the interface independent device transaction class which contains a pointer to the device transaction class.
  • the system transaction class is used to collect convenience routines.
  • the system transaction class contains pointers to each of the required device transaction classes or interface independent device transaction classes.
  • the next level in the hierarchy includes one or more configuration transaction classes which reference selected device objects.
  • the system transaction class provides an infrastructure upon which the test writer can build the test code.
  • the system transaction class contains pointers to device transactions for all of the devices in the simulated system and aggregates the convenience routines which may be useful in writing the tests.
  • the system transaction class contains pointers to interface independent device transaction classes for those devices which may be subject to design changes.
  • the system transaction class is not instantiated directly, but is instead used as the basis for the configuration transaction classes.
  • Each configuration transaction class represents a selected subset of the devices in the simulated system and is instantiated to test transactions involving the corresponding devices. Because the configuration transaction classes use object references to the device objects, the user is forced to supply the appropriate device objects at the time of instantiation and the compiler is therefore able to perform static type checking.
  • the configuration transaction classes thus enable the test writer to use all of the convenience routines defined in the system transaction class while only instantiating those device objects which are needed for the corresponding configuration. At the same time, the test writer can more easily maintain the test code because all of the convenience routines are written only once and collected in the system transaction class.
  • the system transaction class contains pointers to the interface independent device transaction classes. Because the devices are accessed through the interface independent device transaction classes, the test code is presented with a common interface to the devices.
  • the subclasses derived from an interface independent device transaction class allow the tests to interface with the different configurations of a particular device. The same test code can therefore be used for the different device configurations.
  • Fig. 1 is a functional diagram of a simple simulation system in one embodiment of the invention.
  • Fig. 2 is a block diagram of a design verification system in one embodiment of the invention.
  • Fig. 3 is a diagram of a class structure implemented in a test subsystem in one embodiment of the invention.
  • Fig. 4 is a block diagram illustrating the replacement of a first functional model and the corresponding device and transaction classes with another design and its corresponding classes in one embodiment of the invention.
  • a set of transaction classes is implemented in the test subsystem of a circuit design verification system.
  • the test system comprises one or more tests written in a high-level language.
  • the high-level language is C++.
  • a different high-level language can be used.
  • the test system is used in conjunction with a simulation system which is written in a lower-level language such as the Verilog HDL.
  • the test system and the simulation system are coupled by an interface such as CVI.
  • different HDL's and interface systems can be used.
  • the transaction classes provide a mechanism through which a programmer can easily test selected functions in a circuit design.
  • the classes form a hierarchy, the top of which is a base transaction class.
  • the base transaction class contains several virtual functions which are used to initialize device objects and enable the device objects to handle signals and drive transactions during testing.
  • a device transaction class is derived from the base transaction class and is used to provide a level of abstraction between the test writer and the device objects.
  • a system transaction class is derived from the base transaction class and is used to provide an abstracted model of the circuit design under test.
  • the system transaction class contains pointers to device transaction classes corresponding to device objects in the design under test.
  • a configuration transaction class is derived from the system transaction class and is used to configure and test selected portions of the circuit design model.
  • Both the device transaction class and the configuration transaction class contain references to device objects and, in fact, the configuration transaction class sets up device transactions for device objects to be used for executing tests.
  • the embodiment described here refers to a structure of interrelated classes, the invention contemplates a structure of interrelated objects as well.
  • objects are instantiations of classes. The distinction between classes and objects may therefore be viewed as one of code implementation versus memory implementation, or of source code versus executable code. Persons skilled in the art will appreciate these distinctions as well as the fact that the invention need not be limited to one or the other. Accordingly, the references herein to classes are intended to encompass objects which are instantiated from the classes. Likewise, references to objects are, for the purposes of this description, intended to encompass the classes from which they are instantiated.
  • the design verification system is designed to be implemented in a general-purpose computer system.
  • the design verification system comprises a set of software applications which model the functions of a circuit design and perform a series of tests to verify these functions. It should be noted that, in alternate embodiments, one or more parts of the system can be implemented in hardware designed specifically for that purpose.
  • the design verification system includes a test subsystem, a hardware simulation system and an interface subsystem.
  • the hardware simulation system is a software application which includes functional descriptions of the hardware to be simulated, including the newly designed circuitry.
  • the hardware simulation system is used to model the operation of the hardware.
  • the simulation system is typically written in a computer language specifically designed for that purpose (i.e., an HDL). In this instance, the simulation system is written in Verilog.
  • the hardware simulation system includes a number of functional models representative of portions of the system being modeled. These functional models will be referred to herein as bus functional models, although it should be noted that the portions of the system being modeled may comprise items other than buses.
  • the simulation system includes a functional model of the newly designed circuitry (i.e. the design under test, or device under test).
  • the simulation system 10 includes a simulation core 18 and a hardware functional model 20.
  • the hardware functional model 20 includes a host bus functional model 12 and an I/O bus functional model 16 which represent the behavior of the model's interfaces.
  • the functional model of the design under test 14 is inserted into the system and is operatively coupled to the host and I/O bus functional models 12 and 16, just as the hardware device would be coupled to the hardware buses.
  • the host bus functional model 12 would provide a signal as a stimulus to the design under test 14, which would then respond to this stimulus.
  • the stimulus consists of a set of signals which may correspond to a function call or some other command to the design under test.
  • the design under test 14 may in turn convey one or more signals to the I/O bus functional model 16.
  • the I/O bus functional model 16 would then convey a responsive signal to the design under test 14, which would subsequently convey a signal to the host bus functional model 12 so that the proper operation of the system could be verified for the corresponding function.
  • a portion of the bus functional models and the design under test are written in HDL. These functional models interact on a chip I/O level. That is, the models operate on individual bits or signals in the same way the physical devices which they represent operate on individual bits or signals which are input to the respective devices.
  • the models and the corresponding designs can therefore be examined with a very high level of detail. This level of detail, however, is very difficult to work with when a programmer is interested in testing the high level operations of the devices. For example, if the programmer wants to test a simple function, such as copying a file from one location to another, the number of signals which need to be controlled at the device I/O level may be very high. The programmer therefore needs a mechanism by which he can use a simple command or set of commands to achieve this function instead of individually programming each bit signal. In other words, a level of abstraction is necessary to simplify the programmer's task.
  • the interface subsystem translates test commands in a high-level language (e.g., C or C++) to the appropriate chip I/O level signals in HDL.
  • a high-level language e.g., C or C++
  • the test system can therefore take advantage of features such as object-oriented programming constructs, which are available in the high-level language, but not in the HDL.
  • CVI described above
  • Fig. 2 a block diagram of the design verification system, test subsystem 32, interface subsystem system 34 and hardware simulation subsystem 36 execute within the environment of operating system 38.
  • the interface subsystem system 34 controls the interaction between the HDL based hardware simulation subsystem 36 and the C++ based test subsystem 32.
  • the interface subsystem allows tests to be written using an object-oriented paradigm and provides the programmer with device objects which translate the tests into HDL bus signals.
  • test subsystem adds a first level of abstraction between the test writer and the HDL test environment
  • object-oriented programming principles in the test system allows additional levels of abstraction to be obtained within the test subsystem. For example, system level transactions may be defined to generate activity in several devices in response to a single system level function call.
  • Object-oriented principles also provide benefits to the programmer such as the ability to re-use code and to hide data from the test subsystem writer.
  • the test subsystem controls each of the device functional objects in the simulated hardware system in order to verify the functionality of the design.
  • the test subsystem utilizes device transaction objects to abstract away some of the details of the device operation.
  • Configuration transaction objects likewise abstract away some of the details of transactions involving more than one functional device.
  • the configuration transaction objects are derived from a system transaction class in order to group together convenience routines and make them available to the configuration transactions. Convenience routines are functions that simplify the process of managing test data and control sequences.
  • the system transaction class also collects test flow control routines for use in simulation of the configuration transactions.
  • the system transaction class contains pointers to interface independent device transaction classes, and operations on device objects are performed through these pointers to maintain a consistent test interface.
  • the interface independent device transaction classes are subclassed to map the transactions to the particular device designs currently used by the simulated hardware system.
  • the interface independent device transaction subclasses are created as needed by the configuration transaction objects, and the interface independent device transaction subclasses in turn create the corresponding design-specific device transaction classes. This provides a simple, reliable and consistent means for setting up the interrelated objects and classes. Referring to Fig. 3, a diagram of a class structure used in one embodiment of the test system is shown.
  • Object references in the figure are indicated by an arrow with an accompanying ampersand (&).
  • Pointers are indicated by an arrow with an accompanying asterisk (*).
  • One-to-one relationships between objects and/or classes in the figure are indicated by an open circle at the head of the corresponding pointer or object reference arrow.
  • a blackened circle indicates that there may be one or more pointers or object references.
  • the dashed lines from the configuration transaction classes and interface independent device transaction classes to the device transaction classes indicate that the latter are created in the process of instantiating the former.
  • Fig. 3 shows a hierarchical class structure which has a base transaction class 40 at the top of the class hierarchy.
  • Base transaction class 40 is an abstract class which is not directly instantiated. Instead, base transaction class 40 serves to provide a set of basic services which are common to all of the transactions. The services are provided through methods or functions which are declared in the base transaction class and are inherited by the classes which will be derived therefrom.
  • base transaction class 40 includes several virtual functions which are common to all of the transaction classes in the hierarchy.
  • the use of a common set of interface function names is necessary to take advantage of polymorphism, which is a useful feature of object-oriented programming languages.
  • Polymorphism allows the programmer to create transaction objects and work with these objects in an abstract way while deferring to run time that task of figuring out which device is actually being used. Polymorphism provides several other advantages, including providing consistent high-level interfaces to similar objects, hiding from the programmer object information which he doesn't need to see and simplifying program code by encapsulating object-specific variations within the objects themselves.
  • the functions declared by base transaction class 40 include the following: init(); setup_trans(); setup_resp(); and service_signal().
  • Init() initializes the device associated with the transaction class.
  • Setup_trans() enables the associated device to drive transactions in the simulation.
  • Setup_resp() controls how the associated device responds to transactions directed to it.
  • Service_signal() is called to handle CVI signal messages sent from the HDL to the device.
  • a base device class (not shown in the figure) is used in the same manner as the base transaction class.
  • One or more sub-classes can be derived from the base device class.
  • the sub-classes inherit a common set of methods from the base device class and may define additional methods which are specific to the sub-classes.
  • the base device class and its sub-classes enable the instantiation of the device objects which are shown in the figure. Through inheritance, the base device class provides a common interface to all of the bus functional models in the hardware simulation system.
  • Device transaction class 44 is derived from base transaction class 40. Device transaction class 44 therefore inherits the four methods listed above from base transaction class 40.
  • the methods declared in base transaction class 40 are virtual methods. That is, they are declared, but the implementation of each of the methods is not defined. It is left to the device transaction classes (e.g., device transaction class 44) to provide the program code which implements each of the methods.
  • Device transaction class 44 becomes associated with a single device object 42 through an object reference.
  • Device transaction class 44 controls the transactions which device 42 executes. Because an object reference must always be satisfied, the use of an object reference to associate device 42 with device transaction class 44 forces the user to supply a device object when the device transaction class is instantiated. By forcing the user to supply the device object at instantiation, the possibility of changing the pointer or using a NULL pointer is eliminated and the compiler is allowed to perform static type checking. These properties make the object reference inherently safer to use than a standard C pointer. They add some complexity to the system, however, which will be discussed in more detail below.
  • Device transaction class 44 serves to hide the low-level details of the operation of device 42 from the test writer and thereby simplifies the communications between the test subsystem and the bus functional models of the hardware simulation subsystem. Device transaction class 44 also serves to maintain the state of device 42 between invocations of transactions involving the device.
  • the test writer can set up high-level transaction information such as data, address, size and mode in the transaction class and then call a function such as setup_trans() to translate this information into individual register operations at the device level. Therefore, the test writer does not need to know which specific register operations are involved in performing a particular function call.
  • Device transaction class 44 thus acts in a manner similar to that of a device driver while also enabling the compiler to perform static type checking.
  • device transaction class 44 allows the test writer to define convenience methods associated with the device or device transaction. The test writer is free to define these test methods and any necessary instance variables, both of which may be encapsulated into the device transaction class.
  • a test writer may want to develop convenience routines for transactions involving several devices. These convenience routines may manipulate data, affect the control flow of the simulation (e.g., advance the simulation time) or perform some other function.
  • the convenience routines must, of course, be defined so that they have access to the appropriate devices.
  • the test writer might therefore create a system transaction class in which all of these convenience routines are defined. This would provide a grouping of common routines and would therefore potentially achieve the best re-use of program code, but might cause problems in terms of the desired use of object references.
  • the system transaction classes should use object references.
  • object references require that the associated device object be provided when the system transaction class and the object reference are instantiated. If the system transaction class contains convenience routines relating to all the devices in the design under test, any test which uses this system transaction class (i.e. any of the convenience routines in the class) must instantiate every device referenced in the class (i.e. all of the devices.) This would limit the performance of the system because tests would automatically reserve devices which would never be used for those tests. The unnecessary reservation of devices would also make it very difficult for tests to share device objects.
  • Another approach which might be taken by a test writer would be to define a configuration transaction class for every possible system configuration. In other words, a separate configuration transaction class would be written for each combination of devices which might be tested. Using this approach, only those devices which are involved in a transaction are instantiated for each test configuration. There is no unnecessary reservation of devices which are not used. The improved efficiency in the instantiation of device objects, however, is obtained at the expense of the efficient re-use of program code. Many of the configurations defined by the test writer would probably need very similar [access and] convenience routines, but these routines could not be collected in a single transaction class. Instead, the test writer would have to reproduce the code for particular routines in each of the transaction classes which uses the respective routines.
  • system transaction class 46 is created as a subclass of base transaction class 40.
  • System transaction class 46 is a collector of all the convenience routines which may be needed by the test writer. Because system transaction class 46 uses pointers to device objects instead of object references, it is not necessary to instantiate each device in the system for every test. The instantiation of device objects is left to the configuration transaction classes.
  • the system transaction class 46 is sub-classed to create one or more configuration transaction classes 47, 48.
  • the configuration transaction classes contain object references to each of the device objects which are involved in a transaction of the respective configuration.
  • Configuration transaction classes 47, 48 are used to create the required device transaction classes (e.g., by including a method to create the device transaction classes in the constructors of the respective configuration transaction classes.)
  • the device object references passed to the configuration transaction classes are used to set the device transaction class pointers inherited from the system transaction class, so the system transaction class' use of pointers is acceptable from a type checking perspective. This also prevents needless instantiation of devices in the system which are not used for a particular test.
  • the configuration transaction classes inherit all of the convenience routines from the system transaction class, so the programmer does not have to rewrite or copy the routines into each of the configuration transaction classes. This reduces the workload of the programmer and greatly increases the maintainability of the program code.
  • the class structure of Fig. 3 also includes an interface independent device transaction class 50 which is subclassed from base transaction class 40.
  • system transaction class 46 includes one or more pointers to interface independent device transaction classes 50. All operations on interface independent devices (i.e., those which have designs subject to change) are performed through the pointers to the corresponding interface independent device transaction classes.
  • Interface independent device transaction class 50 presents a consistent interface to the device, regardless of the current state of the device's design. That is, the interface provided by this class remains the same whether the device design is in its final form or is simply a prototype design.
  • Interface independent device transaction class 50 defines common interface routines and meta parameters which are used by the test code.
  • the test writer is responsible for initializing the meta parameters and calling the common routines via the pointer to the interface independent device transaction class. Differences between designs in default parameters or routine implementations are hidden within the subclasses. Because the test code operates on interface independent device transaction class 50, the test code need not be changed (or may require only minimal changes, as explained below) to accommodate changes in the design of the device. Changes in the device design are accommodated by the use of subclasses 52, 54 from interface independent device transaction class 50.
  • Classes 50 and 52/54 may be considered first-level and second-level interface independent transaction classes, respectively.
  • These classes inherit the interface routines and meta parameters from interface independent device transaction class 50 which is used by the test code.
  • Classes 52 and 54 are each configured to be used with a single design of a particular device and provide mapping (in conjunction with the respective device transaction classes and device objects) from the interface of interface independent device transaction class 50 to that device design. As shown in Fig. 3, each of these classes is configured for use with a different design of a single device for which interface independent device transaction class 50 provides an interface. As indicated by the dashed line in Fig.
  • an interface independent device transaction subclass (e.g., 52) corresponding to a device which is subject to design changes is created by a configuration transaction class (e.g., 48) for a configuration which uses that device.
  • a configuration transaction class e.g. 48
  • configuration transaction class 48 may include the create() method in its constructor, or this method may be explicitly called.
  • the interface independent device transaction subclass in turn creates the appropriate device transaction class in the same manner.
  • the interface independent device transaction classes provide a means by which test code 60 can be written for a design which includes a prototype device 63 and then be reused without substantial alteration when the prototype device 63 is replaced with a subsequent design 68.
  • Test code 60 incorporates the interface independent device transaction class from which classes 61 and 66 are derived.
  • the only code changes which need to be made as a result of the design change are confined to those classes 61, 62 derived from the interface independent device transaction class. These are simply replaced with classes 66, 67corresponding to the new design 68.
  • CVI uses an interrupt driven model for the test environment.
  • An interrupt driven model allows the test to retain very tight control over execution in the simulation subsystem.
  • the use of an interrupt driven model may, however, create difficulties for a test writer because he or she must be prepared to receive any type of interrupt at any point in the simulation — the test subsystem cannot only handle those types of interrupts which are of interest to the test writer.
  • the use of the class hierarchy shown in Fig. 3 simplifies the program code required to implement an interrupt driven model and reduces the burden on the test writer by enabling a state driven style of test writing.
  • the control flow of the tests are tied to a state sequencer (i.e., finite state machine, or FSM) in a manner resembling a hardware design style.
  • the state sequencer may be defined in the base transaction class or in the system transaction class.
  • the purpose of the state sequencer is to handle signals directed to the device based on the current state of the sequencer. This generally improves the readability of threads in the test subsystem because state information which is usually embedded in the program code is removed. This state information is moved into the device transaction class and stored in a format suitable for the state sequencer.
  • the program code of the test subsystem can therefore be written as a simple stimulus generator. This greatly reduces the complexity of the code.
  • the state driven style of test writing may also simplify the writing of convenience routines. Using other styles of test writing, it may be necessary to include code in convenience methods which returns control to the simulation subsystem. In a state driven style, routines can return control to the simulation subsystem at a high level, allowing parallel operation without the need for multi-threading. This is a great benefit in a random testing environment.

Abstract

A system and method for circuitry design verification testing using a structure of interface independent classes to provide for rapid prototyping and design modification while maximizing test code re-use. A circuit simulation subsystem is interfaced with a test subsystem. The test subsystem employs a system transaction class for collecting common routines and pointers to device transactions. One or more configuration transaction classes derived from the system transaction class define transactions between functional models within the simulation subsystem and cause instantiation of the respective functional models. Operations are performed on the functional models via pointers to interface independent transaction classes which define interfaces to the devices. The operations are mapped to the current designs of the functional models by subclasses of the interface independent transaction classes. Changes to the functional model designs necessitate changes to the subclasses, but the interface independent transaction classes maintain a consistent interface and allow the test code to be re-used with minimal changes.

Description

TITLE: INTERFACE INDEPENDENT TEST SYSTEM
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates generally to computer systems and more particularly to methods and apparatus for facilitating the testing and verification of integrated circuit designs using simulation tools.
2. Description of the Relevant Art
Because of the complexity of the circuitry in modern integrated circuits (ICs), the design of the circuitry is thoroughly tested before the actual circuit is manufactured. The testing is intended to identify errors in the design of the circuitry so that the errors can be corrected with minimal effort and expense. Typically, this testing is accomplished by simulating the functioning of the circuitry on a computer system using a hardware description language. (References herein to "HDL" will indicate a hardware reference language which may be Verilog or any other hardware description language.) The design engineers use an HDL to generate a detailed functional description of the circuitry including, for example, the input signals to be provided to the circuitry and the output signals which are produced in response thereto. The description of the circuitry may comprise descriptions of sub-components or "cells" and the interrelationships between these components. The resulting model can be used to simulate the behavior of the circuitry.
The HDL model of the circuitry is implemented in a simulation system to verify the proper functioning of the circuitry. The simulation system may comprise any one of a number of such systems, one example being the Verilog system, which is well known to those in the art. "Verilog" also refers to a particular HDL. The simulation system accepts data which defines the behavior of the circuitry as well as the signals to be input to the circuitry and, in response, generates data corresponding to simulated output signals.
Traditionally, the entire simulation system, including the functional description of the newly designed circuitry, has been written in HDL. Because HDL is used to form a detailed functional description of circuitry such as ASICs (Application-Specific Integrated Circuits), it is by nature a specialized and complex language. With the increasing complexity of these circuits, verification of functionality at the gate level is often insufficient because of the difficulty of observing the internal state of the circuitry at its I/O interface. Further, generating a set of tests for this circuitry can be a daunting task since HDL does not have many of the features which are found in higher-level languages and which make it easier for programmers to handle large software projects. It is therefore desirable to have an interface mechanism which allows tests written in higher-level languages to control a simulation written in HDL. In addition to the testing difficulties resulting from the increased complexity of current ASICs, difficulties may arise from circuit designers' attempts to leverage intellectual property rights by integrating proprietary cores into their ASICs. These proprietary cores may themselves be very complex. Consequently, their operation generally needs to be verified in a stand-alone environment. Tests for these ASICs are therefore normally written specifically for the proprietary core in a stand-alone configuration. Usually, the tests are dependent upon the specific interface through which the core is driven during test. As a result, the tests cannot be reused once the proprietary core has been integrated into a larger ASIC. New tests must therefore be written to verify the operation of the integrated proprietary core, reducing the amount of time saved by using the already designed core.
Typically, the requirement of testing a proprietary core using several different interfaces is addressed by writing a different test procedure for each of the different interfaces. Each of these test procedures is given the same name, but is compiled separately and is saved in a separate library module. When a test application is linked, it is linked with the library module corresponding to the desired interface. This is, however, an awkward and error-prone process. The test writer must be able to identify and select the appropriate library from the multiple copies which must be maintained for the different interfaces. Even if the number of libraries is small, a mistake in choosing the correct library will introduce errors which may be difficult to identify and time- consuming to correct. This approach is also somewhat inconvenient because it is difficult to dynamically change the interface or to allow the use of several interfaces within the same test.
It would be helpful to be able to resolve this problem at compile time. One approach would be to use preprocessor directives to select the appropriate interface when the test application is compiled. Another approach would be to use function pointers to select the tests appropriate to a particular interface. Both of these approaches, however, are prone to error and result in code which is difficult to maintain.
It would be useful to be able to write tests in a manner which is independent of the interface to the circuit and which do not rely on the approaches suggested above. Interface independent tests could be written once to verify a particular sub-chip level functionality and then reused to test this functionality in the integrated ASIC. Although some tests (e.g. tests of the interface itself) cannot be written in an interface independent manner, many tests can be written this way. A generalized technique for writing interface independent tests would therefore be very beneficial and could provide considerable savings in the time required to test an ASIC. It would be useful to develop a class structure which would allow test writers to develop test code which is portable between several different ASIC interfaces without having to make substantial changes to the code. Some of the problems facing test writers have been alleviated by the development of interface systems which allow tests to be written in high-level languages such as C and C++ instead of writing the entire simulation/test system in HDL. One such interface system is called CVI. The basis for CVI is described in U.S. Patent No. 5,732,247 to Dearth, et al. CVI serves as an interface between a Verilog HDL simulation system and test system which is written in C++. CVI translates the C++ test statements into simulated bus activity in the simulation system. CVI is particularly useful in the development of simulation systems because the verification engineers who write the test procedures normally are not the same engineers who write the functional description of the new circuitry.
One important aspect of the CVI mechanism is that it allows the design of device objects which present a low-level register interface to the test writer. This is useful because it presents the test writer with a consistent interface style shared by all transactors and provides a consistent documentation format. ("Transactor" as used herein refers to a mechanism for executing a transaction, such as an implementation of a class or object as described in more detail below.) The low-level register interface is also intuitively appealing because the register model mimics modern computer system operation and is well understood by programmers. The CVI mechanism introduces a device driver abstraction which shields users from the low-level details of complex circuitry. This level of abstraction again provides test writers with a consistent view of many similar devices.
The device drivers in the simulation system maintain state information regarding the devices in order to simplify control and scheduling of the operations of the device.
SUMMARY OF THE INVENTION
The issues surrounding the abstractions outlined above may be solved by various embodiments of the system and method of the present invention. One embodiment of the invention comprises a simulation system configured to model a circuit design and a test system configured to operate in cooperation with the simulation system. The systems comprise one or more software applications which may be stored on computer-readable media such as magnetic disks or tape, and which may be executed on a suitable computer system.
In one embodiment, a mechanism is provided to facilitate testing of both prototyped and finalized circuitry designs in a device simulation environment. The mechanism is implemented in a test system written in a high-level programming language. The test system is used in conjunction with a simulation system, which is written in an HDL, and a simulation system interface. The mechanism simplifies test writing by performing a function similar to that of an operating system device driver and abstracting away details of the device's operation which are needed by the test writer. The mechanism allows portions of the circuit design to be prototyped and later replaced with finalized designs, while at the same time allowing most of the test code to be retained. The mechanism may provide consistent high-level interfaces to device objects, device object information hiding, simplification of random environment testing, effective parallel operation without threading, state driven test writing style, encapsulation/aggregation of convenience routines, simplification of device object configuration management and storage of parameters for convenience routines in class member variables.
One embodiment of the invention comprises a hierarchical set of transaction classes. The uppermost class defines a base transaction. All transaction classes inherit from this class. Below the base transaction class are a device transaction class, an interface independent device transaction class and a system transaction class. The device transaction class is associated with a device through an object reference. The interface independent device transaction class is associated with a device transaction class through a subclass of the interface independent device transaction class which contains a pointer to the device transaction class. The system transaction class is used to collect convenience routines. The system transaction class contains pointers to each of the required device transaction classes or interface independent device transaction classes. The next level in the hierarchy includes one or more configuration transaction classes which reference selected device objects. The system transaction class provides an infrastructure upon which the test writer can build the test code. The system transaction class contains pointers to device transactions for all of the devices in the simulated system and aggregates the convenience routines which may be useful in writing the tests. The system transaction class contains pointers to interface independent device transaction classes for those devices which may be subject to design changes. The system transaction class is not instantiated directly, but is instead used as the basis for the configuration transaction classes. Each configuration transaction class represents a selected subset of the devices in the simulated system and is instantiated to test transactions involving the corresponding devices. Because the configuration transaction classes use object references to the device objects, the user is forced to supply the appropriate device objects at the time of instantiation and the compiler is therefore able to perform static type checking. The configuration transaction classes thus enable the test writer to use all of the convenience routines defined in the system transaction class while only instantiating those device objects which are needed for the corresponding configuration. At the same time, the test writer can more easily maintain the test code because all of the convenience routines are written only once and collected in the system transaction class.
The system transaction class contains pointers to the interface independent device transaction classes. Because the devices are accessed through the interface independent device transaction classes, the test code is presented with a common interface to the devices. The subclasses derived from an interface independent device transaction class allow the tests to interface with the different configurations of a particular device. The same test code can therefore be used for the different device configurations.
BRIEF DESCRIPTION OF THE DRAWINGS
Other objects and advantages of the invention will become apparent upon reading the following detailed description and upon reference to the accompanying drawings in which:
Fig. 1 is a functional diagram of a simple simulation system in one embodiment of the invention. Fig. 2 is a block diagram of a design verification system in one embodiment of the invention. Fig. 3 is a diagram of a class structure implemented in a test subsystem in one embodiment of the invention. Fig. 4 is a block diagram illustrating the replacement of a first functional model and the corresponding device and transaction classes with another design and its corresponding classes in one embodiment of the invention.
While the invention is subject to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the drawing and detailed description thereto are not intended to limit the invention to the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents and alternatives falling within the spirit and scope of the present invention as defined by the appended claims.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the invention is described below. In this embodiment, a set of transaction classes is implemented in the test subsystem of a circuit design verification system. The test system comprises one or more tests written in a high-level language. In this instance, the high-level language is C++. In other embodiments, a different high-level language can be used. The test system is used in conjunction with a simulation system which is written in a lower-level language such as the Verilog HDL. The test system and the simulation system are coupled by an interface such as CVI. In other embodiments, different HDL's and interface systems can be used.
The transaction classes provide a mechanism through which a programmer can easily test selected functions in a circuit design. The classes form a hierarchy, the top of which is a base transaction class. The base transaction class contains several virtual functions which are used to initialize device objects and enable the device objects to handle signals and drive transactions during testing. A device transaction class is derived from the base transaction class and is used to provide a level of abstraction between the test writer and the device objects. A system transaction class is derived from the base transaction class and is used to provide an abstracted model of the circuit design under test. The system transaction class contains pointers to device transaction classes corresponding to device objects in the design under test. A configuration transaction class is derived from the system transaction class and is used to configure and test selected portions of the circuit design model. Both the device transaction class and the configuration transaction class contain references to device objects and, in fact, the configuration transaction class sets up device transactions for device objects to be used for executing tests. It should be noted that, while the embodiment described here refers to a structure of interrelated classes, the invention contemplates a structure of interrelated objects as well. As will be appreciated by persons skilled in the art of the invention, objects are instantiations of classes. The distinction between classes and objects may therefore be viewed as one of code implementation versus memory implementation, or of source code versus executable code. Persons skilled in the art will appreciate these distinctions as well as the fact that the invention need not be limited to one or the other. Accordingly, the references herein to classes are intended to encompass objects which are instantiated from the classes. Likewise, references to objects are, for the purposes of this description, intended to encompass the classes from which they are instantiated.
The design verification system is designed to be implemented in a general-purpose computer system. The design verification system comprises a set of software applications which model the functions of a circuit design and perform a series of tests to verify these functions. It should be noted that, in alternate embodiments, one or more parts of the system can be implemented in hardware designed specifically for that purpose. The design verification system includes a test subsystem, a hardware simulation system and an interface subsystem. The hardware simulation system is a software application which includes functional descriptions of the hardware to be simulated, including the newly designed circuitry. The hardware simulation system is used to model the operation of the hardware. The simulation system is typically written in a computer language specifically designed for that purpose (i.e., an HDL). In this instance, the simulation system is written in Verilog.
The hardware simulation system includes a number of functional models representative of portions of the system being modeled. These functional models will be referred to herein as bus functional models, although it should be noted that the portions of the system being modeled may comprise items other than buses. In addition to the bus functional models, the simulation system includes a functional model of the newly designed circuitry (i.e. the design under test, or device under test).
Referring to Fig. 1, a functional diagram of a simple simulation system 10 is shown. The simulation system 10 includes a simulation core 18 and a hardware functional model 20. The hardware functional model 20 includes a host bus functional model 12 and an I/O bus functional model 16 which represent the behavior of the model's interfaces. The functional model of the design under test 14 is inserted into the system and is operatively coupled to the host and I/O bus functional models 12 and 16, just as the hardware device would be coupled to the hardware buses. In operation, the host bus functional model 12 would provide a signal as a stimulus to the design under test 14, which would then respond to this stimulus. The stimulus consists of a set of signals which may correspond to a function call or some other command to the design under test. The design under test 14 may in turn convey one or more signals to the I/O bus functional model 16. The I/O bus functional model 16 would then convey a responsive signal to the design under test 14, which would subsequently convey a signal to the host bus functional model 12 so that the proper operation of the system could be verified for the corresponding function.
A portion of the bus functional models and the design under test are written in HDL. These functional models interact on a chip I/O level. That is, the models operate on individual bits or signals in the same way the physical devices which they represent operate on individual bits or signals which are input to the respective devices. The models and the corresponding designs can therefore be examined with a very high level of detail. This level of detail, however, is very difficult to work with when a programmer is interested in testing the high level operations of the devices. For example, if the programmer wants to test a simple function, such as copying a file from one location to another, the number of signals which need to be controlled at the device I/O level may be very high. The programmer therefore needs a mechanism by which he can use a simple command or set of commands to achieve this function instead of individually programming each bit signal. In other words, a level of abstraction is necessary to simplify the programmer's task.
This level of abstraction is provided by the interface subsystem. The interface subsystem translates test commands in a high-level language (e.g., C or C++) to the appropriate chip I/O level signals in HDL. As a result, the programmer is able to write tests in the high-level language. The test system can therefore take advantage of features such as object-oriented programming constructs, which are available in the high-level language, but not in the HDL. In one embodiment, CVI (described above) is employed as the interface system. As shown in Fig. 2, a block diagram of the design verification system, test subsystem 32, interface subsystem system 34 and hardware simulation subsystem 36 execute within the environment of operating system 38. The interface subsystem system 34 controls the interaction between the HDL based hardware simulation subsystem 36 and the C++ based test subsystem 32. The interface subsystem allows tests to be written using an object-oriented paradigm and provides the programmer with device objects which translate the tests into HDL bus signals.
Just as the interface subsystem adds a first level of abstraction between the test writer and the HDL test environment, the use of object-oriented programming principles in the test system allows additional levels of abstraction to be obtained within the test subsystem. For example, system level transactions may be defined to generate activity in several devices in response to a single system level function call. Object-oriented principles also provide benefits to the programmer such as the ability to re-use code and to hide data from the test subsystem writer.
The test subsystem controls each of the device functional objects in the simulated hardware system in order to verify the functionality of the design. The test subsystem utilizes device transaction objects to abstract away some of the details of the device operation. Configuration transaction objects likewise abstract away some of the details of transactions involving more than one functional device. The configuration transaction objects are derived from a system transaction class in order to group together convenience routines and make them available to the configuration transactions. Convenience routines are functions that simplify the process of managing test data and control sequences. The system transaction class also collects test flow control routines for use in simulation of the configuration transactions.
The system transaction class contains pointers to interface independent device transaction classes, and operations on device objects are performed through these pointers to maintain a consistent test interface. The interface independent device transaction classes are subclassed to map the transactions to the particular device designs currently used by the simulated hardware system. The interface independent device transaction subclasses are created as needed by the configuration transaction objects, and the interface independent device transaction subclasses in turn create the corresponding design-specific device transaction classes. This provides a simple, reliable and consistent means for setting up the interrelated objects and classes. Referring to Fig. 3, a diagram of a class structure used in one embodiment of the test system is shown.
(In Fig. 3, a triangular shape on the line between the two classes indicates inheritance from the higher class.) Object references in the figure are indicated by an arrow with an accompanying ampersand (&). Pointers are indicated by an arrow with an accompanying asterisk (*). One-to-one relationships between objects and/or classes in the figure are indicated by an open circle at the head of the corresponding pointer or object reference arrow. A blackened circle indicates that there may be one or more pointers or object references. The dashed lines from the configuration transaction classes and interface independent device transaction classes to the device transaction classes indicate that the latter are created in the process of instantiating the former.
Fig. 3 shows a hierarchical class structure which has a base transaction class 40 at the top of the class hierarchy. Base transaction class 40 is an abstract class which is not directly instantiated. Instead, base transaction class 40 serves to provide a set of basic services which are common to all of the transactions. The services are provided through methods or functions which are declared in the base transaction class and are inherited by the classes which will be derived therefrom.
In this embodiment, base transaction class 40 includes several virtual functions which are common to all of the transaction classes in the hierarchy. The use of a common set of interface function names is necessary to take advantage of polymorphism, which is a useful feature of object-oriented programming languages.
Polymorphism allows the programmer to create transaction objects and work with these objects in an abstract way while deferring to run time that task of figuring out which device is actually being used. Polymorphism provides several other advantages, including providing consistent high-level interfaces to similar objects, hiding from the programmer object information which he doesn't need to see and simplifying program code by encapsulating object-specific variations within the objects themselves.
In this embodiment, the functions declared by base transaction class 40 include the following: init(); setup_trans(); setup_resp(); and service_signal(). Init() initializes the device associated with the transaction class. Setup_trans() enables the associated device to drive transactions in the simulation. Setup_resp() controls how the associated device responds to transactions directed to it. Service_signal() is called to handle CVI signal messages sent from the HDL to the device.
A base device class (not shown in the figure) is used in the same manner as the base transaction class. One or more sub-classes can be derived from the base device class. The sub-classes inherit a common set of methods from the base device class and may define additional methods which are specific to the sub-classes. The base device class and its sub-classes enable the instantiation of the device objects which are shown in the figure. Through inheritance, the base device class provides a common interface to all of the bus functional models in the hardware simulation system.
Device transaction class 44 is derived from base transaction class 40. Device transaction class 44 therefore inherits the four methods listed above from base transaction class 40. In this embodiment, the methods declared in base transaction class 40 are virtual methods. That is, they are declared, but the implementation of each of the methods is not defined. It is left to the device transaction classes (e.g., device transaction class 44) to provide the program code which implements each of the methods.
Device transaction class 44 becomes associated with a single device object 42 through an object reference. Device transaction class 44 controls the transactions which device 42 executes. Because an object reference must always be satisfied, the use of an object reference to associate device 42 with device transaction class 44 forces the user to supply a device object when the device transaction class is instantiated. By forcing the user to supply the device object at instantiation, the possibility of changing the pointer or using a NULL pointer is eliminated and the compiler is allowed to perform static type checking. These properties make the object reference inherently safer to use than a standard C pointer. They add some complexity to the system, however, which will be discussed in more detail below.
Device transaction class 44 serves to hide the low-level details of the operation of device 42 from the test writer and thereby simplifies the communications between the test subsystem and the bus functional models of the hardware simulation subsystem. Device transaction class 44 also serves to maintain the state of device 42 between invocations of transactions involving the device. The test writer can set up high-level transaction information such as data, address, size and mode in the transaction class and then call a function such as setup_trans() to translate this information into individual register operations at the device level. Therefore, the test writer does not need to know which specific register operations are involved in performing a particular function call. Device transaction class 44 thus acts in a manner similar to that of a device driver while also enabling the compiler to perform static type checking. In addition to enabling static type checking and providing a level of abstraction between device-level operations and the test writer, device transaction class 44 allows the test writer to define convenience methods associated with the device or device transaction. The test writer is free to define these test methods and any necessary instance variables, both of which may be encapsulated into the device transaction class.
Although the use of device classes and device transaction classes may considerably enhance the test writing environment, there remain some problems associated with multiple-device transactions which are not resolved simply by the use of these classes. For example, a test writer may want to develop convenience routines for transactions involving several devices. These convenience routines may manipulate data, affect the control flow of the simulation (e.g., advance the simulation time) or perform some other function. The convenience routines must, of course, be defined so that they have access to the appropriate devices. The test writer might therefore create a system transaction class in which all of these convenience routines are defined. This would provide a grouping of common routines and would therefore potentially achieve the best re-use of program code, but might cause problems in terms of the desired use of object references. Because the test writer wants to have static type checking and wants to avoid NULL pointers, as explained above, the system transaction classes should use object references. The use of object references, however, requires that the associated device object be provided when the system transaction class and the object reference are instantiated. If the system transaction class contains convenience routines relating to all the devices in the design under test, any test which uses this system transaction class (i.e. any of the convenience routines in the class) must instantiate every device referenced in the class (i.e. all of the devices.) This would limit the performance of the system because tests would automatically reserve devices which would never be used for those tests. The unnecessary reservation of devices would also make it very difficult for tests to share device objects.
Another approach which might be taken by a test writer would be to define a configuration transaction class for every possible system configuration. In other words, a separate configuration transaction class would be written for each combination of devices which might be tested. Using this approach, only those devices which are involved in a transaction are instantiated for each test configuration. There is no unnecessary reservation of devices which are not used. The improved efficiency in the instantiation of device objects, however, is obtained at the expense of the efficient re-use of program code. Many of the configurations defined by the test writer would probably need very similar [access and] convenience routines, but these routines could not be collected in a single transaction class. Instead, the test writer would have to reproduce the code for particular routines in each of the transaction classes which uses the respective routines. Any code sharing could only be achieved by physically copying the routines from one transaction class to another. This would create more work for the test writer and would result in a program which is very difficult to maintain because each of the copies of a routine must be individually updated. In one embodiment, the problems of the two approaches described above are overcome by using a combination of the different approaches. As described in the first approach, a system transaction class 46 is created as a subclass of base transaction class 40. System transaction class 46 is a collector of all the convenience routines which may be needed by the test writer. Because system transaction class 46 uses pointers to device objects instead of object references, it is not necessary to instantiate each device in the system for every test. The instantiation of device objects is left to the configuration transaction classes.
As shown in Fig. 3, the system transaction class 46 is sub-classed to create one or more configuration transaction classes 47, 48. The configuration transaction classes contain object references to each of the device objects which are involved in a transaction of the respective configuration. Configuration transaction classes 47, 48 are used to create the required device transaction classes (e.g., by including a method to create the device transaction classes in the constructors of the respective configuration transaction classes.) The device object references passed to the configuration transaction classes are used to set the device transaction class pointers inherited from the system transaction class, so the system transaction class' use of pointers is acceptable from a type checking perspective. This also prevents needless instantiation of devices in the system which are not used for a particular test. Further, the configuration transaction classes inherit all of the convenience routines from the system transaction class, so the programmer does not have to rewrite or copy the routines into each of the configuration transaction classes. This reduces the workload of the programmer and greatly increases the maintainability of the program code.
In order to allow for interface independent testing of the system design, the class structure of Fig. 3 also includes an interface independent device transaction class 50 which is subclassed from base transaction class 40. When the test system is configured to perform interface independent testing on the design, system transaction class 46 includes one or more pointers to interface independent device transaction classes 50. All operations on interface independent devices (i.e., those which have designs subject to change) are performed through the pointers to the corresponding interface independent device transaction classes. There is a single interface independent device transaction class 50 for each of the devices which are subject to design changes. Interface independent device transaction class 50 presents a consistent interface to the device, regardless of the current state of the device's design. That is, the interface provided by this class remains the same whether the device design is in its final form or is simply a prototype design. Interface independent device transaction class 50 defines common interface routines and meta parameters which are used by the test code. The test writer is responsible for initializing the meta parameters and calling the common routines via the pointer to the interface independent device transaction class. Differences between designs in default parameters or routine implementations are hidden within the subclasses. Because the test code operates on interface independent device transaction class 50, the test code need not be changed (or may require only minimal changes, as explained below) to accommodate changes in the design of the device. Changes in the device design are accommodated by the use of subclasses 52, 54 from interface independent device transaction class 50. (Classes 50 and 52/54 may be considered first-level and second-level interface independent transaction classes, respectively.) These classes inherit the interface routines and meta parameters from interface independent device transaction class 50 which is used by the test code. Classes 52 and 54 are each configured to be used with a single design of a particular device and provide mapping (in conjunction with the respective device transaction classes and device objects) from the interface of interface independent device transaction class 50 to that device design. As shown in Fig. 3, each of these classes is configured for use with a different design of a single device for which interface independent device transaction class 50 provides an interface. As indicated by the dashed line in Fig. 3, an interface independent device transaction subclass (e.g., 52) corresponding to a device which is subject to design changes is created by a configuration transaction class (e.g., 48) for a configuration which uses that device. Thus, when one design is substituted for another design of the same device, the only change which is required by the test code is in the line that creates the appropriate subclass of interface independent device transaction class 50. As described above, configuration transaction class 48 may include the create() method in its constructor, or this method may be explicitly called. The interface independent device transaction subclass in turn creates the appropriate device transaction class in the same manner.
Referring to Fig. 4, a block diagram illustrating the effect of circuit design changes on the design verification system is shown. The interface independent device transaction classes provide a means by which test code 60 can be written for a design which includes a prototype device 63 and then be reused without substantial alteration when the prototype device 63 is replaced with a subsequent design 68. (Test code 60 incorporates the interface independent device transaction class from which classes 61 and 66 are derived.) The only code changes which need to be made as a result of the design change are confined to those classes 61, 62 derived from the interface independent device transaction class. These are simply replaced with classes 66, 67corresponding to the new design 68. (The arrow between the functional blocks for the "B" design and the "D" design indicate that they are interchangeable, and not that there is any functional interaction between them.) No changes need to be made to the body of the test code 60. Since most of the time and effort invested in the test system can be directed to the body of the test code 60, only a small portion of this investment is discarded when the old design is replaced with a new one.
One embodiment of the invention uses CVI as the interface subsystem. CVI uses an interrupt driven model for the test environment. An interrupt driven model allows the test to retain very tight control over execution in the simulation subsystem. The use of an interrupt driven model may, however, create difficulties for a test writer because he or she must be prepared to receive any type of interrupt at any point in the simulation — the test subsystem cannot only handle those types of interrupts which are of interest to the test writer. The use of the class hierarchy shown in Fig. 3 simplifies the program code required to implement an interrupt driven model and reduces the burden on the test writer by enabling a state driven style of test writing. In a state driven style of test writing, the control flow of the tests are tied to a state sequencer (i.e., finite state machine, or FSM) in a manner resembling a hardware design style. The state sequencer may be defined in the base transaction class or in the system transaction class. The purpose of the state sequencer is to handle signals directed to the device based on the current state of the sequencer. This generally improves the readability of threads in the test subsystem because state information which is usually embedded in the program code is removed. This state information is moved into the device transaction class and stored in a format suitable for the state sequencer. The program code of the test subsystem can therefore be written as a simple stimulus generator. This greatly reduces the complexity of the code.
The state driven style of test writing may also simplify the writing of convenience routines. Using other styles of test writing, it may be necessary to include code in convenience methods which returns control to the simulation subsystem. In a state driven style, routines can return control to the simulation subsystem at a high level, allowing parallel operation without the need for multi-threading. This is a great benefit in a random testing environment.
In a system in which there is only one pending transaction and in which the transaction involves only two bus functional models there will be no random interaction of signals within the system. Thus, when a system is tested with only one transaction at a time, the testing cannot account for such random interactions and the possible effects of these interactions. Using a state driven style of testing, several transactions can be pending at once, allowing the random interaction of the transactions in much the same way as they would occur in the actual operation of the device under test. Because the test transactions are written as objects in a state driven test program, they may easily be performed in parallel to obtain the random interaction which cannot be obtained by the individual transactions.
While the present invention has been described with reference to particular embodiments, it will be understood that the embodiments are illustrative and that the invention scope is not limited to these embodiments. Many variations, modifications, additions and improvements to the embodiments described are possible. These variations, modifications, additions and improvements may fall within the scope of the invention as detailed within the following claims.

Claims

WHAT IS CLAIMED IS:
1. A test subsystem of a circuit design verification system, the circuit design verification system including a circuit simulation system which models a plurality of functional units in the circuit design, wherein the test subsystem comprises: a device class; one or more device transaction classes, wherein each of said device transaction classes contains a reference to a corresponding device object instantiated from said device class, each of said device objects corresponding to one of said functional units; one or more interface independent device transaction classes, wherein each of said interface independent device transaction classes defines an interface to one of said functional units in said simulation system; one or more subclasses, wherein each of said subclasses is derived from a corresponding one of said interface independent device transaction classes, wherein said subclasses inherit said interface defined by said corresponding one of said interface independent device transaction classes, wherein each of said subclasses contains a pointer to one of said device transaction classes; a system transaction class which contains one or more interface independent device transaction class pointers, each of said interface independent device transaction class pointers pointing to one of said one or more interface independent device transaction classes; and a configuration transaction class which is derived from said system transaction class and inherits one or more methods from said system transaction class, said configuration transaction class containing one or more object references to corresponding ones of said devices.
2. The test subsystem of claim 1 wherein said configuration transaction class is configured to create said one or more subclasses of said interface independent device transaction class.
3. The test subsystem of claim 2 wherein each of said subclasses of said interface independent device transaction class is configured to create said device transaction class to which said device transaction class pointer points.
4. The test subsystem of claim 1 wherein said test subsystem is configured to operate on ones of said devices corresponding to said interface independent device transaction class via said pointer to said interface independent device transaction class.
5. The test subsystem of claim 1 further comprising a base transaction class from which said device transaction class and said system transaction class are derived.
6. The test subsystem of claim 5 wherein said base transaction class defines one or more methods for initializing objects instantiated from said configuration transaction class.
7. The test subsystem of claim 1 wherein said system transaction class contains a device transaction class pointer for each functional unit in said circuit design.
8. The test subsystem of claim 1 wherein said system transaction class contains one or more convenience methods.
9. The test subsystem of claim 1 wherein said interface independent device transaction classes contain one or more common interface routines and one or more meta parameters.
10. The test subsystem of claim 1 wherein said device transaction class corresponds to a particular design of said device and contains an object reference to a device object, said device object corresponding to said particular design of said device.
11. A circuit design verification system comprising: a hardware simulation model including a model of a first device design; a body of test code; a first-level interface independent device transaction transactor; a first second-level interface independent device transaction transactor derived from said first interface independent device transaction transactor, said second interface independent device transaction transactor corresponding to said first device design; a first design-specific device transaction transactor corresponding to said first device design; and a first device transactor corresponding to said first device design; wherein said test system is configured to test said hardware simulation model including said first device design; wherein said first second-level interface independent device transaction transactor, said first design- specific device transaction transactor and said first device transactor are replaceable by a second second-level interface independent device transaction transactor, a second design- specific device transaction transactor and a second device transactor, each corresponding to a second device design, with minimal change to said body of test code; and wherein said test system having said second second-level interface independent device transaction transactor, said second design-specific device transaction transactor and said second device transactor is configured to test said hardware simulation model including said second device design.
12. The circuit design verification system of claim 11 further comprising a system transaction transactor which contains a pointer to said first-level interface independent device transaction transactor, wherein said test system is configured to test said hardware simulation model by performing operations using said pointer.
13. The circuit design verification system of claim 12 further comprising a configuration transaction transactor, wherein said configuration transaction transactor is derived from said system transaction transactor and inherits said pointer, and wherein said configuration transaction transactor instantiates one or more device transactors which correspond to one or more device functional models in said hardware simulation model.
14. The circuit design verification system of claim 13 wherein said configuration transaction transactor creates said second-level interface independent device transaction transactors.
15. The circuit design verification system of claim 13 wherein said second-level interface independent device transaction transactors create said design-specific device transaction transactors.
16. A method for verifying a hardware design comprising: providing a hardware simulation model containing a plurality of functional models; providing a body of test code configured to operate on an interface defined by an interface independent device transaction class; providing a first subclass of said interface independent device transaction class, said first subclass containing a pointer to a first device transaction class, said first device transaction class containing an object reference to a first device object corresponding to a first one of said functional models; performing one or more tests contained in said body of test code to verify said hardware simulation model containing said first one of said functional models; replacing said first one of said functional models with a second one of said functional models; replacing said first subclass with a second subclass of said interface independent device transaction class, said second subclass containing a pointer to a second device transaction class, said second device transaction class containing an object reference to a second device object corresponding to said second one of said functional models; and performing said one or more tests contained in said body of test code to verify said hardware simulation model containing said second one of said functional models.
17. The method of claim 16 further comprising providing a system transaction class which contains a pointer to said interface independent device transaction class, and wherein performing said one or more tests comprises performing operations on said pointer.
18. The method of claim 17 further comprising providing a configuration transaction class which is derived from said system transaction class, wherein said configuration transaction class inherits said pointer from said system transaction class and wherein said configuration transaction class creates said first subclass of said interface independent device transaction class.
19. The method of claim 18 wherein said first subclass of said interface independent device transaction class creates said first device transaction class.
20. A computer-readable medium containing a test subsystem of a circuit design verification system, wherein the circuit design verification system includes a simulation subsystem for modeling the operation of a test circuit, wherein the test subsystem on the computer-readable medium comprises: a device class; one or more device transaction classes, wherein each of said device transaction classes contains a reference to a corresponding device object instantiated from said device class, each of said device objects corresponding to one of said functional units; one or more interface independent device transaction classes, wherein each of said interface independent device transaction classes defines an interface to one of said functional units in said simulation system; one or more subclasses, wherein each of said subclasses is derived from a corresponding one of said interface independent device transaction classes, wherein said subclasses inherit said interface defined by said corresponding one of said interface independent device transaction classes, wherein each of said subclasses contains a pointer to one of said device transaction classes; a system transaction class which contains one or more interface independent device transaction class pointers, each of said interface independent device transaction class pointers pointing to one of said one or more interface independent device transaction classes; and a configuration transaction class which is derived from said system transaction class and inherits one or more methods from said system transaction class, said configuration transaction class containing one or more object references to corresponding ones of said devices.
PCT/US2000/005444 1999-03-04 2000-03-03 Interface independent test system WO2000052484A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP00915989A EP1171774A2 (en) 1999-03-04 2000-03-03 Interface independent test system
AU37165/00A AU3716500A (en) 1999-03-04 2000-03-03 Interface independent test system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/262,575 1999-03-04
US09/262,575 US6421634B1 (en) 1999-03-04 1999-03-04 Interface independent test system

Publications (2)

Publication Number Publication Date
WO2000052484A2 true WO2000052484A2 (en) 2000-09-08
WO2000052484A3 WO2000052484A3 (en) 2001-02-08

Family

ID=22998094

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/005444 WO2000052484A2 (en) 1999-03-04 2000-03-03 Interface independent test system

Country Status (4)

Country Link
US (1) US6421634B1 (en)
EP (1) EP1171774A2 (en)
AU (1) AU3716500A (en)
WO (1) WO2000052484A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102567122A (en) * 2010-12-27 2012-07-11 北京国睿中数科技股份有限公司 Communication interface method of processor reference model under multiple simulation and verification platforms

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19650293C1 (en) * 1996-12-04 1998-04-09 Siemens Ag System component testing method for object-orientated program
JP4098448B2 (en) * 1999-10-07 2008-06-11 富士通株式会社 Program verification method and apparatus
US6477698B1 (en) * 1999-11-09 2002-11-05 Khalil Shalish Encapsulation of HDL process descriptions to provide granularity at the process level
US20030200070A1 (en) * 2000-03-01 2003-10-23 Elliott Mark S. Simulation of uncharacterized hardware
US6907557B2 (en) * 2001-02-22 2005-06-14 National Instruments Corporation System and method for testing a group of related products
US7117484B2 (en) * 2002-04-16 2006-10-03 International Business Machines Corporation Recursive use of model based test generation for middleware validation
US8682636B2 (en) * 2002-08-30 2014-03-25 Sap Ag Non-client-specific testing of applications
US6944837B2 (en) * 2002-12-20 2005-09-13 Agilent Technologies, Inc. System and method for evaluating an integrated circuit design
US7194705B1 (en) * 2003-03-14 2007-03-20 Xilinx, Inc. Simulation of integrated circuitry within a high-level modeling system using hardware description language circuit descriptions
GB0322050D0 (en) 2003-09-20 2003-10-22 Spiratech Ltd Modelling and simulation method
US7734737B2 (en) * 2005-05-26 2010-06-08 Nokia Corporation Device management with configuration information
US7870524B1 (en) * 2007-09-24 2011-01-11 Nvidia Corporation Method and system for automating unit performance testing in integrated circuit design
US8296092B2 (en) * 2008-08-15 2012-10-23 International Business Machines Corporation Platform specific test for computing hardware
CN105510744B (en) * 2015-12-18 2019-11-19 杭州士兰微电子股份有限公司 Programmable device test device and test method
CN112193436B (en) * 2020-10-23 2022-01-11 中电科航空电子有限公司 Integrated verification test environment system for civil passenger plane cabin system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6067639A (en) * 1995-11-09 2000-05-23 Microsoft Corporation Method for integrating automated software testing with software development
US5732247A (en) 1996-03-22 1998-03-24 Sun Microsystems, Inc Interface for interfacing simulation tests written in a high-level programming language to a simulation model
US5848236A (en) 1996-03-22 1998-12-08 Sun Microsystems, Inc. Object-oriented development framework for distributed hardware simulation
US5751941A (en) 1996-04-04 1998-05-12 Hewlett-Packard Company Object oriented framework for testing software
US6002869A (en) * 1997-02-26 1999-12-14 Novell, Inc. System and method for automatically testing software programs
US6233540B1 (en) * 1997-03-14 2001-05-15 Interuniversitair Micro-Elektronica Centrum Design environment and a method for generating an implementable description of a digital system
US6219802B1 (en) * 1998-07-06 2001-04-17 Mci Communications Corporation System for generating test data

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN vol. 1996, no. 2, 29 February 1996, & JP 07 254008 A (TOSHIBA CORP.) 03 October 1995, *
PATENT ABSTRACTS OF JAPAN vol. 1998, no. 6, 30 April 1998, & JP 10 049560 A (MITSUBISHI ELECTRIC CORP) 20 February 1998, *
PATENT ABSTRACTS OF JAPAN vol. 1999, no. 3, 31 March 1999 & JP 10 326835 A (OKI ELECTRIC IND CO LTD) 08 December 1998, *
PATENT ABSTRACTS OF JAPAN vol. 1999, no. 3, 31 March 1999 & JP 10 340283 A (TOSHIBA CORP) 22 December 1998, *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102567122A (en) * 2010-12-27 2012-07-11 北京国睿中数科技股份有限公司 Communication interface method of processor reference model under multiple simulation and verification platforms

Also Published As

Publication number Publication date
EP1171774A2 (en) 2002-01-16
US6421634B1 (en) 2002-07-16
WO2000052484A3 (en) 2001-02-08
AU3716500A (en) 2000-09-21

Similar Documents

Publication Publication Date Title
US7865350B1 (en) Partitioning a model in modeling environments
US6421634B1 (en) Interface independent test system
US7913170B2 (en) System and method for performing type checking for hardware device nodes in a graphical program
US6064812A (en) System and method for developing automation clients using a graphical data flow program
US7743335B2 (en) System and method for accessing registers of a hardware device in a graphical program
US5847955A (en) System and method for controlling an instrumentation system
US5361350A (en) Object oriented method management system and software for managing class method names in a computer system
US6212489B1 (en) Optimizing hardware and software co-verification system
US6064816A (en) System and method for performing class propagation and type checking in a graphical automation client
US5710727A (en) System and method for creating resources in an instrumentation system
US20030140337A1 (en) System, method, and article of manufacture for data transfer reporting for an application
US20030121010A1 (en) System, method, and article of manufacture for estimating a potential performance of a codesign from an executable specification
US20030117971A1 (en) System, method, and article of manufacture for profiling an executable hardware model using calls to profiling functions
US20060190905A1 (en) System for designing re-programmable digital hardware platforms
WO2002001424A9 (en) System and method relating to verification of integrated circuit design
US6668312B2 (en) System, method, and article of manufacture for dynamically profiling memory transfers in a program
US6360192B2 (en) Transaction class
US20030120460A1 (en) System, method, and article of manufacture for enhanced hardware model profiling
US5627998A (en) System and method for mapping calls to functions in a first driver level library to a session-based instrumentation control driver level system
Krause et al. Timing simulation of interconnected AUTOSAR software-components
WO2001090961A2 (en) Enhancements to object-oriented electronic circuit design modeling and simulation environment
US6904398B1 (en) Design of an application specific processor (ASP)
US6937973B1 (en) Design of an application specific processor (ASP)
US6697774B1 (en) Application specific processor (ASP)
Dunlop et al. OMI-a standard model interface for IP delivery

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

WWE Wipo information: entry into national phase

Ref document number: 2000915989

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 2000915989

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 2000915989

Country of ref document: EP