|Publication number||US7840530 B2|
|Application number||US 11/901,494|
|Publication date||Nov 23, 2010|
|Filing date||Sep 18, 2007|
|Priority date||Sep 18, 2007|
|Also published as||US8271464, US20090077082, US20110040738, WO2009039119A2, WO2009039119A3|
|Publication number||11901494, 901494, US 7840530 B2, US 7840530B2, US-B2-7840530, US7840530 B2, US7840530B2|
|Inventors||Michael M. Magruder, David Detlefs, John Joseph Duffy, Goetz Graefe, Vinod K. Grover|
|Original Assignee||Microsoft Corporation|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (26), Non-Patent Citations (10), Referenced by (15), Classifications (13), Legal Events (3)|
|External Links: USPTO, USPTO Assignment, Espacenet|
Software transactional memory (STM) is a concurrency control mechanism analogous to database transactions for controlling access to shared memory in concurrent computing. A transaction in the context of transactional memory is a piece of code that executes a series of reads and writes to shared memory. In other words, a transaction accesses data in one or more objects. An object in the context of transactional memory is a set of connected memory locations that are locked as one entity. An object in this context might also be a static variable, or a set of such variables, or it might be a set of cache lines.
STM is used as an alternative to traditional locking mechanisms. STM allows concurrent programs to be written more simply. A transaction specifies a sequence of code that is supposed to execute as if it were executing in isolation. This illusion of isolation is achieved by fine-grained locking of objects, and by executing in a mode that allows the side-effects of the transaction to be rolled back if the transaction is discovered to be in conflict with some other transaction. We say that a data access is “transacted” if the code generated for that access has been modified to include support for these locking and rollback mechanisms.
Transactions may be nested, and can be classified as open or closed nested. If a thread is currently executing a transaction and reaches the start of a new atomic block, this atomic block is executed as a closed nested child transaction of the currently-executing parent. This nested transaction executes within the same isolation boundary as the enclosing transaction, and just like other memory accessed within the enclosing transaction, the effects of the nested transaction will only become visible when the enclosing transaction commits. In other words, the parent transaction is effectively suspended, and the closed nested transaction is allowed to run to completion before processing in the parent is resumed. When a nested transaction rolls back, its temporary effects are undone and the state of the parent transaction is restored to the point that the nested transaction began.
The “outermost” transaction being executed by a given thread is not nested; we call this the top-level transaction. This top-level transaction must execute atomically, so the nested transactions become part of it. Nesting could arise, for example, if some abstractions A and B each had internal representation invariants they wanted to maintain even in use by concurrent threads, and they therefore used atomic blocks in the implementations of their methods to guarantee that these invariants are not violated by concurrent accesses. Now assume that some higher-level abstraction C uses instances of A and B in its implementation, and has some invariant that relates these A and B instances. Methods of C might use transactions to ensure that this invariant is not violated. If A and B methods are used inside C's transactions, the transactions in the A and B methods will be nested (in this use).
Current transactional memory systems do not allow work performed within the isolation boundary of one transaction to be distributed between multiple concurrent threads of execution. In current systems, a transaction may have only one nested child transaction. The semantics of such systems simply do not allow such parallelism within a transaction, and attempts to execute more than one nested transaction at a time would result in nested transaction log entries intermixed without order in the parent's log and other errors, and a breakdown of the basic underlying fine grained locking protocols used to provide the illusion of isolation.
Various technologies and techniques are disclosed for supporting parallel nested transactions in a transactional memory system. Multiple closed nested transactions are created for a single parent transaction, and the closed nested transactions are executed concurrently as parallel nested transactions. Various techniques are used to ensure effects of the parallel nested transactions are hidden from other transactions outside the parent transaction until the parent transaction commits.
In one implementation, versioned write locks are used with parallel nested transactions. When a transactional memory word changes from a write lock to a versioned write lock, an entry is made in a global versioned write lock map to store a pointer to a write log entry that the versioned write lock replaced. When the versioned write lock is encountered during transaction processing, the global versioned write lock map is consulted to translate the versioned write lock to the pointer to the write log entry.
In another implementation, the release of a duplicate write lock for rollback is supported for parallel transactions. During rollback processing of a parallel nested transaction, a first write log entry is encountered that represents a write lock. If the write lock is determined to be a duplicate, a global lock is acquired and used to synchronize access to a global versioned write lock map.
In yet another implementation, optimistic read validation is supported for parallel nested transactions. During optimistic read validation, if a versioned write lock indicates a conflict from a sibling parallel nested transaction, then information is consulted to determine if a parallel nested transaction should be doomed. In one implementation, that information is contained in a versioned write lock and in a global versioned write lock map.
In yet a further implementation, write lock acquisition is supported for parallel nested transactions. Upon attempting to acquire a write lock for a parallel nested transaction, a transactional memory word is read and analyzed to determine if the write lock can be obtained. If the transactional memory word indicates a versioned write lock, a global versioned write lock map is accessed to retrieve a write log entry pointer that points to a first write log entry.
In yet another implementation, pessimistic reads are supported for parallel nested transactions. A pessimistic duplication detection data structure is created for a parallel nested transaction. An entry is made into the data structure for each pessimistic read in the parallel nested transaction. When committing the parallel nested transaction, new pessimistic read locks are passed to an immediate parent, and an entry is made into a separate pessimistic duplication detection data structure of the immediate parent with synchronization between sibling transactions. The pessimistic duplication detection data structures can also be used for upgrades from pessimistic reads to write locks.
In another implementation, retry operations are supported with parallel nested transactions. When a transaction that is a parallel nested transaction or a child transaction of the parallel nested transaction executes a retry, a read set of the transaction is registered for the retry. When a decision is made to propagate the retry past a parallel nested transaction parent of the transaction, the read set is kept registered and made part of a parent read set.
In yet a further implementation, write abort compensation maps can be used with parallel nested transactions to detect and handle falsely doomed parent transactions. A write abort compensation map is created when releasing new write locks for a parallel nested transaction during rollback. When the parallel nested transaction rolls back, an entry is created in the write abort compensation map for each new write lock released.
This Summary was provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
The technologies and techniques herein may be described in the general context as a transactional memory system, but the system also serves other purposes in addition to these. In one implementation, one or more of the techniques described herein can be implemented as features within a framework program such as MICROSOFT® .NET Framework, or from any other type of program or service that provides platforms for developers to develop software applications. In another implementation, one or more of the techniques described herein are implemented as features with other applications that deal with developing applications that execute in concurrent environments.
As noted in the background section, a nested transaction is considered closed if it its effects are part of the same isolation boundary as its containing, or parent, transaction. Using various technologies and techniques described herein, a transaction may have multiple closed nested transactions at the same time. These are called “parallel nested transactions” (PNTs). All of the PNTs under a single enclosing transaction are called the “parallel children” of the transaction, and the enclosing transaction is called the “parallel parent”. The parallel parent and its children are referred to as a “parallel nest”. A “sibling” of a PNT is another PNT enclosed (at some nesting level) within the same parallel parent. In one implementation, each PNT executes much like a normal closed nested transaction: its effects are isolated within the enclosing transaction and only become visible beyond the parallel nest when the parallel parent commits. However, each PNT is isolated from its siblings just as if it were a top-level transaction. The effects of a PNT only become visible to its siblings when it commits.
As shown in
Additionally, device 100 may also have additional features/functionality. For example, device 100 may also include additional storage (removable and/or non-removable) including, but not limited to, magnetic or optical disks or tape. Such additional storage is illustrated in
Computing device 100 includes one or more communication connections 114 that allow computing device 100 to communicate with other computers/applications 115. Device 100 may also have input device(s) 112 such as keyboard, mouse, pen, voice input device, touch input device, etc. Output device(s) 111 such as a display, speakers, printer, etc. may also be included. These devices are well known in the art and need not be discussed at length here. In one implementation, computing device 100 includes transactional memory application 200. Transactional memory application 200 will be described in further detail in
Turning now to
Transactional memory application 200 includes program logic 204, which is responsible for carrying out some or all of the techniques described herein. Program logic 204 includes logic for allowing multiple parallel transactions to be nested under a single parent transaction 206 (as described below with respect to
Turning now to
The parallel nested transaction fills in the parallel nested transaction entry in the parent log with information (stage 276). In one implementation, the information includes a pointer to the child's log and a pointer to the write abort compensation map for the child and/or pessimistically read object table, if applicable. The write abort compensation map is described in further detail in
Before moving on to more detailed discussions on how versioned write locks are used, let's first explore an example that will help illustrate the need for versioned write locks (VWL's). Suppose there is an in-place STM system, and a top-level transaction Tx1 that acquires a write lock on object O1. The TMW for O1 is set to WLE1, which is a write log entry in Tx1's log representing Tx1's write lock on O1. Now, suppose two PNT's are introduced, Tx2 and Tx3, with Tx1 as the parallel parent. Tx2 and Tx3 are siblings in the parallel nest, and are executed concurrently. Tx2 and Tx3 may access data locked by Tx1, but they must be isolated from each other. Therefore, while Tx2 and Tx3 may both access O1, they must not be allowed to do so concurrently. Now, suppose Tx3 wishes to read from O1. It performs an optimistic read operation, creating an optimistic read log entry in its log recording the value of O1's TMW as WLE1. Next, assume that Tx2 writes to O1. Tx2 will acquire a write lock on O1, and set the TMW for O1 to WLE2, which is a write log entry in Tx2's log. WLE2 records that WLE1 is the previous value of O1's TMW. Tx2 may now write to fields of O1, and does so with in-place writes. As Tx3 continues to execute, it reads fields of O1 that contain uncommitted writes from Tx2. Tx3 is by definition doomed and should rollback. However, if Tx2 rolls back for any reason before Tx3 attempts to commit, then it must release its write lock on O1. To do this, Tx2 would normally set O1's TMW back to WLE1. But now when Tx3 attempts to commit, it will see that O1's TMW contains the same value that it did when Tx3 first read O1. In this situation, Tx3 will appear valid, and will fail to recognize that it read uncommitted writes from Tx2. Therefore, when Tx2 rolls back it must set O1's TMW to some value other than WLE1, and it must do this in a way that ensures that other transactions in the system (PNT siblings or other top-level transactions) recognize that O1 is still write locked by Tx1. This is accomplished by setting O1's TMW to a versioned write lock (VWL) and making an entry in the global versioned write lock map (VWLM) that indicates Tx1 holds a write lock on O1. The details and use of VWL's and the VWLM are described below. This example illustrates one case where a VWL is necessary. However, it will be appreciated by one of ordinary skill in the art that there are numerous scenarios where a VWL can be used, as will become apparent as the processes for lock acquisition and release are described in detail in the rest of this section.
If the current TMW is instead a WLE* (decision point 598), and if the WLE is owned by the transaction, and the saved version number in the WLE matches the old TMW (decision point 600), then the transaction is valid (stage 594). If the current TMW is not a V/C pair (decision point 590), and the current TMW is not a WLE* (decision point 598), then the TMW is a VWL (stage 602). A synchronized lookup is made in the VWLM using the address of the locked object. If there is no VWLM entry (decision point 604), then the transaction is invalid (stage 596). If there is an entry (decision point 604), then the VWLM entry is used to retrieve the WLE* that the VWL replaced. If the WLE is owned by the transaction, and the saved version number in the WLE matches the old TMW (decision point 606), then the transaction is valid (stage 594). Otherwise, the transaction is invalid (stage 596). The process ends at end point 608.
Turning now to
If the current TMW is not a V/C pair (decision point 620), and is not a WLE* (decision point 624), then the current TMW is a VWL (stage 632). If the WLE from the original TMW is owned by this transaction or any ancestor, and if the version number saved in the WLE matches the version number in the VWL (decision point 634), then the transaction is valid (stage 628). Otherwise, the transaction is not valid (stage 630). The process ends at end point 636.
Turning now to
If the current TMW is not a V/C pair (decision point 650), and the current TMW is not a WLE* (decision point 654), then the current TMW is a VWL (stage 662). A lookup is performed in the VWLM to translate the VWL to a WLE* (stage 664). If an entry is not found (decision point 666), then the transaction is not valid (stage 660). Otherwise, if an entry is found (decision point 666), then the system checks to see if the version numbers of the original and current VWL match, and if the WLE found in the VWLM for the TMW is owned by this transaction or any ancestor (decision point 668). If both criteria are met, then the transaction is valid (stage 658). Otherwise, the transaction is invalid (stage 660). The process ends at end point 670.
Correct operation of pessimistic reads in a system with simple closed nested transactions requires the use of a duplication detection data structure called a Pessimistically Read Object Table (PROT). Each top-level transaction creates a PROT either at transaction start, or lazily at the first pessimistic read operation. When the transaction, or any descendent, attempts to acquire a pessimistic read lock on an object, it consults the PROT to determine if a pessimistic read lock has already been acquired. If the object is in the PROT, then that object is already read locked by the nest of transactions. If the object is not in the PROT, and if the object is not currently write locked by another transaction, then a pessimistic read lock is acquired using a CAS operation to increment C (the count of pessimistic readers) in the V/C pair stored in the object's TMW. If the CAS operation is successful, then an entry is made in the PROT to record the fact that the nest now has the object locked for pessimistic reads. When the pessimistic read lock is released, either during top-level commit or rollback, C is decremented (with a CAS again), and the PROT entry is removed. Let's now look at how PROTs are used with parallel nested transactions.
Now it is time to describe the exemplary process shown in
Turning now to
As shown in
As shown in
In one implementation, when a transaction executes a retry operation, the system registers for waits on every read in the read set of the retrying transaction. The retrying transaction waits for notification that something in the read set has changed. A wait notification is initiated from a particular transaction releasing a write lock. A transaction knows if notification is required in one of two ways. In the first way, if the transactional memory word contained a waiters bit during write lock acquisition, then during release the transactional memory word is looked up in an object waiters map, and each waiting transaction is signaled. In the second way, if a writing transaction finds a global count of waiting transactions to be greater than zero after releasing all write locks, it will use a transaction waiters map to determine which transactions, if any, were waiting on locations written to and need to be signaled. In each case, the write lock is released using a normal store operation.
In another implementation, a progressive retry operation is started with a rollback of just the retrying nested transaction and waiting on its read set. After waiting for some particular time or for some other condition to be met, a backoff process is performed to rollback an immediate parent of the retrying transaction, increasing the size of the original wait set. The backoff process is repeated until rollback of a top-most parent, adding an additional wait for each next parent. The aggregate wait set is associated with the top-most parent and any notification will result in re-execution of the top-most parent.
Returning now to
Write abort compensation maps can be used to detect falsely doomed parent transactions of nested children in transactional memory systems that use in-place writes. A write abort compensation map (or other storage mechanism) tracks the release count for each lock released for each nested transaction that rolls back. The number of times the nested transactions release a write lock is recorded in their respective write abort compensation map. The release counts can be used during a validation of a parent transaction to determine if an apparently invalid optimistic read is really valid.
In one implementation, while processing a parent transaction log, any write abort compensation maps seen for nested child transactions are combined into an aggregated write abort compensation map in the parent. If the optimistic read failed to validate due to a version number mismatch, then the aggregated write abort compensation map is consulted to retrieve a particular variable's write lock release count for the nested child transactions. If a difference in version numbers exactly matches the write lock release count for the nested child transactions, then the optimistic read is valid.
Returning now to
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims. All equivalents, changes, and modifications that come within the spirit of the implementations as described herein and/or by the following claims are desired to be protected.
For example, a person of ordinary skill in the computer software art will recognize that the examples discussed herein could be organized differently on one or more computers to include fewer or additional options or features than as portrayed in the examples.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US5251318 *||Aug 23, 1989||Oct 5, 1993||Hitachi, Ltd.||Multiprocessing system comparing information copied from extended storage before and after processing for serializing access to shared resource|
|US5263155||Feb 21, 1991||Nov 16, 1993||Texas Instruments Incorporated||System for selectively registering and blocking requests initiated by optimistic and pessimistic transactions respectively for shared objects based upon associated locks|
|US5687363||Jul 26, 1996||Nov 11, 1997||Siemens Stromberg-Carlson||Distributed database architecture and distributed database management system for open network evolution|
|US5721909||Nov 7, 1996||Feb 24, 1998||Siemens Stromberg-Carlson||Distributed database architecture and distributed database management system for open network evolution|
|US5764977||Jul 12, 1995||Jun 9, 1998||Siemens Stromberg-Carlson||Distributed database architecture and distributed database management system for open network evolution|
|US5835757||Jul 17, 1995||Nov 10, 1998||Siemens Telecom Networks||Distributed database management system for servicing application requests in a telecommunications switching system|
|US5983225 *||Jan 26, 1998||Nov 9, 1999||Telenor As||Parameterized lock management system and method for conditional conflict serializability of transactions|
|US6052695 *||Feb 27, 1996||Apr 18, 2000||Ntt Data Communications Systems Corporation||Accurate completion of transaction in cooperative type distributed system and recovery procedure for same|
|US6295610 *||Sep 17, 1998||Sep 25, 2001||Oracle Corporation||Recovering resources in parallel|
|US6343339 *||Oct 20, 2000||Jan 29, 2002||Sun Microsystems, Inc.||Method and apparatus that utilizes state locks to lock resources|
|US6578033||Jun 20, 2000||Jun 10, 2003||Sun Microsystems, Inc.||System and method for accessing a shared computer resource using a lock featuring different spin speeds corresponding to multiple states|
|US6772154 *||Nov 16, 2000||Aug 3, 2004||Sun Microsystems, Inc.||Implementation of nested databases using flexible locking mechanisms|
|US6772255 *||Dec 14, 2000||Aug 3, 2004||Sun Microsystems, Inc.||Method and apparatus for filtering lock requests|
|US6990503 *||Apr 12, 2002||Jan 24, 2006||Ncr Corporation||Rescheduling transactions in a database system|
|US7234076 *||Feb 14, 2003||Jun 19, 2007||Sun Microsystems, Inc.||Multi-level undo of main-memory and volatile resources|
|US7289992 *||May 1, 2003||Oct 30, 2007||International Business Machines Corporation||Method, system, and program for lock and transaction management|
|US7418706 *||May 8, 2003||Aug 26, 2008||Teradota Us, Inc.||Rescheduling table scan transactions|
|US7478210 *||Jun 9, 2006||Jan 13, 2009||Intel Corporation||Memory reclamation with optimistic concurrency|
|US7496574 *||May 1, 2003||Feb 24, 2009||International Business Machines Corporation||Managing locks and transactions|
|US7516366 *||Aug 17, 2007||Apr 7, 2009||Sun Microsystems, Inc.||System and method for executing nested atomic blocks using split hardware transactions|
|US20070136365||Mar 23, 2006||Jun 14, 2007||Microsoft Corporation||Reducing unnecessary software transactional memory operations on newly-allocated data|
|US20070162520||Dec 30, 2005||Jul 12, 2007||Leaf Petersen||Software assisted nested hardware transactions|
|US20070198519||Jun 27, 2006||Aug 23, 2007||David Dice||Methods and apparatus to implement parallel transactions|
|US20070198978||Jun 27, 2006||Aug 23, 2007||David Dice||Methods and apparatus to implement parallel transactions|
|US20090006407||Sep 18, 2007||Jan 1, 2009||Microsoft Corporation||Parallel nested transactions in transactional memory|
|US20090077083||Sep 18, 2007||Mar 19, 2009||Microsoft Corporation||Parallel nested transactions in transactional memory|
|1||Agrawal, Kunal et al., "Nested Parallelism in Transactional Memory", Principles and Practice of Parallel Programming, Proceedings of the 13th ACM SIGPLAN Symposium on Principles and practice of parallel programming 2008, pp. 163-174.|
|2||Dice, et al., Transactional Locking II, Lectures Notes in Computer Science, vol. 4167, Sep. 2006, pp. 194-208.|
|3||Dice, et al., What Really Makes Transactions Faster?, First ACM SIGPLAN Workshop on Languages, Compilers, and Hardware Support for Transactional Computing, Jun. 2006, 11 pages.|
|4||International Search Report and Written Opinion for Application No. PCT/US2008/076563, mailed on Mar. 18, 2009, 11 pages.|
|5||International Search Report and Written Opinion for Application No. PCT/US2008/076565, mailed on Mar. 18, 2009, 10 pages.|
|6||International Search Report and Written Opinion for application PCT/US2008/076564 dated Mar. 31, 2009, 9 pages.|
|7||Mcdonald, Austin et al., "Architectural Semantics for Practical Transactional Memory", ACM, vol. 34, Issue 2, May 2006, pp. 53-65.|
|8||Moravan, et al., "Supporting Nested Transactional Memory in LogTM", Twelfth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), San Jose, CA, Oct. 21-25, 2006, 12 pages.|
|9||Moraven, et al., Supporting Nested Transactional Memory in LogTM, Proceedings of the 12th International Conference on Architectural Support for Programming Languages and Operating Systems, Oct. 2006, pp. 359-370.|
|10||Moss, J. Eliot B. et al., "Nested transactional memory: Model and architecture sketches", Science of Computer Programming (2006), May 10, 2006, 16 pages.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7962456 *||Sep 18, 2007||Jun 14, 2011||Microsoft Corporation||Parallel nested transactions in transactional memory|
|US8195621 *||Nov 14, 2008||Jun 5, 2012||Moshe Elisha||Database schema management system|
|US8271464 *||Oct 27, 2010||Sep 18, 2012||Microsoft Corporation||Parallel nested transactions in transactional memory|
|US8271465 *||Feb 15, 2011||Sep 18, 2012||Microsoft Corporation||Parallel nested transactions in transactional memory|
|US8281185 *||Jun 30, 2009||Oct 2, 2012||Oracle America, Inc.||Advice-based feedback for transactional execution|
|US9342454||Oct 12, 2012||May 17, 2016||International Business Machines Corporation||Nested rewind only and non rewind only transactions in a data processing system supporting transactional storage accesses|
|US9367263||Oct 22, 2012||Jun 14, 2016||International Business Machines Corporation||Transaction check instruction for memory transactions|
|US9367264||Feb 26, 2013||Jun 14, 2016||International Business Machines Corporation||Transaction check instruction for memory transactions|
|US9396115||Oct 12, 2012||Jul 19, 2016||International Business Machines Corporation||Rewind only transactions in a data processing system supporting transactional storage accesses|
|US9411635||Sep 18, 2012||Aug 9, 2016||Microsoft Technology Licensing, Llc||Parallel nested transactions in transactional memory|
|US9430166||Oct 12, 2012||Aug 30, 2016||International Business Machines Corporation||Interaction of transactional storage accesses with other atomic semantics|
|US20090150396 *||Nov 14, 2008||Jun 11, 2009||Moshe Elisha||database schema management system|
|US20100332901 *||Jun 30, 2009||Dec 30, 2010||Sun Microsystems, Inc.||Advice-based feedback for transactional execution|
|US20110040738 *||Oct 27, 2010||Feb 17, 2011||Microsoft Corporation||Parallel nested transactions in transactional memory|
|US20110138145 *||Feb 15, 2011||Jun 9, 2011||Microsoft Corporation||Parallel nested transactions in transactional memory|
|U.S. Classification||707/609, 707/685, 707/675, 707/704, 707/683, 707/692, 707/674, 707/687, 707/695|
|Cooperative Classification||G06F17/30368, G06F17/30362|
|Aug 21, 2008||AS||Assignment|
Owner name: MICROSOFT CORPORATION, WASHINGTON
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MAGRUDER, MICHAEL M.;DETLEFS, DAVID;DUFFY, JOHN JOSEPH;AND OTHERS;REEL/FRAME:021420/0109;SIGNING DATES FROM 20070827 TO 20070910
|Apr 24, 2014||FPAY||Fee payment|
Year of fee payment: 4
|Dec 9, 2014||AS||Assignment|
Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034542/0001
Effective date: 20141014