|Publication number||US7512616 B2|
|Application number||US 10/718,420|
|Publication date||Mar 31, 2009|
|Filing date||Nov 20, 2003|
|Priority date||Nov 20, 2003|
|Also published as||CN1882912A, CN100483345C, US20050114391, WO2005055054A1|
|Publication number||10718420, 718420, US 7512616 B2, US 7512616B2, US-B2-7512616, US7512616 B2, US7512616B2|
|Inventors||Brian Jeffrey Corcoran, Lourdes Magally Gee, Matthew Joseph Kalos, Ricardo Sedillos Padilla|
|Original Assignee||International Business Machines Corporation|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (26), Non-Patent Citations (10), Referenced by (8), Classifications (16), Legal Events (5)|
|External Links: USPTO, USPTO Assignment, Espacenet|
1. Field of the Invention
This invention relates to data transmission and more particularly relates to an apparatus, system, and method for communicating binary data using a self-descriptive binary data structure.
2. Description of the Related Art
One of the primary methods of transferring data between a host and a storage system is to use a data structure called an s-record. The s-record format was first created by Motorola™ and has become an industry-standard for transmitting files from a source 102 to a target 104. Other developers have created derivatives and supplementary enhancements to the s-record over time, but the s-record data structure has generally remained the same in most regards. Although the s-record data structure may be used to transmit files that contain data that will ultimately be stored in binary format, the s-record data structure itself is in ASCII format, typically using ASCII and hex characters.
An s-record may be described as a single line in an s-record image or file. Each s-record within the file includes metadata and data. The metadata, for example, includes a memory address in which the data is to be stored. Unfortunately, the total length of each s-record is relatively short, limited to no more than 78 bytes. Consequently, an s-record image containing many s-records must include a significant amount of metadata. This creates various concerns for transferring an s-record image as well as processing and storing the data.
Of great concern is the overhead required to transmit an s-record image from one device to another. The amount of bandwidth and the time required to transmit an s-record is substantial due to the large amount of metadata that also must be transmitted with the data. Furthermore, the ASCII s-record needs to be converted to binary, at some point, prior to storing the data in the memory. A significant disadvantage related to converting large quantities of data from ASCII to binary is that substantial memory is necessary to concurrently accommodate both the ASCII and the binary formats as the conversion is taking place.
One beneficial use of the s-record data structure is recognized in applications that require frequent error checking during transmission of the data. By transmitting and checking individual s-records, transmission errors may be recognized quickly, and the data may be reprocessed. Although the s-record format may include one record to indicate the quantity of records in a file, the s-record format does not provide a means to check the integrity of the entire image or file. In contrast, there is much less need in many data transmission applications to check very small blocks of data. For example, many data transmission applications, such as storage system applications, realize significant benefits by transmitting large blocks of data and checking the entire image or file, rather than individual records. Frequent error checking is not required in many storage system applications because the transmission distance is relatively short and the opportunity for data transmission losses is relatively low.
A further shortcoming of the s-record data structure is that it does not provide any means for identifying individual code segments within the s-record or the s-record image. The s-record simply provides a small set of data and the memory address in which that data is to be stored. The data within a single s-record is contiguous, but the data in consecutive s-records is not necessarily contiguous. Without some type of index, table of contents, or process for identifying individual code segments in an s-record or s-record image, it is not possible to extract a desired set of data from within the s-record or s-record image.
It is important to note that some forms of binary images, as compared to ASCII images, do exist. Some of these binary image formats include the executable and linking format (ELF) and the common object file format (COFF). However, these formats are configured to include only a single executable and do not identify individual code segments within a file.
Consequently, a need exists for an apparatus, system, and method that overcome the foregoing limitations that are inherent in the conventional s-record data structure and regime. Beneficially, such an apparatus, system, and method would overcome the detrimental impacts of the large size of the s-record image, the complexity of processing the data, the inability to perform error checking on an entire image, and the inability to identify or extract an individual code segment.
The present invention has been developed in response to the present state of the art, and in particular, in response to the problems and needs in the art that have not yet been fully solved by currently available code images and data structures. Accordingly, the present invention has been developed to provide an apparatus, system, and method for communicating binary data using a self-descriptive binary data structure that overcomes many or all of the above-discussed shortcomings in the art.
The apparatus for communicating binary data using a self-descriptive binary data structure is provided with a logic unit containing a plurality of modules configured to functionally execute the necessary steps of communicating binary data using a self-descriptive binary data structure. These modules in the described embodiments include a plurality of data segments, a target data set, and a data structure descriptor. The data structure descriptor indicates the location of the target data set within one of the plurality of data segments. In this way, the binary data structure is self descriptive.
The data structure descriptor may be, in one embodiment, a customizable directory descriptor configured to provide a table of contents, index, or directory of the data stored in each of the data fields. In particular, the data structure descriptor describes the location of an executable. In a further embodiment, the data structure descriptor may comprise a name, version, type, or other indicator that is descriptive of the binary data image. Additionally, the target data set may be a code image, an executable, or another runtime text or data set. In a certain embodiment, the binary data image also may include one or more alignment segments.
A system of the present invention is also presented for communicating binary data using a self-descriptive binary data structure. The system, in one embodiment, includes a source device connected via a communication channel to a target device. In one embodiment, the system may be a storage system or a storage area network, or portion thereof. The source transmits a self-descriptive binary data structure to the target.
In a further embodiment, the source device may be configured to generate the binary data structure, for instance, from data or a non-binary data structure. The target device may be further configured to process an executable, such as a bootstrap module, that is within the binary data image.
A method of the present invention is also presented for communicating binary data using a self-descriptive binary data structure. The method, in the disclosed embodiments, substantially includes the steps necessary to carry out the functions presented above with respect to the operation of the described apparatus and system. Specifically, one embodiment of the described method includes generating a plurality of data segments, attaching a data structure descriptor to the combined data segments, identifying a target data set, and storing the location of the target data set in the data structure descriptor.
One embodiment of the present invention beneficially decreases the time and complexity associated with communicating a binary data structure between a source and a client. In another embodiment, the present invention advantageously reduces the size and processing complexity of data structures that may be used in conjunction with data transfers to a storage system. Additional benefit also may be derived from the self-descriptive nature of the present binary data structure. These and other benefits are described in more detail in the description that follows.
Reference throughout this specification to features, advantages, or similar language does not imply that all of the features and advantages that may be realized with the present invention should be or are in any single embodiment of the invention. Rather, language referring to the features and advantages is understood to mean that a specific feature, advantage, or characteristic described in connection with an embodiment is included in at least one embodiment of the present invention. Thus, discussion of the features and advantages, and similar language, throughout this specification may, but do not necessarily, refer to the same embodiment.
Furthermore, the described features, advantages, and characteristics of the invention may be combined in any suitable manner in one or more embodiments. One skilled in the relevant art will recognize that the invention can be practiced without one or more of the specific features or advantages of a particular embodiment. In other instances, additional features and advantages may be recognized in certain embodiments that may not be present in all embodiments of the invention.
These features and advantages of the present invention will become more fully apparent from the following description and appended claims, or may be learned by the practice of the invention as set forth hereinafter.
In order that the advantages of the invention will be readily understood, a more particular description of the invention briefly described above will be rendered by reference to specific embodiments that are illustrated in the appended drawings. Understanding that these drawings depict only typical embodiments of the invention and are not therefore to be considered to be limiting of its scope, the invention will be described and explained with additional specificity and detail through the use of the accompanying drawings, in which:
Many of the functional units described in this specification have been labeled as modules, in order to more particularly emphasize their implementation independence. For example, a module may be implemented as a hardware circuit comprising custom VLSI circuits or gate arrays, off-the-shelf semiconductors such as logic chips, transistors, or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices or the like.
Modules may also be implemented in software for execution by various types of processors. An identified module of executable code may, for instance, comprise one or more physical or logical blocks of computer instructions which may, for instance, be organized as an object, procedure, or function. Nevertheless, the executables of an identified module need not be physically located together, but may comprise disparate instructions stored in different locations which, when joined logically together, comprise the module and achieve the stated purpose for the module.
Indeed, a module of executable code could be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices. Similarly, operational data may be identified and illustrated herein within modules, and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set, or may be distributed over different locations including over different storage devices, and may exist, at least partially, merely as electronic signals on a system or network.
Reference throughout this specification to “one embodiment,” “an embodiment,” or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrases “in one embodiment,” “in an embodiment,” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.
Furthermore, the described features, structures, or characteristics of the invention may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided, such as examples of programming, software modules, user selections, network transactions, database queries, database structures, hardware modules, hardware circuits, hardware chips, etc., to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention can be practiced without one or more of the specific details, or with other methods, components, materials, and so forth. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the invention.
A code image is a fundamental set of computer instructions, similar to an operating system, which define how a computer system or subsystem will function. A code image also may be called microcode, embedded code, or the like. The code image typically includes assembly code instructions or raw machine language binary code instructions that are optimized for a particular microprocessor and/or set of hardware.
Periodically, the code image on a computer or hardware device must be updated to provide improved functionality, resolve programming bugs, and/or support new hardware. It is desirable that an old code image be updated with a new code image with minimal interruption of the computer system. The code image update should require minimal time, comprise operations of minimal complexity, and provide minimal delay in resuming regular operations once the update completes.
In one embodiment, a code image update may be performed by a section of an old code image known as the bootstrap code. The bootstrap code is executed in response to an interrupt signaling a code image update operation. In an alternate embodiment, the code image update may be performed at least in part by a section of a new code image. The bootstrap code may copy the new code image directly from a source media device, such as a disk drive, into a memory device connected to the hardware. Alternately, the bootstrap code may locate and process the new code image. The copy operation may partially or wholly overwrite the old code image with the new code image. This process is known as a code overlay. In one embodiment, the target 104 may receive the new code image from the source 102.
The illustrated s-record data structure 200 includes a type field 202, a length field 204, an address field 206, a data field 208, and a checksum field 210. Each s-record 200 is not more than 78 bytes in length. The type field 202 stores a type indicator that indicates the type of record that the s-record data structure 200 is. Table 1-1 outlines the various type indicators that currently exist. The length field 204 stores a length indicator that indicates the length of the composite address field 206, data field 208, and checksum field 210. The length indicator includes two hex characters and indicates the length in bytes, rather than characters.
The address field 206 stores an address indicator that indicates the memory address where the data in the data field 208 is to be stored. The address indicator may be four, six, or eight characters, corresponding to 16-, 24-, and 32-bit addresses, respectively. The data in the data field 208 is represented by hex characters. The checksum field 210 stores the one's compliment of the 8-bit checksum.
Type of S-Record
Optional Starting Record
Data Record, 16-bit address
Data Record, 24-bit address
Data Record, 32-bit address
Symbol Record (used by LSI ™)
Data Record Quantity
Ending Record (for S3 Record)
Ending Record (for S2 Record)
Ending Record (for S1 Record)
The target 104, upon receiving an s-record 200 from the source 102, may store 410 the s-record 200 in a memory buffer in the target 104 and check 412 the parity of the s-record 200 to verify that the s-record 200 was properly transmitted 408 and received. The target 104 then stores 414 the s-record 200 in the local memory on the target 104. Storing 414 the s-record in the local memory is discussed further with reference to
The illustrated s-record communication method 400 then determines 418 if additional s-records 200 need to be processed and, if so, returns to transmit 408 a subsequent ASCII s-record 200 from the source 102 to the target 104. After all of the available s-records 200 have been processed, the depicted s-record communication method 400 then ends 418.
The target 104 then stores 512 the data in binary format in the memory location identified by the address indicator in the address field 206. The s-record storage method 500 may proceed to determine 514 if additional s-records 200 need to be processed and, if so, returns to parse 504 a subsequent s-record 200. The depicted s-record storage method 500 ends 520 after all of the s-records 200 have been processed.
The CPUs 606, 614 are configured, in one embodiment, to process operational commands within the source 602 and target 604, respectively. The electronic memory devices 608, 616 are configured, in one embodiment, to store data and metadata that may be related to the operation of the source 602 and target 604, respectively. In one embodiment, the electronic memory device may comprise a computer readable storage medium. The MRB generation module 612 is configured, in one embodiment, to generate a microcode reconstruct and boot (MRB) data structure. The MRB structure will be discussed further with reference to
The source communications interface 610 is configured, in one embodiment, to send data from the source 602 to the target 604. The target communications interface 618 is configured, in one embodiment, to receive the data sent by the source 602. In a certain embodiment, the source 602 may comprise a storage system and the source communications interface 610 may comprise a host adapter. Additionally, the target 604 may be a host and the target communications adapter 618 may be a host bus adapter (HBA).
The image header 702 is configured to store metadata describing the MRB image 700 and its contents. The image header 702 will be discussed further with reference to
Each data segment 704, in one embodiment, includes a data header 708 and data 710. The data header 708 is configured to store metadata regarding the data 710 and will be discussed further with reference to
The alignment segment 706 also may include a data header 712 and data 714. In one embodiment, the alignment segment 706 is provided in the MRB image 700 solely to adjust the length of the MRB image 700 in order to facilitate error detection, error correction, and similar integrity checking. In a further embodiment of the MRB image 700, the alignment section 706 may be located at the beginning of the MRB image 700 or between data segments 704. Alternately, multiple alignment segments 706 may be included in the MRB image 700 and located jointly or in a distributed manner.
The architecture-specific descriptors 802 are stored in descriptor fields that have fixed byte allocations. In other words, the location and length of each architecture-specific descriptor field may be fixed within the MRB image 700. In one embodiment, for example, the first 128 bytes and last 128 bytes of a 512-byte MRB image header 800 maybe invariant with respect to their location, size, and content definition. The contents of these fields may change, but the field definition is invariant. For example, eight bytes may be reserved in every MRB image header 800 to store a version indicator, regardless of which version is actually indicated.
The customizable descriptors 804 of the MRB image header 800 may be variable in size, definition, and content depending on the application in which the MRB image 700 is implemented. The customizable descriptors 804, for example, may contain error check information, application-specific variables, and other variable data. In one embodiment, the customizable descriptors 804 include a table of contents or index that indicates the location of one or more executables stored within the data segments 704 of the MRB image 700.
The target address 902 indicates the memory location in which the corresponding data 710 in the data segment 704 is to be stored on the target 604. The segment size indicator 904 indicates the size of the subsequent set of data 710. There is no inherent limit on the size of the set of data 710 in the data segment 704. The flags 906, in one embodiment, may be configured to indicate characteristics or a certain status associated with the data 710 in the data segment 704. In a further embodiment, one or more flags 906 may be used to indicate the presence of a particular subset of data, such as an executable bootstrap module, within the data 710 in the data segment 704.
The source 602 then transmits 1106 the MRB image 700 to the target 604. Because the MRB image 700 is a true binary image, no conversion from ASCII characters is required prior to transmission. Upon receiving the MRB image 700, the target 604 may store 1108 the MRB image 700 in the local memory device 606, for example, in a buffer. While in the buffer, the target 602 may check 1110 the MRB image 700 using error detection, error correction, and other integrity checking techniques. In one embodiment, the MRB processing module 620 checks 1110 the MRB image 700. The MRB processing module 620 then may proceed to process 1112 the MRB image 700 according to the requesting application. The depicted MRB processing method 1100 then ends 1114.
The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US5216613 *||Aug 12, 1992||Jun 1, 1993||Texas Instruments Incorporated||Segmented asynchronous operation of an automated assembly line|
|US5848198 *||Jan 12, 1995||Dec 8, 1998||Penn; Alan Irvin||Method of and apparatus for analyzing images and deriving binary image representations|
|US5862143 *||Sep 16, 1996||Jan 19, 1999||Electronics And Telecommunications Research Institute||Byte aligner and frame synchronizer for 622 MBIT/S high-speed data|
|US6172980 *||Sep 11, 1997||Jan 9, 2001||3Com Corporation||Multiple protocol support|
|US6243081 *||Jul 31, 1998||Jun 5, 2001||Hewlett-Packard Company||Data structure for efficient retrieval of compressed texture data from a memory system|
|US6282642 *||Nov 18, 1998||Aug 28, 2001||International Business Machines Corporation||System for presetting a first or second remote boot protocol by a computer remotely receiving and storing a boot parameter prior to being powered on|
|US6408326 *||Apr 20, 1999||Jun 18, 2002||Microsoft Corporation||Method and system for applying a policy to binary data|
|US6438664 *||Oct 27, 1999||Aug 20, 2002||Advanced Micro Devices, Inc.||Microcode patch device and method for patching microcode using match registers and patch routines|
|US6467021 *||Oct 1, 1998||Oct 15, 2002||Memquest, Inc.||Data storage system storing data of varying block size|
|US6499137 *||Nov 20, 1998||Dec 24, 2002||Microsoft Corporation||Reversible load-time dynamic linking|
|US6580647 *||Aug 24, 2000||Jun 17, 2003||Sony Corporation||Editing apparatus, editing method, and non-volatile memory|
|US6807617 *||Apr 2, 2001||Oct 19, 2004||Advanced Micro Devices, Inc.||Processor, method and apparatus with descriptor table storing segment descriptors of varying size|
|US6839825 *||Jun 21, 2001||Jan 4, 2005||Mosaid Technologies, Inc.||Method and apparatus for logically expanding the width of memory|
|US7047283 *||Jun 9, 2000||May 16, 2006||Samsung Electronics Co., Ltd.||Apparatus and method of upgrading program of firmware board|
|US7155709 *||Mar 20, 2002||Dec 26, 2006||Stmicroelectronics Limited||Displaying user readable information during linking|
|US20030033280 *||May 15, 2002||Feb 13, 2003||Van Den Hamer Peter||Self-descriptive data tag|
|US20030051236 *||Sep 4, 2001||Mar 13, 2003||Pace Charles P.||Method, system, and structure for distributing and executing software and data on different network and computer devices, platforms, and environments|
|US20030120909 *||Dec 20, 2001||Jun 26, 2003||Zimmer Vincent J.||Boot process|
|US20030229707 *||Jun 6, 2002||Dec 11, 2003||Adc Telecommunications Israel Ltd.||Method and apparatus for rapid file transfer to embedded system|
|US20040022444 *||Nov 1, 2002||Feb 5, 2004||Rhoads Geoffrey B.||Authentication using a digital watermark|
|US20050114685 *||Nov 20, 2003||May 26, 2005||Blinick Stephen L.R.||Apparatus, system, and method for updating an embedded code image|
|US20060034189 *||Aug 11, 2004||Feb 16, 2006||International Business Machines Corporation||Apparatus, system, and method for controlling link status changes|
|EP0360241A2 *||Sep 20, 1989||Mar 28, 1990||Fujitsu Limited||Error correction system in a multicarrier radio transmission system|
|WO1990006647A1 *||Dec 5, 1989||Jun 14, 1990||Compuquest Inc||Method and system for data transmission, using forward error correction and frame interleaving|
|WO2002029624A1 *||Oct 4, 2001||Apr 11, 2002||Bullant Technology Pty Ltd||Data processing structure|
|WO2005055054A1 *||Oct 22, 2004||Jun 16, 2005||Ibm||Apparatus, system, and method for communicating a binary code image|
|1||*||Anderson,A et al. "the binary compatibility standard", thirty-fourth IEEE computer society international conference: intellectual leverage, digest of papers, 1989, pp. 32-37.|
|2||*||Cooper T et al. "The case for segments", fourth internatinal workshop on object-orientation in oerating systems, 1995, pp. 94-102.|
|3||D. M. Nagel and J. W. van den Berg., "Directorized Data Descriptor" IBM Technical Disclosure Bulletin, vol. 21, No. 7 (Dec. 1978), pp. 2653-2659. New York, New York.|
|4||*||Eero Lassila, "A macro expansion approach to embedded processor code generation", 1996.|
|5||*||Gordon Doughman, software specialist, Reference guide for SRecCvt, An S-record formatting program for the M68HC12 Microcontroller family, Motorola semiconductor, Mar. 21, 2001 pp. 1-9.|
|6||*||Jean-Claude Wippler, "An overview of the MetaKit daa format", Equi4 Software, Dec. 1999, 7 pages.|
|7||Li Feng, Yang Zhen, "Design of Booting System Based on Flash," Journals of Nanjing University of Posts and Telecommunications, vol. 23, No. 2.|
|8||*||System V application Binary interface-Draft-24,SCO, Chapter 5, program loading and dynamic linking, Apr. 2001.|
|9||*||Tong WB et al. "data structure for segmenting binary image", proceedings TENCON'93,vol. 2 IEEE, 1993, pp. 1146-1149.|
|10||*||Witold Litwin et al. "LH*RS: A highly available distributed data storage", proceedings of the 30th VLDB conference, 2004, pp. 1289-1292.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7631301 *||Feb 10, 2006||Dec 8, 2009||Microsoft Corporation||Customizing binary content files|
|US7877741 *||Oct 11, 2005||Jan 25, 2011||Industrial Technology Research Institute||Method and corresponding apparatus for compiling high-level languages into specific processor architectures|
|US8230412 *||Aug 31, 2007||Jul 24, 2012||Apple Inc.||Compatible trust in a computing device|
|US8789037||Jul 5, 2012||Jul 22, 2014||Apple Inc.||Compatible trust in a computing device|
|US20060130024 *||Feb 10, 2006||Jun 15, 2006||Microsoft Corporation||Customizing binary content files|
|US20060248262 *||Oct 11, 2005||Nov 2, 2006||Tay-Jyi Lin||Method and corresponding apparatus for compiling high-level languages into specific processor architectures|
|US20090063108 *||Aug 31, 2007||Mar 5, 2009||Dallas Blake De Atley||Compatible trust in a computing device|
|US20120110558 *||Oct 29, 2010||May 3, 2012||Microsoft Corporation||Customized binaries on-the-fly|
|U.S. Classification||1/1, 717/177, 341/89, 341/95, 717/164, 717/136, 341/88, 341/87, 707/999.101, 707/999.1, 707/999.01|
|International Classification||G06F17/30, G06F9/445|
|Cooperative Classification||G06F9/4401, Y10S707/99942|
|Nov 20, 2003||AS||Assignment|
Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CORCORAN, BRIAN J.;GEE, LOURDES M.;KALOS, MATTHEW J.;ANDOTHERS;REEL/FRAME:014746/0698
Effective date: 20031120
|Feb 18, 2005||AS||Assignment|
Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y
Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE NAMES OF ASSIGNORS PREVIOUSLY RECORDED ON REEL 014746 FRAME 0698;ASSIGNORS:CORCORAN, BRIAN JEFFREY;GEE, LOURDES MAGALLY;KALOS, MATTHEW JOSEPH;AND OTHERS;REEL/FRAME:015696/0469
Effective date: 20031120
|Nov 12, 2012||REMI||Maintenance fee reminder mailed|
|Mar 31, 2013||LAPS||Lapse for failure to pay maintenance fees|
|May 21, 2013||FP||Expired due to failure to pay maintenance fee|
Effective date: 20130331