|Publication number||US7257592 B2|
|Application number||US 10/607,567|
|Publication date||Aug 14, 2007|
|Filing date||Jun 26, 2003|
|Priority date||Jun 26, 2003|
|Also published as||CN1652109A, CN100403304C, US20040267843|
|Publication number||10607567, 607567, US 7257592 B2, US 7257592B2, US-B2-7257592, US7257592 B2, US7257592B2|
|Inventors||Hung T. Dinh, Phong A. Pham|
|Original Assignee||International Business Machines Corporation|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (33), Non-Patent Citations (19), Referenced by (8), Classifications (13), Legal Events (5)|
|External Links: USPTO, USPTO Assignment, Espacenet|
A portion of the disclosure of this patent document contains material to which the claim of copyright protection is made. The copyright owner has no objection to the facsimile reproduction by any person of the patent document or the patent disclosure, as it appears in the U.S. Patent and Trademark Office file or records, but reserves all other rights whatsoever.
An embodiment of the invention relates generally to the replication of binary large object data between character sets.
When computers were first developed, they mainly stored conventional numeric or character data. But today, computers are increasingly being used to store, access, and manipulate not only numeric and character data but also video images, still images, audio data, or a combination of types of data, which can require a large amount of storage. Because of their size, these types of data are often stored in databases in a special way in untyped objects called blobs (binary large objects). The blobs are untyped, meaning that the database system does not know the format of the data. Thus, blobs are typically stored in a database with only two attributes: a data value and a data length, which is the length of the data value.
The lack of formatting information causes a problem when attempting to convert blob data between languages when the blob data type is used to store character data. Modem computers are capable of supporting multiple languages with different character sets and converting their data between them. For example, the English language uses different characters than does the Russian, Chinese, Japanese, or Korean languages, and users would like to be able to convert their data between the different languages using a conversion program. Unfortunately, since blob data is untyped, the conversion program is unable to convert the blob data. In order to take advantage of blob data and to provide support for multiple languages, what is needed is a technique for converting blob data objects between languages.
A method, apparatus, processor, system, and signal-bearing medium are provided that in an embodiment determine that blob (binary large object) data in a source field is associated with a source CCSID (Coded Character Set Identifier), determine a target CCSID for a target field, and replicate the blob data from the source field to the target field based on the source CCSID and the target CCSID. In this way, blob data can be converted between languages.
The electronic device 102 includes a processor 110 connected directly or indirectly to a storage device 115, an input device 120, and an output device 122 via a bus 125. The processor 110 represents a central processing unit of any type of architecture, such as a CISC (Complex Instruction Set Computing), RISC (Reduced Instruction Set Computing), VLIW (Very Long Instruction Word), or a hybrid architecture, although any appropriate processor may be used. Although not depicted in
The processor 110 executes instructions and includes that portion of the electronic device 102 that controls the operation of the entire electronic device. The processor 110 reads and/or stores code and data to/from the storage device 115 and/or the network 105, reads data from the input device 120 and writes data to the output device 122.
Although the electronic device 102 is shown to contain only a single processor 110 and a single bus 125, the present invention applies equally to electronic devices that may have multiple processors and multiple buses with some or all performing different functions in different ways.
The storage device 115 represents one or more mechanisms for storing data. For example, the storage device 115 may include random access memory (RAM), removable or fixed magnetic-disk storage media, optical storage media, flash memory devices, and/or other machine-readable media. In other embodiments, any appropriate type of storage device may be used. Although only one storage device 115 is shown, multiple storage devices and multiple types and levels of storage devices may be present. Further, although the electronic device 102 is drawn to contain the storage device 115, it may be distributed across other electronic devices, for example electronic devices connected via a network, such as the network 105.
The storage device 115 includes a source database 126, a target database 128, and a replication controller 140.
The source database 126 contains data to be converted. In an embodiment the source database 126 is a relational database, but in other embodiments, any appropriate data repository may be used. The target database 128 contains data converted from the source database 126. In an embodiment, the target database 128 is a relational database, but in other embodiments, any appropriate data repository may be used. Although the source database 126 and the target database 128 are shown to be within the storage device 115 in the electronic device 102, in other embodiments they may be contained in different storage devices and may be within different electronic devices, e.g., in or associated with different electronic devices connected via the network 105. The source database 126 and the target database 128 are further described below with reference to
The replication controller 140 may include instructions capable of being executed by the processor 110 and/or statements capable of being interpreted by instructions that execute on the processor 110. In another embodiment, some or all of the functions of the replication controller 140 may be implemented via logic gates and/or other hardware mechanisms in lieu of or in addition to a processor-based system. The replication controller 140 replicates the source database 126 to the target database 128 while translating select fields in the database. The functions of the replication controller 140 are further described below with reference to
The input device 120 may be a keyboard, mouse or other pointing device, trackball, touchpad, touchscreen, keypad, microphone, voice recognition device, or any other appropriate mechanism for the user to input data to the electronic device 102. Although only one input device 120 is shown, in another embodiment any number and type of input devices may be present. In an embodiment, a user may use the input device 120 to invoke the replication controller 140, but in other embodiments the replication controller 140 may be invoked from another routine or via any other appropriate mechanism.
The output device 122 is that part of the electronic device 102 that presents output to the user. The output device 122 may be a cathode-ray tube (CRT) based video display well known in the art of computer hardware. But, in other embodiments the output device 122 may be replaced with a liquid crystal display (LCD) based or gas, plasma-based, flat-panel display. In still other embodiments, any appropriate display device may be used. In other embodiments, a speaker or a printer may be used. In other embodiments any appropriate output device may be used. Although only one output device 122 is shown, in other embodiments, any number of output devices of different types or of the same type may be present.
The bus 125 may represent one or more busses, e.g., PCI (Peripheral Component Interconnect), ISA (Industry Standard Architecture), X-Bus, EISA (Extended Industry Standard Architecture), or any other appropriate bus and/or bridge (also called a bus controller).
The electronic device 102 may be implemented using any suitable hardware and/or software, such as a personal computer. Portable computers, laptop or notebook computers, PDAs (Personal Digital Assistants), pocket computers, telephones, pagers, automobiles, teleconferencing systems, appliances, and mainframe computers are examples of other possible configurations of the electronic device 102. The hardware and software depicted in
The network 105 may be any suitable network or combination of networks and may support any appropriate protocol suitable for communication of data and/or code to/from the electronic device 102. In various embodiments, the network 105 may represent a storage device or a combination of storage devices, either connected directly or indirectly to the electronic device 102. In an embodiment, the network 105 may support Infiniband. In another embodiment, the network 105 may support wireless communications. In another embodiment, the network 105 may support hard-wired communications, such as a telephone line or cable. In another embodiment, the network 105 may support the Ethernet IEEE (Institute of Electrical and Electronics Engineers) 802.3x specification. In another embodiment, the network 105 may be the Internet and may support IP (Internet Protocol). In another embodiment, the network 105 may be a local area network (LAN) or a wide area network (WAN). In another embodiment, the network 105 may be a hotspot service provider network. In another embodiment, the network 105 may be an intranet. In another embodiment, the network 105 may be a GPRS (General Packet Radio Service) network. In another embodiment, the network 105 may be any appropriate cellular data network or cell-based radio network technology. In another embodiment, the network 105 may be an IEEE 802.11B wireless network. In still another embodiment, the network 105 may be any suitable network or combination of networks. Although one network 105 is shown, in other embodiments any number of networks (of the same or different types) may be present.
As will be described in detail below, aspects of an embodiment of the invention pertain to specific apparatus and method elements implementable on a computer, processor, or other electronic device. In another embodiment, the invention may be implemented as a program product for use with a computer, processor, or other electronic device. The programs defining the functions of this embodiment may be delivered to the computer, processor, or other electronic device via a variety of signal-bearing media, which include, but are not limited to:
(1) information permanently stored on a non-rewriteable storage medium, e.g., a read-only memory device attached to or within a computer, processor, or other electronic device, such as a CD-ROM readable by a CD-ROM drive;
(2) alterable information stored on a rewriteable storage medium, e.g., a hard disk drive or diskette; or
(3) information conveyed to a computer, processor, or other electronic device by a communications medium, such as through a computer or a telephone network, e.g., the network 105, including wireless communications.
Such signal-bearing media, when carrying machine-readable instructions that direct the functions of the present invention, represent embodiments of the present invention.
The table 201 also includes fields 208 and 210. In the example shown, the field 208 includes “last name” for the column name in the column 202, “blob-c” (binary large object-character) for the type name in the column 204, and “70” for the maximum length in the column 206. The blob-c type name indicates that the attributes data structure 212 is present and contains a CCSID (Coded Character Set Identifier), as further described below. In the example shown, the field 210 includes “first name” for the column name in the column 202, “blob” (binary large object) for the type name in the column 204, and “70” for the maximum length in the column 206. Although two fields 208 and 210 are shown, in other embodiments any appropriate number of fields may be present. Although blob-c and blob are illustrated as example type names, in other embodiments, the type names may be binary, character, or any other appropriate data type.
The attributes 212 includes a length field 214, a CCSID (Coded Character Set Identifier) field 216, and a data field 218. The length field 214 specifies the actual length of the data field 218 while the maximum length field 206 specifies the maximum length of the attributes. A CCSID identifies a group of character sets, code pages, and encoding schemes. A CCSID is often used for languages that use multiple code pages, but in other embodiments, a CCSID may be used for any language. Examples of a languages with multiple code pages are Japanese and Korean, although in other embodiments any appropriate language may be used. A character set is a group of characters. An example of a character set is DBCS (Double Byte Character Set), but in other embodiments any appropriate character set may be used.
A code page is a group of specifications of code points (e.g., integer numbers) for each character in the character set. The exact code point value for a character in a character set is found using the code page.
An encoding scheme is a plan for the encoding and/or decoding of characters. When a character is converted from one code page to another, the encoding scheme controls the conversion.
The CCSID 240 is applicable to the entire source database 126 and all data in the source database 126 is stored using the CSSID 240. In contrast, the BLOB-C attribute has its own CCSID 216, which is stored at the record level, i.e., in some embodiments each row in a table may have a different CCSID. When the replication controller 140 (
The data shown in the table 201 and the attributes 212 is exemplary only and any appropriate data may be used.
The table 301 also includes fields 308 and 310. In the example shown, the field 308 includes “last name” for the column name in the column 302, “character” for the type name in the column 304, and “70” for the maximum length of the attributes 312 in the column 306. The “character” data type name indicates that the attributes data structure 312 is present and uses the value in the CCSID field 307, which is defined at the database level. The use of “character” as a data type may refer in various embodiments to any type of character data, such as CHARACTER, VARCHAR (Variable Character), CLOB (Character Large Object), or any other appropriate type of character data. A CCSID identifies a group of character sets, code pages, and encoding schemes.
In the example shown, the field 310 includes “first name” for the column name in the column 302, “blob” for the type name in the column 304, and “70” for the maximum length in the column 306. Although two fields 308 and 310 are shown, in other embodiments any appropriate number of fields may be present. Although “character” and “blob” are illustrated as example type names, in other embodiments, the type names may be binary or any other appropriate data type.
The attributes 312 includes a length field 314, and a data field 318. The length field 314 specifies the actual length of the data field 318 while the maximum length field 306 specifies the maximum length of the attributes 312.
The CCSID 307 identifies a group of character sets, code pages, and encoding schemes. A code page is a group of specifications of code points (e.g., integer numbers) for each character in the character set. The exact code point value for a character in a character set is found using the code page.
An encoding scheme is a plan for the encoding and/or decoding of characters. When a character is converted from one code page to another, the encoding scheme controls the conversion. An example of an encoding scheme used in an embodiment is UTF-8 (Universal Character Set Transformation-8), which is defined by ISO (International Standards Organization) 10646-1:2000 Annex D and is also described in RFC (Request for Comments) 2279. But in other embodiments, UTF-16, UTF-32, or any other appropriate encoding scheme may be used.
The data shown in the table 301 and the attributes 312 is exemplary only and any appropriate data may be used.
If the determination at block 405 is true, then replication of the database 126 is not yet complete, so control continues to block 410 where the replication controller 140 reads the next field from the source database 126. Using the example shown in
Control then continues to block 415 where the replication controller 140 determines whether the data type name in the source database 126 is blob-c (blob character). The blob-c data type signifies that the blob data has an associated CCSID. In the example shown in
If the determination at block 415 is true, then control continues to block 425 where the replication controller 140 determines whether the data type name in the target database 128 is blob or blob-c (blob character). In the example shown in
If the determination at block 425 is false, then control continues to block 430 where the replication controller 140 determines whether the data type name in the target database 128 is character. If the determination at block 430 is false, then control continues to block 499 where the replication controller 140 returns an error since, in an embodiment, the replication controller 140 is not able to translate data of type blob-c (blob character) to data types other than blob, blob-c (blob character), or character. But, in other embodiments, the replication controller can translate any appropriate data types.
If the determination at block 430 is true, then control continues to block 435 where the replication controller 140 replicates the value in the field and converts the blob-c data to the character type having the target CCSID 307. The data is converted from the source CCSID 216 to the target CCSID 307 using a normal conversion method. In an embodiment, a mapping file is used to map characters from the source CCSID 216 to the target CCSID 307, but in other embodiments any appropriate conversion technique may be used. In the examples of
In the previous detailed description of exemplary embodiments of the invention, reference was made to the accompanying drawings (where like numbers represent like elements), which form a part hereof, and in which is shown by way of illustration specific exemplary embodiments in which the invention may be practiced. These embodiments were described in sufficient detail to enable those skilled in the art to practice the invention, but other embodiments may be utilized and logical, mechanical, electrical, and other changes may be made without departing from the scope of the present invention. Different instances of the word “embodiment” as used within this specification do not necessarily refer to the same embodiment, but they may. The previous detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims.
In the previous description, numerous specific details were set forth to provide a thorough understanding of the invention. But, the invention may be practiced without these specific details. In other instances, well-known circuits, structures, and techniques have not been shown in detail in order not to obscure the invention.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US5878220 *||Nov 4, 1997||Mar 2, 1999||Oracle Corporation||Method and apparatus for storing and transferring data on a network|
|US6078920||Jan 29, 1998||Jun 20, 2000||International Business Machines Corporation||Computer program product and apparatus for retrieval of OLE enabled BLOBs from an RDBMS server|
|US6094587 *||Dec 22, 1997||Jul 25, 2000||Nokia Mobile Phones Ltd.||Programming of a telephone's ringing tone|
|US6112024||Oct 2, 1996||Aug 29, 2000||Sybase, Inc.||Development system providing methods for managing different versions of objects with a meta model|
|US6233545 *||Mar 3, 1998||May 15, 2001||William E. Datig||Universal machine translator of arbitrary languages utilizing epistemic moments|
|US6275789 *||Dec 18, 1998||Aug 14, 2001||Leo Moser||Method and apparatus for performing full bidirectional translation between a source language and a linked alternative language|
|US6275831||Aug 18, 1998||Aug 14, 2001||Starfish Software, Inc.||Data processing environment with methods providing contemporaneous synchronization of two or more clients|
|US6356946||Jan 19, 1999||Mar 12, 2002||Sybase Inc.||System and method for serializing Java objects in a tubular data stream|
|US6370531 *||Aug 21, 1998||Apr 9, 2002||International Business Machines Corporation||Method and computer program product for automatic conversion of data based on location extension|
|US6370541 *||Sep 21, 1999||Apr 9, 2002||International Business Machines Corporation||Design and implementation of a client/server framework for federated multi-search and update across heterogeneous datastores|
|US6424976 *||Mar 23, 2000||Jul 23, 2002||Novell, Inc.||Method of implementing a forward compatibility network directory syntax|
|US6427230 *||Nov 9, 1998||Jul 30, 2002||Unisys Corporation||System and method for defining and managing reusable groups software constructs within an object management system|
|US6446133 *||Mar 30, 2001||Sep 3, 2002||I-Dns.Net International Pte Ltd.||Multi-language domain name service|
|US6453356 *||Apr 15, 1998||Sep 17, 2002||Adc Telecommunications, Inc.||Data exchange system and method|
|US6453462 *||Jun 29, 1999||Sep 17, 2002||International Business Machines Corporation||Mock translation system, method, and program using multi-byte placeholder characters to test translatability of software that will display multi-byte languages|
|US6560596 *||Aug 30, 1999||May 6, 2003||Multilingual Domains Llc||Multiscript database system and method|
|US6615219 *||Dec 29, 1999||Sep 2, 2003||Unisys Corporation||Database management system and method for databases having large objects|
|US6732109 *||Jan 31, 2001||May 4, 2004||The Eon Company||Method and system for transferring information between a user interface and a database over a global information network|
|US6745209 *||Aug 15, 2001||Jun 1, 2004||Iti, Inc.||Synchronization of plural databases in a database replication system|
|US6961681 *||Nov 16, 2000||Nov 1, 2005||Microsoft Corporation||System and method providing virtual applications architecture|
|US7065484 *||Feb 22, 2002||Jun 20, 2006||Dell Products L.P.||Method and systems for screening Chinese address data|
|US20020032027 *||Jan 11, 2001||Mar 14, 2002||Shekhar Kirani||Media spooler system and methodology providing efficient transmission of media content from wireless devices|
|US20020116405||Aug 13, 2001||Aug 22, 2002||Starfish Software, Inc.||Data processing environment with methods providing contemporaneous synchronization of two or more clients|
|US20030046317 *||Apr 19, 2001||Mar 6, 2003||Istvan Cseri||Method and system for providing an XML binary format|
|US20030208511 *||Apr 30, 2003||Nov 6, 2003||Earl Leroy D.||Database replication system|
|EP0698243A1 *||May 12, 1994||Feb 28, 1996||Apple Computer, Inc.||Storage manager for computer system|
|EP1331579A2 *||Jan 24, 2003||Jul 30, 2003||ROLLS-ROYCE plc||Databases|
|JPH1011464A||Title not available|
|JPH1097456A||Title not available|
|JPH11143883A||Title not available|
|WO1999028835A2 *||Nov 30, 1998||Jun 10, 1999||Koninklijke Philips Electronics N.V.||Apparatus and method for optimizing keyframe and blob retrieval and storage|
|WO2003044737A1 *||Oct 28, 2002||May 30, 2003||Koninklijke Philips Electronics N.V.||Computer vision method and system for blob-based analysis using a probabilistic framework|
|WO2005083594A1 *||Jul 29, 2004||Sep 9, 2005||Microsoft Corporation||Systems and methods for a large object infrastructure in a database system|
|1||Andrew Laursen et al., Oracle Media Server: Providing Consumer Based Interactive Access to Multimedia Data, ACM, 1994, pp. 470-477.|
|2||Brian Sayrs, Architecting Multimedia Database Systems, Feb. 1997, Object Magazine, pp. 53-57.|
|3||*||Dvir,G et al. "context-based image modelling", proceedings, 16th internatinal conference on pattern recognition, 2002, vol. 4, pp. 162-165.|
|4||Edward Grabczewski et al., 3D Murale: Multimedia Database System Architecture, Association for Computing Machinery, 2002, pp. 315-321.|
|5||Giho Choi et al., Providing Multiple BLOB Types for Efficient Storage of Multimedia-Data, vol. 22, No. 10, Oct. 1995, Journal off KISS (B) : Software and Applications, pp. 1404-1415, only abstract p. 1404.|
|6||INSPEC abstract Providing Multiple BLOB Types for Efficient Storage of Multimedia Data, Giho Choi et al., Journal of KISS (B) (Software and Applications), vol. 22, No. 10, pp. 1414-1415, Oct. 1995, only abstract.|
|7||INSPEC abstract, Embedding Image Query Operations in an Object-Relational Database Management System, M. et al., Illustra Inf. Technol. Inc., Proceedings of the SPIE-The International Society for Optical Engineering, vol. 2420, pp. 197-203, 1995.|
|8||*||Jim Gray et al. "scientific data management in the coming decade", Technical Report MSR-TR-2005-01 Microsoft research, Jan. 2005.|
|9||Michael Ubell et al., Embedding Image Query Operations in an Object-Relational Database Management System, Feb. 9-10, 1995, SPIE vol. 2420, pp. 197-203.|
|10||*||Oracle 9i database globalization support guide release 2 (9.2), part No. A96529-01, copy right 2002, 20 pages.|
|11||*||Oracle 9i database globalization support guide release 2 (9.2), part No. A96529-01, copy right 2002, 21 pages.|
|12||Paul Dourish et al., Extending Document Management Systems with User-Specific Active Properties, ACM Transactions on Information Systems, vol. 18, No. 2, Apr. 2000, pp. 140-154.|
|13||*||Preethi Vishwanath, "Efficient replication of XML documents with BLOB data", CS297 Report, Dec. 2006.|
|14||*||Qian,R.J et al. "Image retrieval using blob histograms", IEEE internatinal conference on multimedia and expo, 2000, vol. 1, pp. 125-128.|
|15||Randal Burns et al., Version Management and Recoverability for Large Object Data.|
|16||*||Said,J et al. "transformatin of binary relations", The sixth international conference on computer supported cooperative work in design, 2001, pp. 575-580.|
|17||*||Sangho Park et al. segmentation and tracking of interacting human body parts under occlusion and shadowing, IEEE procedings of the workshop on motion and video computing, 2002, 7 pages.|
|18||*||Secom Co. Ltd. "Database Schema Design Strategy in Relational Database", VTT-MEMO-ADA-02, Aug. 6, 2001, 3 pages.|
|19||*||Shapiro,M et al. "managing databases with binary large objects", Mass storage systems, 1999, 16th IEEE symposium , 1999, pp. 185-193.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US8510304 *||Aug 27, 2010||Aug 13, 2013||Amazon Technologies, Inc.||Transactionally consistent indexing for data blobs|
|US8510344 *||Aug 27, 2010||Aug 13, 2013||Amazon Technologies, Inc.||Optimistically consistent arbitrary data blob transactions|
|US8621161||Sep 23, 2010||Dec 31, 2013||Amazon Technologies, Inc.||Moving data between data stores|
|US8688666||Aug 27, 2010||Apr 1, 2014||Amazon Technologies, Inc.||Multi-blob consistency for atomic data transactions|
|US8856089||Aug 27, 2010||Oct 7, 2014||Amazon Technologies, Inc.||Sub-containment concurrency for hierarchical data containers|
|US9112935 *||Dec 13, 2012||Aug 18, 2015||Microsoft Technology Licensing, Llc||Manipulating binary large objects|
|US9544400||Jul 13, 2015||Jan 10, 2017||Microsoft Technology Licensing, Llc||Manipulating binary large objects|
|US20130232190 *||Dec 13, 2012||Sep 5, 2013||Microsoft Corporation||Manipulating binary large objects|
|U.S. Classification||1/1, 704/8, 707/E17.006, 707/999.101, 707/999.1, 707/999.001|
|International Classification||G06F17/00, G06F17/30, G06F17/20|
|Cooperative Classification||Y10S707/99931, Y10S707/99942, G06F17/30569|
|Jun 26, 2003||AS||Assignment|
Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:DINH, HUNG T.;PHAM, PHONG A.;REEL/FRAME:014240/0908
Effective date: 20030625
|Jan 29, 2011||FPAY||Fee payment|
Year of fee payment: 4
|Mar 27, 2015||REMI||Maintenance fee reminder mailed|
|Aug 14, 2015||LAPS||Lapse for failure to pay maintenance fees|
|Oct 6, 2015||FP||Expired due to failure to pay maintenance fee|
Effective date: 20150814