CN102591993A - Asynchronous processing method and device for hotlist data update - Google Patents

Asynchronous processing method and device for hotlist data update Download PDF

Info

Publication number
CN102591993A
CN102591993A CN2012100356356A CN201210035635A CN102591993A CN 102591993 A CN102591993 A CN 102591993A CN 2012100356356 A CN2012100356356 A CN 2012100356356A CN 201210035635 A CN201210035635 A CN 201210035635A CN 102591993 A CN102591993 A CN 102591993A
Authority
CN
China
Prior art keywords
time
data
updated
update
non real
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012100356356A
Other languages
Chinese (zh)
Inventor
何敏华
蔡凌玮
韦东俊
邓校锋
梁柱标
刘圣杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN2012100356356A priority Critical patent/CN102591993A/en
Publication of CN102591993A publication Critical patent/CN102591993A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention discloses an asynchronous processing method and an asynchronous processing device for hotlist data update. The method comprises the following steps of: (a), acquiring data to be updated containing data update information, data processing state and timestamp, and extracting delayed update data from the data to be updated; (b), generating current time range start time T2 according to rollback time delta T1 and last time range end value T1, and generating current time range end time according to the current time T3 of a system; (c), selecting the delayed update data of which timestamp is between T1 and the current time T3 of the system from the delayed update data to carry out update; and (d), updating the T1 to the T3, updating the last startup end time to the current time T4, and updating the operation mentoring time to the current time T4. By the method and the device, the bottleneck problem about real-time update of hotlist records can be solved, the condition that the records to be processed are missed during asynchronous processing is avoided, and the integral operating efficiency and the reliability of the system are improved.

Description

A kind of asynchronous processing method and device that is used for the hotlist Data Update
Technical field
The invention relates to microcomputer data processing, particularly about a kind of asynchronous processing method and device that is used for the hotlist Data Update.
Background technology
On line data is handled according to the ageing of data processing can be divided into real-time update and two kinds of non real-time renewals.The data that need real-time update are the data of having relatively high expectations to ageing, after operating, the user in database, obtain at once embodying, and the result that the subsequent user operation must draw based on preceding single job, and relevant with the data manipulation sequencing; The data that do not need real-time update are to ageing less demanding data, do not need after the user operates in tables of data, to embody at once, only need in certain time interval, embody getting final product, and follow-up each user's operation is not necessarily based on the result of preceding single job.
In large-scale system of commercial bank; Because the business processing amount is huge, can fight for system resource during the renewal of various system datas, and updating data has exclusiveness; Promptly when Data Update, must write down the reading that locks, occur bottleneck when having caused hotlist record real-time update data.For example: the traffic volume measurement data, phase 8 hour in need be updated 100 ten thousand time in peak traffic every day, promptly need be updated 34 times average p.s..If this data also adopt the mode of real-time update to upgrade; Because the updating data temperature is high; And Data Update has exclusiveness, can cause the on line data processing latency longer, the long expense that influences user's operation and the operation of increase system of system operation time.So for upgrading temperature height and the ageing less demanding data of Data Update; Can adopt non real-time data updated update mode; From real time data is upgraded, detach out and carry out asynchronous operation, improve the overall operation speed of in-line processing this part Data Update.
Prior art can be treated deal with data and carry out full table scan when non-real-time data is carried out asynchronous process, is untreated record so that find out treatment state.Generally need the data volume of asynchronous process huge, handle all full dose at every turn and scan pending tables of data and find out the record that is untreated, can cause treatment effeciency low unusually.To this situation; A kind of in addition processing mode is to confirm earlier the time range of this processing, and the record that is untreated in the scope between is at this moment handled, and confirms follow-up time range next time more successively; Carry out asynchronous data and handle, search the efficient of pending data with raising.
But the processing mode of this definite time range makes some record that is in the time range critical value exist by the possibility of drain process.The reason that produces drain process mainly is to have the regular hour poor because the timestamp of data recording and data recording really appear between the time point on the tables of data.When data recording generated, system had registered a timestamp according to the current time for it, but after this record possibly also can carry out other special operational, record just really was inserted in the tables of data.As shown in Figure 1, newly-increased SQL timestamp carried out in a pending a record is 10:00, also possibly also can carry out other inquiry, newly-increased, deletion SQL after newly-increased, to 10:01 just to before the operation unification do COMMIT (submission) processing and really be written in the tables of data.This mistiming is very small perhaps; But concerning computing machine; The time of this scanning this bar (or some) record when 10:00 does not appear in the tables of data; Scanning next time zero-time then causes the meeting of these (or some) record by drain process for the timestamp of " greater than 10:00 " this record is that 10:00 does not meet the time requirement of scanning next time again.
Therefore, need a solution, can either solve the bottleneck problem of hotlist record real-time update, can avoid again carrying out occurring in the asynchronous process process situation that pending record is omitted in that non real-time is Updated Information.
Summary of the invention
The present invention provides a kind of asynchronous processing method and device that is used for the hotlist Data Update, to solve the bottleneck problem of hotlist record real-time update, occurs the situation that pending record is omitted when avoiding asynchronous process.
To achieve these goals; The present invention provides a kind of asynchronous processing method that is used for the hotlist Data Update; This method comprises: step a: obtain the data to be updated that comprise Data Update information, data processing state and timestamp, and Update Information from said extracting data non real-time to be updated; Step b: according to rollback time Δ T1 and last time time range end value T1 generate this time range start time T2, and generate the concluding time of this time range according to current time in system T3; Step c: select time stabs the non real-time fall between T1 and the current time in system T3 and Updates Information and carry out update processing from said non real-time Updates Information; Steps d: said T1 is updated to T3, will starts the concluding time last time to be updated to current time T4, the operation monitoring time is updated to current time T4.
Further; After steps d; Described method also comprises: judge automatic interval time Δ T2 and described operation monitoring time sum whether greater than work at present time T 5; If equal said automatic interval time of Δ T2 and when starting concluding time T4 sum last time, repeating step b in current system time.
Further, if interval time, Δ T2 and described operation monitoring time sum were to be not more than work at present time T 5, the output abnormality information automatically.
Further, when receiving the exception handling instruction of user's input, repeating step b.
Further, after step c, described method also comprises: will accomplish treatment state that the non real-time of update processing Updates Information and be updated to and handle.
To achieve these goals; The present invention provides a kind of asynchronous process device that is used for the hotlist Data Update; This device comprises: data extracting unit; Be used to obtain the data to be updated that comprise Data Update information, data processing state and timestamp, and Update Information from said extracting data non real-time to be updated; The time range generation unit, be used for according to rollback time Δ T1 and last time time range end value T1 generate this time range start time T2, and generate the concluding time of this time range according to current time in system T3; Data are selected updating block, are used for falling into non real-time between T1 and the current time in system T3 and Updating Information and carry out update processing from the said non real-time select time stamp that Updates Information; The time updating block is used for said T1 is updated to T3, will start the concluding time last time to be updated to current time T4, and the operation monitoring time is updated to current time T4.
Further, this device also comprises: the time judging unit, be used to judge automatic interval time Δ T2 and described operation monitoring time sum whether greater than work at present time T 5.
Further, this device also comprises: the abnormal prompt unit, be used for when automatic interval time Δ T2 and described operation monitoring time sum be when being not more than work at present time T 5, the output abnormality information.
Further, this device also comprises: the command reception unit is used to receive the exception handling instruction that the user imports.
Further, this device also comprises: state updating unit is used for the treatment state that the non real-time of accomplishing update processing Updates Information is updated to and handles.
The beneficial effect of the embodiment of the invention is; Through being separated, non real-time deal with data and real-time processing data carry out asynchronous process; Make and in a large number ageing less demanding data can be upgraded by non real-time, avoid system the low problem of hot spot table update efficiency to occur.When the asynchronous process data, adopted and confirmed each time range of handling, search pending record through time range, avoided full dose to scan pending record sheet, the problem that search efficiency is low, system overhead is big.
Through adopting the method for time rollback scope computing time; The time range of twice asynchronous process covers mutually before and after making; Be in some record of time range critical value; Even need carry out could really being registered in the pending record sheet after the various special processings, can not omitted by twice asynchronous process in front and back yet, improved the reliability of system.
Asynchronous process is monitored, under abnormal conditions, can in time be reminded the user, improved the security of data processing.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art; To do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.In the accompanying drawings:
Fig. 1 is prior art record drain process synoptic diagram;
Fig. 2 is used for the asynchronous process apparatus structure synoptic diagram of hotlist Data Update for the embodiment of the invention;
Fig. 3 is the structured flowchart of embodiment of the invention data storage device;
Fig. 4 is the structured flowchart of embodiment of the invention asynchronous process device;
Fig. 5 is an embodiment of the invention time range synoptic diagram;
Fig. 6 is the structured flowchart of embodiment of the invention asynchronous process starter gear;
Fig. 7 is used for the structured flowchart of the asynchronous process device of hotlist Data Update for the embodiment of the invention;
Fig. 8 is the asynchronous processing method process flow diagram of embodiment of the invention hotlist Data Update.
Embodiment
For the purpose, technical scheme and the advantage that make the embodiment of the invention is clearer, the embodiment of the invention is explained further details below in conjunction with accompanying drawing.At this, illustrative examples of the present invention and explanation thereof are used to explain the present invention, but not as to qualification of the present invention.
As shown in Figure 2, present embodiment provides a kind of asynchronous process device that is used for the hotlist Data Update, and this device comprises: data screening device 1, data storage device 2, asynchronous process device 3, parameter setting apparatus 4 and asynchronous process starter gear 5.
Data screening device 1, asynchronous process device 3 and parameter setting apparatus 4 are connected with data storage device 2 respectively, and asynchronous process starter gear 5 is connected with asynchronous process device 3, and data screening device 1 externally is connected in banking system 6.Asynchronous process device 3 can be equipment such as single-chip microcomputer or FPGA.
The function of data screening device 1 is to receive the data that banking system 6 need be upgraded operation; The row filter of going forward side by side; Being judged as the real-time update data as if the data that need upgrade operation then directly upgrades operation and withdraws from processing; Data Update is treated to the state of the art, repeats no more at this.Be judged as non real-time as if the data that need upgrade operation and Update Information, this non real-time is Updated Information store data storage device 2 into, as pending data recording.Data screening device 1 is the data monitoring communication interface, can comprise: interfaces such as serial ports or USB mouth, and data reception module and data transmission blocks.
The function of data storage device 2 is temporary transient each time value that generates in storage pending data recording, system operational parameters and the operational process.As shown in Figure 3, data storage device 2 comprises parameter storage unit 21, time temporary storage location 22 and pending record storage unit 23.
Parameter storage unit 21 can be used for storage system operation desired parameters, and is as shown in table 1, and system's operation desired parameters comprises at least: rollback time, self-starting interval time parameter.The required parameter of using when wherein, " rollback time " parameter is asynchronous process device scope 3 computing time; " self-starting interval time " parameter is to confirm to start the required parameter of using of time of asynchronous process device 3 next time, and whether normally asynchronous process starter gear 5 judges the asynchronous process device 3 required parameter of using of operation.
Table 1
The constant title Constant value
The rollback time t
Self-starting interval time W
Time temporary storage location 22 is used for storing asynchronous process device 3 and is carrying out each item time numerical value that data handling procedure is obtained; As shown in table 2, each item time numerical value mainly comprises: start last time time range end value, last time concluding time, operation monitoring time three records." time range end value last time " preserved the end value of the time range of last transaction processing, is used to calculate the starting value of the time range of issued transaction next time; " start the concluding time last time " and preserved the end of run time of last asynchronous process device 3 data processing, be used to calculate the time that next time starts asynchronous process device 3; Whether " operation monitoring time " is preserved each working time of handling, be used to judge asynchronous process normally operation.
Table 2
Field Field value
Last time the time range end value T
Started the concluding time last time W
The operation monitoring time M
The non real-time that pending record storage unit 23 is used to pending processing such as storing Updates Information, and is as shown in table 3, and non real-time Updates Information and comprises at least: Data Update information, treatment state, timestamp three partial contents." Data Update information " preservation need be upgraded the concrete data message of operation; " treatment state " is used to write down the treatment state of pending record, and record is defaulted as 0-when newly-increased and is untreated, and after being handled by asynchronous process device 3, is updated to 1-and handles; Timestamp when " timestamp " writes down this data message and generate, asynchronous process device 3 through the time range that calculates issued transaction after, judge whether " timestamp " falls into this time range, and whether decision is handled these data.
Table 3
Figure BDA0000136138040000071
The function of asynchronous process device 3 is to confirm the time range of this issued transaction through the time rollback; Pending record to falling into time range carries out update processing; Then; Calculate start-up time next time, start asynchronous process device 3 automatically and when start-up time next time, carry out pending recording processing once more.As shown in Figure 4, asynchronous process device 3 comprises: time rollback unit 31, data processing unit 32 and self-starting unit 33.
Time rollback unit 31 is used to calculate the time range of this issued transaction, so that the data message of selecting needs to handle according to this time range.At first, the value Δ T1 of " rollback time " parameter in the parameter storage unit 21 in the time rollback unit 31 reading of data memory storages 2; Time temporary storage location 22 obtains " time range end value last time " in the reading of data memory storage 2, is assumed to be T1; Then, T1 deducts " rollback time " Δ T1 with " time range end value last time ", obtains time value T2 as this time range starting value, and obtaining the current time in system again is that T3 is as this time range end value; At last, draw the time range of time range T2 to T3 as the pending record of screening, time range is as shown in Figure 5.
Data processing unit 32 is used for the time range that calculates according to time rollback unit 31, and the pending record that obtains in the corresponding time range is handled.At first, the pending record storage unit 23 of data processing unit 32 visits, the value of choosing " timestamp " falls into all records of time range " T2 to T3 ", and judges whether its " treatment state " is that 0-is untreated; Then, qualified pending record is carried out data processing, and more " treatment state " of new record handled for 1-; Whenever handle a notes record back time temporary storage location 22 and will " operation monitoring time " be updated to the current time; All recording processing of these affairs finish, and access time temporary storage location 22 is updated to T3 with " time range end value last time ", " starting the concluding time last time " is updated to the current time, and " operation monitoring time " is updated to the current time.
The function of self-starting unit 33 is according to certain interval time, starts 3 pairs of pending records of asynchronous process device automatically and handles.At first, 33 access time of self-starting unit temporary storage location 22 obtains " starting the concluding time last time " (being assumed to be W0), and access parameter storage unit 21 is obtained " self-starting interval time " (Δ T2); Then, " starting the concluding time last time " W0 is added " self-starting interval time " Δ T2, obtain W1 start-up time next time; Then, when system time equals W1, start asynchronous process device 3 once more.
The function of general parameter setting device 4 is to receive user instruction, and the system operational parameters in the data memory storage 2 is provided with and adjusts.
Whether the function of asynchronous process starter gear 5 is monitoring asynchronous process device 3 normally operations, if the instruction of restarting asynchronous process device 3 is not then carried out in normal operation; If the user is then pointed out in misoperation, and rerun asynchronous process device 3.Asynchronous process starter gear 5 is used to monitor whether misoperation of asynchronous process device 3, receives user instruction and also judges whether to allow the user to restart asynchronous process device 3; Normally move if judged result is an asynchronous process device 3, then do not allow to restart; Otherwise, restart asynchronous process device 3.As shown in Figure 6, asynchronous process starter gear 5 comprises monitoring means 51 and starts processing unit 52.
The function of monitoring means 51 is the contrasts according to operation monitoring time and current system time, and whether monitoring asynchronous process device 3 operate as normal.Specifically be treated to: at first, 51 access time of monitoring means temporary storage location 22 obtains " operation monitoring time " M, and access parameter storage unit 21 is obtained " self-starting interval time " Δ T2; Whether compare M+ Δ T2 then less than the current time in system; If M+ Δ T2 is less than the current time in system; Then above normal time do not upgrade, i.e. send misoperation remind startup processing unit 52 by asynchronous process device 3 misoperations for proof " operation monitoring time " M.If M+ Δ T2, proves then that asynchronous process device 3 normally moves greater than the current time in system.
Starting processing unit 52 can be according to monitoring means 51 judged result, and whether control carries out the instruction that the user starts asynchronous process device 3.Remind if receive the misoperation that monitoring means 51 sends, then be prompted to the user, and when receiving user instruction, restart asynchronous process device 3; Do not remind if receive the misoperation that monitoring means 51 sends, then when receiving user instruction, do not allow to restart asynchronous process, promptly do not do any operation.
Fig. 7 is used for the structured flowchart of the asynchronous process device of hotlist Data Update for the embodiment of the invention, and this device comprises: data extracting unit 701, and time range generation unit 702, data are selected updating block 703 and time updating block 704.
In addition; This device also comprises a storage unit 705; Be used for realizing the function of Fig. 2 data storage device 2; The storage non real-time Updates Information, and storage comprises system's operation desired parameters of rollback time and self-starting interval time, can also store to start time range end value last time, the last time of obtaining in the data handling procedure each item time parameters such as concluding time, operation monitoring time.
In addition, will be referred to several current time, the time point of present current time when each current time is meant the execution different operating among the embodiment below.
Data extracting unit 701 is used for realizing the function of Fig. 2 data screening device 1; Data extracting unit 701 is at first obtained the data to be updated that comprise Data Update information, data processing state and timestamp; And Update Information from said extracting data non real-time to be updated, this non real-time is Updated Information is saved in the storage unit 705 then.Data extracting unit 701 is the data monitoring communication interface, can comprise: interfaces such as serial ports or USB mouth, and data reception module and data transmission blocks.
Time range generation unit 702 according to the rollback time Δ T1 in the storage unit and last time time range end value T1 generate this time range start time T2 (T2=T1-Δ T1), and generate the concluding time of this time range according to current time in system T3.
Data select updating block 703 to be used for stabbing the non real-time that falls between T1 and the current time in system T3 and Updating Information from the said non real-time select time that Updates Information, and the non real-time of selection Updated Information carry out update processing.
After Data Update is finished dealing with, time updating block 704 with last time time range end value T1 be updated to T3 (T3 this moment no longer be the current time), will start the concluding time last time to be updated to current time T4, the operation monitoring time, M was updated to current time T4.
Further, this device also comprises: state updating unit 706, after Data Update was finished dealing with, state updating unit 706 can be updated to the treatment state that the non real-time of accomplishing update processing Updates Information and handle.
Time range generation unit 702, data select updating block 703, time updating block 704 and state updating unit 706 to be used for realizing the function of Fig. 2 asynchronous process device 3.
Further, this device also comprises: time judging unit 707 and abnormal prompt unit 708.Time judging unit 707 be used to judge automatic interval time Δ T2 and operation monitoring time M (the current time T4 after the renewal) sum (Δ T+M) whether greater than work at present time T 5.
If interval time, Δ T2 and described operation monitoring time sum were greater than work at present time T 5 automatically; Equal said automatic interval time of Δ T2 and when starting concluding time T4 sum last time in current system time; Allocating time scope generation unit 702, data select updating block 703, time updating block 704 and state updating unit 706 to carry out corresponding operation once more.
When automatic interval time Δ T2 and described operation monitoring time sum be when being not more than work at present time T 5, abnormal prompt unit 708 can the output abnormality information.
Abnormal prompt unit 708 can the output abnormality information after, execute exception is handled operation and is also needed after user instruction, carry out.Further; This device also comprises: command reception unit 707; Be used at the exception handling instruction that receives user's input, allocating time scope generation unit 702, data select updating block 703, time updating block 704 and state updating unit 706 to carry out corresponding operation once more.
Specify the embodiment of the invention below in conjunction with concrete data; Suppose shown in the parameter and each item time value table 4 described as follows, table 5 and table 6 that storage unit 705 is preserved; Table 4 is rollback time and self-starting interval time; In the table 5 storage for last time time range end value, last time start concluding time, operation monitoring time, the Data Update information, treatment state and the timestamp that Update Information for non real-time of storage in the table 6.
Table 4
The constant title Constant value (minute)
The rollback time 3
Self-starting interval time 1
Table 5
Field Field value
Last time the time range end value 09:03:00
Started the concluding time last time 09:03:05
The operation monitoring time 09:03:05
Table 6
Data Update information Treatment state Timestamp
XXXXX 0 10:00:00
XXXXX 0 10:01:00
XXXXX 0 10:02:00
XXXXX 0 10:03:00
XXXXX 0 10:04:00
XXXXX 0 10:05:00
XXXXX 0 10:06:00
XXXXX 0 10:07:00
XXXXX 0 10:08:00
XXXXX 0 10:09:00
Fig. 8 is the asynchronous processing method process flow diagram of embodiment of the invention hotlist Data Update, and this method comprises:
S801: data extracting unit 701 is obtained the data to be updated that comprise Data Update information, data processing state and timestamp, and Updates Information from said extracting data non real-time to be updated, and is as shown in table 6.
S802: time range generation unit 702 according to rollback time Δ T1 and last time time range end value T1 generate this time range start time T2, and generate the concluding time of this time range according to current time in system T3.
Time range generation unit 702 at first " rollback time " parameter value in the reading cells 705 is 3 minutes, and " time range end value last time " is 09:03:00; Then, deduct the start time " 09:00:00 " that " rollback time " obtains this time range with " time range end value last time ".With the concluding time of current system time " 10:11:00 " as this time range, last, draw the time range of time range " 09:00:00 "-" 10:11:00 " as the pending record of screening.
S803: data are selected updating block 703 select time stamp from said non real-time Updates Information to fall into non real-time between T1 and the current time in system T3 to Update Information and carry out update processing.
Data are selected updating block 703 reading cells 705; Selecting " timestamp " numerical value falls into time range " 09:00:00 "-" 10:11:00 " and field " treatment state " and is the untreated pending record of 0-; 10 records in the table 6 all within process range, carry out data processing to these 10 records.
S804: time updating block 704 is updated to T3 with said T1, will start the concluding time last time to be updated to current time T4, and the operation monitoring time is updated to current time T4.
Time updating block 704 is updated to " 10:11:00 ", " starting the concluding time last time " with " time range end value last time " and is updated to the current time " 10:11:05 ", " operation monitoring time " and is updated to the current time " 10:11:05 ".
After step S803, this method also comprises: will accomplish treatment state that the non real-time of update processing Updates Information and be updated to 1-and handle, and whenever handle a record.
After step S804, this method also comprises:
S805: judge automatic interval time Δ T2 and described operation monitoring time sum whether greater than work at present time T 5; Automatically interval time, Δ T2 and described operation monitoring time sum were greater than work at present time T 5; Then start-up time scope generation unit 702, data are selected the normal operation of updating block 703, time updating block 704 and state updating unit 706 (asynchronous process device 3).
Time judging unit 707 at first obtains the work at present time " 10:12:05 ", obtain " self-starting interval time " parameter value and be 1 (minute), and obtain " operation monitoring time " 10:11:05; Use " operation monitoring time " to add " self-starting interval time " then, obtain 10:12:05; Then, whether compare " 10:12:05 " greater than work at present time " 10:12:05 ", if greater than, prove that then asynchronous process device 3 normally moves, and forwards step S806 to; Otherwise 3 misoperations of asynchronous process device forward step S807 to.
S806: equal said automatic interval time of Δ T2 and when starting concluding time T4 sum last time in current system time, repeat S802.
Obtain " starting the concluding time last time ": 10:11:05, and obtain " self-starting interval time " parameter value be 1 (minute); Then, " starting the concluding time last time " added " self-starting interval time ", obtained start-up time " 10:12:05 " next time; Forward step S802 when equaling " 10:12:05 " at system time.
S807: if interval time, Δ T2 and described operation monitoring time sum were to be not more than work at present time T 5, the output abnormality information automatically.
S808: if receive the exception handling instruction of user's input, repeating step S802, otherwise flow process finishes.
The beneficial effect of the embodiment of the invention is; Through being separated, non real-time deal with data and real-time processing data carry out asynchronous process; Make and in a large number ageing less demanding data can be upgraded by non real-time, avoid system the low problem of hot spot table update efficiency to occur.When the asynchronous process data, adopted and confirmed each time range of handling, search pending record through time range, avoided full dose to scan pending record sheet, the problem that search efficiency is low, system overhead is big.
Through adopting the method for time rollback scope computing time; The time range of twice asynchronous process covers mutually before and after making; Be in some record of time range critical value; Even need carry out could really being registered in the pending record sheet after the various special processings, can not omitted by twice asynchronous process in front and back yet, improved the reliability of system.
Asynchronous process is monitored, under abnormal conditions, can in time be reminded the user, improved the security of data processing.
Above-described specific embodiment; The object of the invention, technical scheme and beneficial effect have been carried out further explain, and institute it should be understood that the above is merely specific embodiment of the present invention; And be not used in qualification protection scope of the present invention; All within spirit of the present invention and principle, any modification of being made, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (10)

1. an asynchronous processing method that is used for the hotlist Data Update is characterized in that, described method comprises:
Step a: obtain the data to be updated that comprise Data Update information, data processing state and timestamp, and Update Information from said extracting data non real-time to be updated;
Step b: according to rollback time Δ T1 and last time time range end value T1 generate this time range start time T2, and generate the concluding time of this time range according to current time in system T3;
Step c: select time stabs the non real-time fall between T1 and the current time in system T3 and Updates Information and carry out update processing from said non real-time Updates Information;
Steps d: said T1 is updated to T3, will starts the concluding time last time to be updated to current time T4, the operation monitoring time is updated to current time T4.
2. method according to claim 1 is characterized in that, after steps d, described method also comprises:
Judge automatic interval time Δ T2 and described operation monitoring time sum whether greater than work at present time T 5, if equal said automatic interval time of Δ T2 and when starting concluding time T4 sum last time, repeating step b in current system time.
3. method according to claim 2 is characterized in that, if interval time, Δ T2 and described operation monitoring time sum were to be not more than work at present time T 5, the output abnormality information automatically.
4. method according to claim 3 is characterized in that, when receiving the exception handling instruction of user's input, and repeating step b.
5. method according to claim 1 is characterized in that, after step c, described method also comprises: will accomplish treatment state that the non real-time of update processing Updates Information and be updated to and handle.
6. asynchronous process device that is used for the hotlist Data Update is characterized in that described device comprises:
Data extracting unit is used to obtain the data to be updated that comprise Data Update information, data processing state and timestamp, and Updates Information from said extracting data non real-time to be updated;
The time range generation unit, be used for according to rollback time Δ T1 and last time time range end value T1 generate this time range start time T2, and generate the concluding time of this time range according to current time in system T3;
Data are selected updating block, are used for falling into non real-time between T1 and the current time in system T3 and Updating Information and carry out update processing from the said non real-time select time stamp that Updates Information;
The time updating block is used for said T1 is updated to T3, will start the concluding time last time to be updated to current time T4, and the operation monitoring time is updated to current time T4.
7. device according to claim 6 is characterized in that, described device also comprises:
The time judging unit, be used to judge automatic interval time Δ T2 and described operation monitoring time sum whether greater than work at present time T 5.
8. device according to claim 7 is characterized in that, described device also comprises:
The abnormal prompt unit, be used for when automatic interval time Δ T2 and described operation monitoring time sum be when being not more than work at present time T 5, the output abnormality information.
9. device according to claim 8 is characterized in that, described device also comprises:
The command reception unit is used to receive the exception handling instruction that the user imports.
10. device according to claim 6 is characterized in that, described device also comprises:
State updating unit is used for the treatment state that the non real-time of accomplishing update processing Updates Information is updated to and handles.
CN2012100356356A 2012-02-16 2012-02-16 Asynchronous processing method and device for hotlist data update Pending CN102591993A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2012100356356A CN102591993A (en) 2012-02-16 2012-02-16 Asynchronous processing method and device for hotlist data update

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012100356356A CN102591993A (en) 2012-02-16 2012-02-16 Asynchronous processing method and device for hotlist data update

Publications (1)

Publication Number Publication Date
CN102591993A true CN102591993A (en) 2012-07-18

Family

ID=46480628

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012100356356A Pending CN102591993A (en) 2012-02-16 2012-02-16 Asynchronous processing method and device for hotlist data update

Country Status (1)

Country Link
CN (1) CN102591993A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103020304A (en) * 2012-12-31 2013-04-03 中国工商银行股份有限公司 Data processing method and equipment
CN103744936B (en) * 2013-12-31 2017-02-08 华为技术有限公司 Multi-version concurrency control method in database and database system
CN108334633A (en) * 2018-02-26 2018-07-27 平安普惠企业管理有限公司 Data-updating method, device, computer equipment and storage medium
CN108563776A (en) * 2018-04-24 2018-09-21 武汉斗鱼网络科技有限公司 Off-line data acquisition methods and system, server and storage medium
CN108984779A (en) * 2018-07-25 2018-12-11 郑州云海信息技术有限公司 Distributed file system snapshot rollback metadata processing method, device and equipment
CN110096517A (en) * 2014-11-04 2019-08-06 阿里巴巴集团控股有限公司 Data cached monitoring method, device and system based on distributed system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1773463A (en) * 2004-11-12 2006-05-17 国际商业机器公司 A method and system for managing data transfer in consistency group formation
US7233947B2 (en) * 2003-05-22 2007-06-19 Microsoft Corporation Timestamping in databases
US20100036895A1 (en) * 2008-08-06 2010-02-11 International Business Machines Corporation Representation of system clock changes in time based file systems
US20110138020A1 (en) * 2008-12-31 2011-06-09 Roger Pantos Real-Time or Near Real-Time Streaming with Compressed Playlists

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7233947B2 (en) * 2003-05-22 2007-06-19 Microsoft Corporation Timestamping in databases
CN1773463A (en) * 2004-11-12 2006-05-17 国际商业机器公司 A method and system for managing data transfer in consistency group formation
US20100036895A1 (en) * 2008-08-06 2010-02-11 International Business Machines Corporation Representation of system clock changes in time based file systems
US20110138020A1 (en) * 2008-12-31 2011-06-09 Roger Pantos Real-Time or Near Real-Time Streaming with Compressed Playlists

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103020304A (en) * 2012-12-31 2013-04-03 中国工商银行股份有限公司 Data processing method and equipment
CN103744936B (en) * 2013-12-31 2017-02-08 华为技术有限公司 Multi-version concurrency control method in database and database system
US9953051B2 (en) 2013-12-31 2018-04-24 Huawei Technologies Co., Ltd. Multi-version concurrency control method in database and database system
CN110096517A (en) * 2014-11-04 2019-08-06 阿里巴巴集团控股有限公司 Data cached monitoring method, device and system based on distributed system
CN108334633A (en) * 2018-02-26 2018-07-27 平安普惠企业管理有限公司 Data-updating method, device, computer equipment and storage medium
CN108334633B (en) * 2018-02-26 2020-09-15 平安普惠企业管理有限公司 Data updating method and device, computer equipment and storage medium
CN108563776A (en) * 2018-04-24 2018-09-21 武汉斗鱼网络科技有限公司 Off-line data acquisition methods and system, server and storage medium
CN108563776B (en) * 2018-04-24 2022-06-17 武汉斗鱼网络科技有限公司 Offline data acquisition method and system, server and storage medium
CN108984779A (en) * 2018-07-25 2018-12-11 郑州云海信息技术有限公司 Distributed file system snapshot rollback metadata processing method, device and equipment

Similar Documents

Publication Publication Date Title
CN110569305B (en) Block synchronization method, device, medium and computing equipment
CN102591993A (en) Asynchronous processing method and device for hotlist data update
CN104021043B (en) The interruption re-access method and system of batch application program
CN102521712B (en) A kind of process instance data processing method and device
CN103020304A (en) Data processing method and equipment
US10310900B2 (en) Operating programs on a computer cluster
US9098360B2 (en) Program, information processing apparatus, and event processing method
WO2019148728A1 (en) Electronic device, execution task assignment method for distributed system, and storage medium
CN103235811A (en) Data storage method and device
EP2696297B1 (en) System and method for generating information file based on parallel processing
CN202600778U (en) Asynchronous processing system for updating hotlist data
US9928164B2 (en) Information processing apparatus
CN110895490A (en) Data batch processing system, method, equipment and storage medium
CN112231403B (en) Consistency verification method, device, equipment and storage medium for data synchronization
CN103092955B (en) Checkpointed method, Apparatus and system
CN112202909A (en) Online upgrading method and system for computer storage system
CN103488549B (en) Roll-back processing system and roll-back processing method for multi-mirror-image data
CN111459748A (en) Operation and maintenance control method, system and device based on command control and storage medium
CN116069859A (en) Incremental data synchronization method of database, storage medium and computer equipment
CN115827265A (en) Transaction processing method, device, equipment and storage medium
CN115277398A (en) Cluster network configuration method and device
CN113849161A (en) Application control method and device, storage medium and electronic equipment
US20210303339A1 (en) Data backup method, electronic device and computer program product
CN108664503A (en) A kind of data archiving method and device
CN112350837B (en) Cloud platform-based power application cluster management method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20120718