WO2000014651A1

WO2000014651A1 - Document semantic analysis/selection with knowledge creativity capability

Info

Publication number: WO2000014651A1
Application number: PCT/US1999/019699
Authority: WO
Inventors: Valery M. Tsourikov; Leonid S. Batchilo; Igor V. Sovpel
Original assignee: Invention Machine Corporation
Priority date: 1998-09-09
Filing date: 1999-08-31
Publication date: 2000-03-16
Also published as: US20010014852A1; CA2341583A1; NO20011194L; US6167370A; CN1325513A; JP4467184B2; NO20011194D0; KR20010075026A; AU5790399A; JP2002524799A; KR100594512B1; EP1112541A1

Abstract

A computer based software system and method for semantically processing a user entered natural language request to identify (16) and store (18) linguistic subject-action-object (SAO) structures, using such structures as key words/phrases (24) to search (30) local and Web-based databases for downloading (12) candidate natural language documents, semantically processing candidate document texts into candidate document SAO structures, and selecting and storing only relevant documents whose SAO structures include a match with a stored request SAO structure. Further features include analyzing relationships among relevant document SAO structures and creating new SAO structures (20) based on such relationships that may yield new knowledge concepts and ideas for display to the user and generating and displaying natural language summaries (22, 26) based on the relevant document SAO structures.

Description

TITLE: DOCUMENT SEMANTIC ANALYSIS/SELECTION WITH KNOWLEDGE CREATIVITY CAPABILITY

REFERENCE TO PRIORITY APPLICATION:

This application claims the benefit of U.S. Provisional Application No. 60/099,641, filed September 9, 1998.

BACKGROUND:

The present invention relates to computer based apparatus for and methods of semantically analyzing, selecting, and summarizing candidate documents containing

specific content or subject matter.

Computer based document search processors are known to perform key word searches for publications on the Internet and World Wide Web. Today, information owners and service providers are adapting their data bases to individual tastes and

requirements. For example, Boston based Agents, Inc. offers over the Web personalized

newsletters for music fans such that classical music lovers are blocked from receiving Rap music ads and vice- versa. KD, Inc. of Hong Kong has developed a system that takes into consideration words similar by sense while searching the Web. Today the user can download 10,000 papers from the Web by typing the word "Screen". The search

system designed by KD, Inc. asks the user whether he/she is seeking papers related to

Computer Screen. TV Screen or Window Screen. In this case, the number of unrelated papers will be drastically reduced.

Software based search processors are able to remember requests of single user and

to conduct personalized non-stop searches on the Web. So, when a user wakes up in the

morning he/she finds references and abstracts of several new Web papers, related to

his/her area of interest. In 1997, practically all fundamental technical publications, journals, magazines, as well as patents of all industrial countries became available on the

Web, i.e. available in electronic format.

Although key word searching the Web affords the user great value, it also has

created and will continue to create substantial problems adversely affecting this value.

Specifically, because of the enormous amount of information available on the Web, key word search processors produce too much downloaded information, the vast majority of

which is irrelevant or immaterial to the information the user wants. Many users simply

give up in frustration when presented with several hundred articles in response to what

the user considered a request for only those few articles related to a specific request.

This problem is also experienced in the technical fields of science and engineering,

particularly since there is a growing number of libraries, government patent offices,

universities, government research centers, and other adding vast amounts of technical and scientific information for Web access. Engineers, scientists, and doctors are overwhelmed with too many articles, papers, patents and general information on the topic of interest to

them. In addition, the user presently has only two choices when examining a download

article to determine its relevance to the users project. He/she can either read the authors

abstract and/or scan various sections of the full article to determine whether or not to save or print-out that specific document. Since the author's abstract is not

comprehensive, it often omits the reference to the specific subject matter of interest to the user or treats this subject matter in an incomprehensive manner. Thus, scanning the

abstract and scanning the full article may have little value and require an inordinate amount of user time.

Various attempts purport to increase the recall and precision of the selection such

as U.S. Patents Nos. 5,774,833 and 5,794,050 incorporated here by reference, however,

these methods simply rely on key word or phrase searching with various techniques of

selection based on variations of the key words, or purported understanding of textual

phrases. These prior methods may improve recall but may still requires too much physical and mental effort and time to determine why the document was selected and what is the

pertinent part. This results from the entire document of abstract being presented without

summary or concept generation.

SUMMARY OF EXEMPLARY EMBODIMENT OF PRESENT INVENTION

A computer based software system and method according to the principles of the

present invention solves the foregoing problems and has the ability to perform a non-stop search of all databases on the Web or other network for key words and to semantically

process candidate documents for specific technological functions and specific physical

effects so that only the very few prioritized or a single article meeting the search criteria is

presented or identified to the user.

Further, the computer based software system in accordance with the principles of the present invention captures these few highly relevant documents and creates a

compressed, short summary of the precise technical physical aspects designated by the

search criteria.

Another aspect of the present invention includes using the semantic analysis results of the selected documents to create new ideas of knowledge concepts. The system

does this by analyzing the subjects, actions, and objects mentioned in the documents and

re-organizing these representations into new and/or different profiles of such elements.

As further described below, some of these reorganized sets of relationships among these

elements may comprise new concepts never before thought of by anyone.

According to an aspect of the present invention, the method and apparatus begins

with the user entering natural language text related to the task or concept for which the

user desires to acquire publications or documents. The system analyzes this request text

and automatically tags each word with a code that indicates the type of word it is. Once all words in the request are tagged, the system performs a semantic analysis that, in one

example, includes determining and storing the verb groups within the first sentence of the

request, then determining and storing the noun groups within that sentence of the request.

This process is repeated for all sentences in the request.

Next, the system parses each request sentence with an heirarcal algorithm into a coded framework which is substantially indicative of the sense of the sentence. The

system includes databases of various types to aid in generating the coded framework, such

as grammar rules, parsing rules, dictionary synonyms, and the like. Once parsed sentence

codes are stored, the system identifies Subj ect- Action-Object (SAO) extractions within each sentence and stores them. A sentence can have one, two, or a plurality of SAO extractions as seen in the detailed description below. Each extraction is normalized into a SAO structure by processing extractions according to certain rules described below.

Accordingly, the result of the semantic analysis routine performed on the request text is a

series of SAO structures indicative of the content of the request. These request SAO

structures are applied to (1) a comparative module for comparing the SAO structures of

candidate documents as described below and (2) a search request and key word generator

that identifies key words and key combinations of words, and synonyms thereof, for

searching the Web internet, intranet, and local data bases for candidate documents. Any

suitable search engine, e.g. Alta Vista, can be used to identify, select, and download candidate documents based on the generated key words.

It should be understood that, as mentioned above, key word searching produces

an over-abundance of candidate documents. However, according to the principles of the

present invention, the system performs substantially the same semantic analysis on each

candidate document as performed on the user input search request. That is, the system

generates an SAO structure(s) for each sentence of each candidate document and

forwards them to the comparative Unit where the request SAO structures are compared to the candidate document SAO structures. Those few candidate documents having SAO

structures that substantially match the request SAO structure profile are placed into a

retrieved document Unit where they are ranked in order of relevance. The system then

summarizes the essence of each retrieved document by synthesizing those SAO structures

of the document that match the request SAO structures and stores this summary for user display or printout. Users can later read the summary and decide to display or print out

or delete the entire retrieved document and its SAO's.

As stated above, the SAO structures for each sentence for each retrieved document are stored in the system according to the present invention. According to the

knowledge creativity aspect of the present invention, the system analyzes all these stored

structures, identifies where common or equivalent subjects and objects exist and

reorganizes, generates, synthesizes, new SAO structures or new strings of SAO structures

for user's consideration. Some of these new structured or strings may be unique and comprise new solutions to problems related to the user's requested subject matter. For

example, if two structures S1-A1-O1 and S2-A2-O2 are stored, and the present system

recognizes that S2 is equivalent to or the synonym for or has some other relation to 01

then it will generate and store for the user's access a summary of S1-A1-S2-A2-O2. Of if

the system stores an association between SI and A2 it can generate S1-A1/A2-O1 to

suggest improvement of 01 toward desired results.

Other and further advantages and benefits shall become apparent with the

following detailed description when taken in view of the appended drawings, in which:

DRAWING DESCRIPTION:

Figure 1 is a pictorial representation of one exemplary embodiment of the system

according to the principles of the present invention.

Figure 2 is a schematic representation of the main architectural elements of the

system according to the present invention. Figure 3 is a schematic representation of the method according to the principles of the present invention.

Figure 4 is a schematic representation of Unit 16 of Figure 2.

Figure 5 is a schematic representation of Unit 20 of Figure 2.

Figure 6 is a schematic representation of Unit 22 of Figure 2.

Figure 7 is a typical example of the user request text entered by user.

Figure 8 is a tagged and coded representation version of text of Figure 7.

Figure 9 is an identification of verb groups of the text of Figure 8.

Figure 10 is an identification of noun groups of the coded text of Figure 8.

Figure 11 is a representation of parsed hierarchy coded text of Figure 8.

Figure 12 is a representation of SAO extraction of the text of Figure 7.

Figure 13 is a representation of SAO structures of the extraction of Figure 12.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

One exemplary embodiment of a semantic processing system according to the

principles of the present invention includes:

A CPU 12 that could comprise a general purpose personal computer or networked

server or minicomputer with standard user input and output driver such as keyboard 14,

mouse 16, scanner 19, CD reader 17, and printer 18. System 10 also includes standard

communication ports 21 to LANs, WANs, and/or public or private switched networks to

the Web.

With reference to Figures 1-6, the semantic procession system 10 includes a temporary storage or data base 12 for receiving and storing documents downloaded from

the Web or local area net or generated as a user request text with use of keyboard 14 or one of the other input devices. User can type the request, examples disclosed below, or

enter full documents into DB 12 and designate the document as user's request. System 10

further includes semantic processor 14 for receiving the entire text of each document and

includes a Subj ect- Action-Object (SO A) analyzer Unit 16 that tags each word of each

sentence with a code type (such as Markov chain theory code). Unit 16 then identifies

each verb group and noun group, (described below) within each sentence, and parses and

normalizes each sentence into SAO structures that represents the sense of the sentence.

Unit 16 applies its output to DB of SAO structures 18. SAO processor Unit 20 stores the

request SAO structures and receives the SAO structures of each sentence of each document stored in Unit 18. Unit 20 compares the document SAO's to the request SAO's

and deletes out those documents with no matches. The SAO structures of matched

documents are stored back in Unit 18 or some other storage facility. In addition, Unit 20

analyzes SAO structures within a single document or with those of one or more other

relevant documents, searches for relationships among S-A-O's and generates new SAO structures for user consideration. These new structures are stored in Unit 18 or some

other storage facility in the system.

Unit 14 further includes natural language Unit 22 that receives SAO structures in

table form and synthesizes structures into natural language form, i.e. sentences.

Unit 14 also includes keyword Unit 24 for receiving SAO structures and extracts

key words and phrases from them and acquires their synonyms for use as additional key words/phrases.

Database Units 26, 28, and 30 receive the outputs from Unit 14, generally as

shown, for storing the natural language summaries of selected SAO structures as

described below and the key words/phrases that form user request sent to search engines

through port 21.

Unit 16 includes document pre-formatter 32 that receives full text of documents

from Unit 12 and converts the text and other contents to a standard plain text format.

Text coder 34 analyzes each word of each sentence of text and tags a code to every word

which code designates the word type, see Fig 8. Various data bases designated 44 in Fig 4 are available to aid the Units of Unit 16. Following tagging, recognizer Unit 36 identifies the verb groups (Fig 9) and the noun groups of each sentence (Fig 10).

Sentence parser 38 then parses each sentence into a hierarchical coded form that

represents the sense of the sentence. Fig 11. S-A-O extractor 40 organizes the SAO's of

each sentence into extracted table format (Fig 12). Then normalizer 42 normalizes the extractions into SAO structures as described above (Fig 13).

SAO processor 20 includes three main Units. Comparative Unit 46 receives SAO

structures from database 18. One set of these structures originates from the user request

text described above and other sets originate from the candidate documents. Unit 46 then

compares these two sets looking for matches between SAO structures of these two sets. If no match results, then the candidate document and associated SAO's are deleted. If a

match is identified then the document is marked relevant and ranked and stored in Unit 12

and its SAO structures stored in Unit 18. Unit 46 then compares all candidate documents in sequence and in the same way as described.

Unit 20 also includes the SAO structure reorganizing Unit 48 to synthesize new

SAO structures from different documents on the same matter and combines them into the

new structure, as described above, and applies them to Unit 18.

Filtering Unit 50 analyzes every SAO structure of each document and blocks or

deletes those not relevant to the SAO structures of the request.

Reference 52 designates some of the data bases available to aid sub-units of Unit 20.

SAO synthesizer Unit 22 (Figure 6) includes a Subject detector 54 for detecting the

content of the subject for each received SAO structure. If S is detected then the SAO is

fed to Unit 56 in which the tree structure of the verb group(s) is restored to natural

language using grammar, semantic, speech patterns, and synonyms rules data base 66. Synthesizer 58 does the same for subject noun groups and synthesizer 60 does the same

for object noun groups. Combiner 68 then organizes and combines these groups into a

natural language sentence.

If S was not detected by Unit 54, the SAO structures are processed by synthesizer

62 to restore the verb group in passive form. Synthesizer 64 processes the object noun

group for a passive sentence and combiner 70 to organize and combine the groups into a

natural language sentence.

If SAO structures received by Unit 54 bear new structure markings, then combiners 68 and 70 apply their output to Unit 28 and if they were marked existing SAO

structure, then units 68, 70 apply output to Unit 26. See Fig 3.

The salient steps to the method according to the principles of the present invention are shown in Figure 3, where the number in the parenthesis refer to the Units of Figure 2

where the process steps takes place. A session begins with the user inputting a national

language request which could be customized with the use of the keyboard or would be a

national language document entered via one of the input devices shown in Figure 1. A

typical user generates customized request as shown in Figure 7., System 10 Unit 14, then by first tagging each word with a type code (See Figure 8) then identifying the verb

groups of each sentence (Figure 9) and noun groups of each sentence (Figure 10) then

processing each sentence into an hierarchical tree (Figure 11) and then extracting the

SAO extractions where all extracted words are the originals of the request (Figure 12).

Then the method normalizes these words (modifies) each as each action is changed to its infinitive form. This, "is isolated" Figure 12 is changed to "ISOLATE", the word "to"

being understood (Figure 13). It should be understood that not all attributes of the

subject, action and objects appearing in Figure 11 are shown in Figures 12 and 13, but the system knows the full attributes associated with the SAO elements and these attributes are

part of the SAO structure. Also, note in Figure 13, no subject is listed for the last action

because is indicated pursuant to the planning rules. This absence does not affect the

reliability of the overall method because all sentences of the candidate documents the include an A-O of Isolate-slides will be considered a matter regardless of the subject. The normalized SAO's are called herein as SAO structures. These users request SAO structures are stored and applied in two following steps (i) synthesis of key word/phrases

of user request; (ii) a comparative analysis of SAO structure of each sentence of each

candidate documents as described below. The request SAO structure key words/phrases are stored and sent to a standard search engine to search for candidate documents in local databases, LANs and/or the

Web. AltaVista™, Yahoo™, or other typical search engines could be used. The engine,

using the request SAO structure key words/phrases identifies candidate documents and

stores them (full text) for system 10 analysis. Next the SAO analysis as described above

for the search request is repeated for each sentence of each candidate document so that

SAO structures are generated and stored as indicated in Fig. 3. In addition, the SAO

structures of each document are used in the comparative steps where the request SAO

structures are compared with the candidate document SAO structures. If no match is found then the documents and related SAO structures are deleted from the system. If one

or more matches are found then the document and related structures are marked relevant

and its relevancy marked for example on a scale of 1.0 to 10.0. The full relevant

document text is permanently stored (although it can later be deleted by user if desired)

for display or print-out as user desires. Relevant SAO structures are also marked relevant

and permanently stored.

Next System 10 filters out the least relevant SAO structures and uses the matched

SAO structures of each relevant documents to synthesis into natural language summary

sentences(s) the matched SAO structures and the page number where the complete

sentence associated with the matched SAO structures appears. This summary is stored

and available for users display or print-out as desired.

Filtered relevant SAO structures of relevant document(s) are analyzed to identify

relationships among the subjects, actions, and objects among all relevant structures. Then SAO structures are processed to reorganize them into new SAO structures for storage

and synthesis into natural language new sentence(s). The new sentences may and probably some of them will express or summarize new ideas, concepts and thoughts for

users to consider. The new sentences are stored for user display or print-out.

For example, if

SrA_rO.

S₂-A₂-O₂

S₃-A₃-O₃

and S, is the same as or a synonym of O₃ then S₃-A₃-S₁-A₁-Oι is synthesized into a new

sentence and stored.

Accordingly, the method and apparatus according to the present invention

provides user automatically with a set of new ideas directly relating to user's requested

area of interest some of which ideas are probably new and suggest possible new solutions to user's problems under consideration and/or the specific documents and summaries of

pertinent parts of specific documents related directly to user's request.

Although mention has been made herein of application of the present system and

method to the engineering, scientific and medical fields, the application thereof is not

limited thereto. The present invention has utility for historians, philosophers, theology,

poetry, the arts or any field where written language is used.

It will be understood that various enhancements and changes can be made to the

example embodiments herein disclosed without departing from the spirit and scope of the

present invention.

Claims

WE CLAIM:

Claim 1. A natural language document analysis and selection system comprising,

a general purpose computer having a monitor, a central processing unit (CPU), a

user input device for generating request data representing a natural language request, and

a communications device for communication with local and remote natural language

document databases,

said CPU comprising (i) first storage means for storing the request data, (ii) a

semantic processor for generating request subject-action-object (SAO) extractions in

response to receiving request data, and (iii) SAO storage means for storing

representations of the request SAO extractions.

Claim 2. A system as set forth in Claim 1, wherein said communication device conveys

candidate document data to said CPU for storage in said first storage means, the candidate document data representing natural language document text,

said semantic processor generating candidate document SAO extractions in

response to receiving candidate document data, and

said SAO storage means also storing representations of candidate document SAO

extractions.

Claim 3. A system as set forth in Claim 2, wherein said semantic processor identifies

matches between said representations of said request SAO extractions and said candidate

document SAO extractions.

Claim 4. A system as set forth in Claim 3, wherein said semantic processor comprises means for marking as relevant candidate document data that includes at least one

representation of candidate document SAO extraction that matches at least one representation of request SAO extraction.

Claim 5. A system as set forth in Claim 4, wherein said semantic processor comprises

means for deleting stored candidate document data and stored representations of

candidate document SAO extractions for those documents that have no representation of

candidate document SAO extraction that matches a representation of request SAO

extraction.

Claim 6. A system as set forth in Claim 3, wherein said semantic processor includes an

SAO text analyzer having a plurality of stored text formatting rules, coding rules, word

tagging rules, SAO recognizing rules, parsing rules, SAO extraction rules, and

normalizing rules for applying such rules to the request data and candidate document data such that said representations of candidate document SAO extractions and of request

SAO extractions comprise candidate document and request SAO structures, respectively.

Claim 7. A system as set forth in Claim 6 further comprising second storage means for

storing request SAO structures and for applying SAO structures as key words/phrases to

said communication device for application to document search engines on the WEB or

local databases to cause downloading of candidate document data to the system.

Claim 8. A system as set forth in Claim 6 further comprising an SAO synthesizer for generating and storing for display on said monitor natural language summaries of marked

documents in response to receipt of document SAO structures.

Claim 9. A system as set forth in Claim 6 further comprising an SAO synthesizer for

analyzing relationships among subjects, actions, and objects among relevant and stored

SAO structures and processing those SAO structures that have a relationship with at least

one other SAO structure to generate a different SAO structure and storing the different

SAO structure for display to the user.

Claim 10. A system as set forth in Claim 9 wherein said relationship comprises:

S_I-A_J-O_J

S₂-A₂-O₂ where S_j synonym O₂

Claim 11. In a digital data processing system including the World Wide Web and a

general purpose computer having a monitor, a central processing unit (CPU), a user input

device, and a communications device for communication with local and remote natural

language document databases, the method of analyzing and selecting natural language

documents comprising, generating request data representing a natural language request,

storing the request data,

semantically processing the request data to generate request subject-action-object

(SAO) extractions, and storing representations of the request SAO extractions.

Claim 12. The method as set forth in Claim 11, wherein said communication device

conveys candidate document data to said CPU, the candidate document data representing

natural language document text, storing the candidate document data, said semantically processing including generating candidate document SAO

extractions in relation to the candidate document data, and storing representations of candidate document SAO extractions.

Claim 13. A method as set forth in Claim 12, wherein said semantically processing

includes identifying matches between said representations of said request SAO extractions

and said candidate document SAO extractions.

Claim 14. A method as set forth in Claim 13, wherein said semantically processing

comprises marking as relevant candidate document data that includes at least one

Claim 15. A method as set forth in Claim 14, wherein said semantically processing

comprises deleting access to stored candidate document data and stored representations

of candidate document SAO extractions for those documents that have no representation

of candidate document SAO extraction that matches a representation of request SAO

extraction.

Claim 16. A method as set forth in Claim 13, wherein said semantically processing

includes applying a plurality of stored text formatting rules, noun and verb recognition

rules, coding rules, word tagging rules, SAO recognizing rules, parsing rules, SAO

extraction rules, and normalizing rules to the request data and candidate document data

such that said representations of candidate document SAO extractions and

representations of request SAO extractions comprise candidate document and request

SAO structures, respectively.

Claim 17. A method as set forth in Claim 16 further comprising storing request SAO

structures and applying SAO structures as key words/phrases to document search

engines on the WEB or local databases to cause downloading of candidate document data

to the CPU.

Claim 18. A method as set forth in Claim 16 further comprising generating and storing

and displaying on said monitor natural language summaries of marked relevant documents

in relation to relevant document SAO structures.

Claim 19. A method as set forth in Claim 16 further comprising analyzing relationships

among subjects, actions, and objects among relevant and stored SAO structures, further

processing those SAO structures that have a relationship with at least one other relevant

and stored SAO structure, and generating a different SAO structure based on the said relationship, and

storing the different SAO structure and displaying the different SAO structure to

the user.

Claim 20. A method as set forth in Claim 19 wherein said relationship comprises:

S_J-A_J-O_J comprises one relevant and stored SAO structure

S₂- A₂-O₂ comprises a second relevant and stored SAO structure

where said relationship comprises S_x synonym O₂

and the different SAO structure is S^A^S^A_J-O_J .

Claim 21. A method as set forth in Claim 19 wherein said relationship comprises:

S_j-Ai-O_! comprises one relevant and stored SAO structure S₂-A₂-O₂ comprises a second relevant and stored SAO structure where said relationship exists between Sj and A₂ and the different SAO structure is

S_J- A_J-O, where / means alternate.