US20050251737A1 - Document processing apparatus, document processing method, document processing program, and recording medium - Google Patents

Abstract

The text format of input data is checked, and is converted into a system-manipulated format. It is further determined if the input data is in an HTML or e-mail format using tags, heading information, and the like. The converted data is divided into blocks in a simple manner such that elements in the blocks can be checked based on repetition of predetermined character patterns. Each block section is tagged with a tag indicating a block. The data divided into blocks is parsed based on tags, character patterns, etc., and is structured. A table in text is also parsed, and is segmented into cells. Finally, tree-structured data having a hierarchical structure is generated based on the sentence-structured data. A sentence-extraction template paired with the tree-structured data is used to extract sentences.

Description

BACKGROUND OF THE INVENTION
• 1. Field of the Invention
• The present invention relates to a document processing apparatus, a document processing method, and a document processing program in which digitized text information is extracted in order to make it more convenient to read the text aloud, and further relates to a recording medium for use therewith.
• 2. Description of the Related Art
• Recently, as the Internet has become increasingly widespread, a large volume of digitized text data has been handled over networks. On the Internet, in particular, voluminous digitized text data is exchanged via web sites on the World Wide Web (WWW) or by e-mail. E-mail messages mainly contain plain text information. On a web site, on the other hand, text data is mainly described in HTML (Hyper Text Markup Language).
• In HTML, a document in a text-data format has codes, called tags, embedded therein, which are also expressed using text data, and the tags can be used to define the document structure. A document described in HTML is read using viewer software supporting the document in order to view the document in a layout according to the document structure defined by the tags. Hereinafter, a document described in HTML is simply referred to as an “HTML document”.
• The data format of text data exchanged over a network is still different between e-mails and HTML documents, thus requiring different viewers therefor.
• Occasionally, it may be necessary to extract sentences in a predetermined fashion from the text data obtained in this way over a network according to the document structure. For example, in order to read aloud a document in a synthetic voice, etc., sections to be read aloud may have to be automatically extracted from the obtained text data. In order to view a document on a display, again, more conveniently, a selective extraction of desired sections is automated.
• In the related art, sentences are extracted from such HTML documents merely by removing the tag information.
• A typical viewer for viewing text data presents ruled lines by continuously repeating a symbol such as “*” or “−” on one line, or by using a symbol such as “|”, in a text-format document, such as an e-mail message. In this way, symbols can be used to form a table in a text-format document. When sentences are extracted from such a document, generally, the symbols used as a ruled line are simply segmented as a character string, and are not identified as a table.
• In text data, typically, a quotation symbol such as “>” is used for quoting the document of others. In an e-mail response, for example, this quotation symbol may be added at the beginning of each line of an original e-mail message to indicate that the original message has been quoted.
• There has been a system in the related art which is configured to identify a block including quoted sections to distinctively show the quoted sections and the other sections in different colors. In this case, again, if a sentence is extracted from the quoted text, the sentence together with the quotation symbol, such as “>”, is take out.
• An extended e-mail system which has become popular recently is a system such as a so-called mail magazine capable of transmitting the same information to multiple destinations at once. The transmitted e-mail often contains a large amount of information, namely, blocks of advertisements, a signature, and the like, in addition to the text body. Generally, it is difficult to remove such additional information from the text data to acquire only the text body information.
• Furthermore, as described above, an HTML document uses tags to define the document structure, and the document structure is viewed using an appropriate viewer in a style according to the tags. This allows a tag to be generally used as a control code indicating visual functionality for display, that is, a layout, whereas the positional functionality, such as whether a text section associated with the tag indicates a table or a heading in the document, may not be determined from the tag even in an HTML document.
• In a typical apparatus for reading aloud an HTML document, therefore, sections to be read aloud and the other sections cannot be differentiated in the HTML document only by tags. In addition, an operator cannot specify which sections are to be read aloud.
SUMMARY OF THE INVENTION
• Accordingly, it is an object of the present invention to provide a document processing apparatus, a document processing method, and a document processing program in which a section which is desired to be read aloud is extracted, as desired, from e-mail text data or HTML text data, and further to provide a recording medium for use therewith.
• It is another object of the present invention to provide a document processing apparatus, a document processing method, and a document processing program which are capable of unitarily processing e-mails and HTML documents, and further to provide a recording medium for use therewith.
• To this end, in an aspect of the present invention, a document processing apparatus for processing digitized document data includes: a block dividing unit for dividing input text data into blocks in a predetermined manner according to the structure of the text data; a document structuring unit for structuring the text data by parsing the document structure of a block into which the document data is divided by the block dividing unit according to the structure of the text data to segment the text data into sentences, and by adding tag information to the segmented sentences according to the structure of the text data; and a sentence extraction unit which controls an extraction of the sentences according to the tag information added to the sentences in the text data structured by the document structuring unit.
• In another aspect of the present invention, a document processing method for processing digitized document data includes the steps of: dividing input text data into blocks in a predetermined manner according to the structure of the text data; structuring the text data by parsing the document structure of a block into which the document data is divided by the block dividing step according to the structure of the text data to segment the text data into sentences, and by adding tag information to the segmented sentences according to the structure of the text data; and extracting the sentences according to the tag information added to the sentences in the text data structured by the document structuring step.
• In another aspect of the present invention, a document processing program causes a computer apparatus to execute a document processing method for processing digitized document data. The document processing program causes the computer apparatus to execute the steps of: dividing input text data into blocks in a predetermined manner according to the structure of the text data; structuring the text data by parsing the document structure of a block into which the document data is divided by the block dividing step according to the structure of the text data to segment the text data into sentences, and by adding tag information to the segmented sentences according to the structure of the text data; and extracting the sentences according to the tag information added to the sentences in the text data structured by the document structuring step.
• In another aspect of the present invention, a recording medium records a document processing program for causing a computer apparatus to execute a document processing method for processing digitized document data, the document processing method including the steps of: dividing input text data into blocks in a predetermined manner according to the structure of the text data; structuring the text data by parsing the document structure of a block into which the document data is divided by the block dividing step according to the structure of the text data to segment the text data into sentences, and by adding tag information to the segmented sentences according to the structure of the text data; and extracting the sentences according to the tag information added to the sentences in the text data structured by the document structuring step.
• According to the present invention, therefore, input text data is divided into blocks in a predetermined manner according to the structure of the text data, the text data is structured by parsing the document structure of a divided block according to the structure of the text data to segment the text data into sentences, and by adding tag information to the segmented sentences according to the structure of the text data, and the sentences are extracted according to the tag information added to the sentences in the sentence-structured data. This makes it possible to easily extract sentences from input text data.
BRIEF DESCRIPTION OF THE DRAWINGS
• FIG. 1 is a flowchart showing an outline of a document processing sequence according to the present invention;
• FIG. 2 is a functional block diagram for implementing the functionality of a document processing apparatus according to an embodiment of the present invention;
• FIG. 3 is a block diagram of a computer apparatus incorporating the document processing apparatus according to the embodiment;
• FIG. 4 is a flowchart showing a document processing sequence according to an embodiment of the present invention;
• FIG. 5 is a flowchart which illustrates a process for determining a text format type in greater detail;
• FIG. 6 is a flowchart which illustrates a process for dividing data into blocks in greater detail;
• FIGS. 7A and 7B are views schematically showing an example of tagging for ruled-line characters;
• FIG. 8 is a table of ruled-line characters registered in a ruled-line-character register;
• FIGS. 9A and 9B are views schematically showing an example of tagging for character-based ruled lines;
• FIG. 10 is a table of characters registered in a continuous-character-based ruled-line character register;
• FIGS. 11A and 11B are views schematically showing an example of tagging for a horizontal rule formed by horizontal-rule characters;
• FIG. 12 is a table of horizontal-rule characters registered in a horizontal-rule character register;
• FIGS. 13A and 13B are views schematically showing an example of tagging for blank lines with block tag;
• FIGS. 14A and 14B are views schematically showing an example of tagging for a two-dimensional regular expression;
• FIG. 15 is a table of regular expressions registered in a regular-expression register;
• FIGS. 16A and 16B are views schematically showing how an unwanted tag is deleted from tagged text;
• FIG. 17 is a table showing a list of used tags which are registered in a used-tag register;
• FIGS. 18A and 18B are views schematically showing an example of tagging for the character position on each line;
• FIG. 19 is a flowchart of a process for structuring a document;
• FIGS. 20A and 20B are views schematically showing how a character string emphasized by underline characters is tagged with an underline tag indicating underline emphasis;
• FIG. 21 is a table of underline characters registered in an underline character register;
• FIGS. 22A and 22B are views schematically showing an example of tagging for a character string which uses a quotation character indicating a quotation from a different document;
• FIG. 23 is a table of quotation characters registered in a quotation character register;
• FIGS. 24A and 24B are views schematically showing an example of tagging for a quotation character;
• FIGS. 25A and 25B are views schematically showing an example of tagging for a heading line;
• FIG. 26 is a table of heading characters registered in a heading character register;
• FIGS. 27A and 27B are views schematically showing that a centered character string is identified as a heading;
• FIGS. 28A and 28B are views schematically showing that a character string is identified as a heading based on the character position;
• FIGS. 29A and 29B are views schematically showing that a bracketed character string is identified as a heading;
• FIGS. 30A and 30B are views schematically showing list items;
• FIG. 31 is a view showing a table formed by ruled-line characters;
• FIG. 32 is a view showing that a table is segmented into cells which are then tagged with tags indicating a table;
• FIGS. 33A and 33B are views schematically showing regular expressions in block-structured data;
• FIGS. 34A and 34B are views schematically showing a block break using a blank line;
• FIGS. 35A and 35B are views schematically showing how matching of quotation marks is checked by a quotation-mark determining unit;
• FIGS. 36A and 36B are views schematically showing that a block is divided based on a paragraph break;
• FIGS. 37A and 37B are views schematically showing that a block is segmented into sentences based on the period;
• FIG. 38 is a flowchart of a process for extracting a sentence from tree-structured data according to an embodiment of the present invention;
• FIG. 39 is a schematic view of example tree-structured data;
• FIG. 40 is a table of example extraction modes;
• FIG. 41 is a table of units;
• FIG. 42 is a table of tag action data;
• FIG. 43 is a table showing the structure of a template stored in a sentence-extraction-template storage;
• FIG. 44 is a view showing that flag information for a node in a template is pointed;
• FIG. 45 is a view showing that flag information for a node in a template is pointed;
• FIG. 46 is a table of template search modes; and
• FIG. 47 is a view schematically showing an example fuzzy search based on a text ID.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
• Some embodiments of the present invention are now described with reference to the drawings.
• FIG. 1 is a flowchart showing an outline of a document processing sequence according to the present invention.
• In step S10, the data type of character information on an incoming e-mail message or HTML document is determined to determine the type of text format. The text format is then converted into a format which can be processed by an apparatus for document processing. The document is divided into blocks in step S20, followed by step S30 in which a quotation, a heading, a table, a paragraph, etc. are extracted to structure the document. In step S40, a sentence is extracted, as desired, from the structured document.
• The extracted sentence is input to, for example, an apparatus for reading aloud text in a synthetic voice, and is thus output as audio information. An action allocated to an element of the extracted sentences can also be taken. Of course, the separated sentence can simply be displayed on a display device. A template which is prepared beforehand may be used for a more efficient separation of sentences.
• FIG. 2 is a functional block diagram for implementing the functionality of adocument processing apparatus300 according to an embodiment of the present invention. Acontroller1 which controls the overalldocument processing apparatus300 comprises a CPU (central processing unit), and serves to manage the overall software and hardware.
• Incoming text data which is input from aninput device2 connected to thecontroller1 is stored in adocument data storage4. Thedocument data storage4 takes up a predetermined area of a storage medium such as a hard disk drive (HDD). Adisplay device3 connected to thecontroller1 displays the text data input by theinput device2 or sentences which are finally extracted by thedocument processing apparatus300.
• Theinput device2 may be a keyboard or a voice input device for converting voice-input text information into text data which is then output. As an alternative, theinput device2 may be a communication interface connected to an external network such as the Internet, through which text data may be acquired from an external network. Alternatively, a predetermined connector may be used as an input device to connect to another compatible device, through which text data may be acquired from an external device. Of course, text data may be acquired from a removable storage medium such as a flexible disk (FD), a magneto-optical disk (MO), or a CD-ROM (compact disc read-only memory).
• A text-format determining unit5 executes the process in step S10 in the flowchart ofFIG. 1. The text-format determining unit5 includes a character-coding specifying unit6, a character-coding converting unit7, and a character-type determining unit8, and serves to determine and convert the data format of text in the input text data. The character-type determining unit8 determines the encoding method of the input text data. The character-coding specifying unit6 specifies the character coding, such as EUC (extended Unix code) or SJIS (shift-JIS) coding, to be processed by thedocument processing apparatus300. The character-coding converting unit7 converts the character coding of the input text data into a character coding which can be processed by thedocument processing apparatus300.
• The text data which is processed in this way by the text-format determining unit5 is buffered in a RAM (random access memory)111, as described below, which is implemented as aconversion buffer9. The text data buffered in theconversion buffer9 is passed to ablock dividing unit10 by thecontroller1.
• Theblock dividing unit10 executes the process in step S20 in the flowchart ofFIG. 1 on the text data passed from theconversion buffer9. Theblock dividing unit10 includes a horizontal-rule determining unit11, a horizontal-rule character register12, a ruled-linecharacter determining unit13, a continuous-character-based ruled-line character register14, a continuous-character-number specifying unit15, a ruled-line character register17, acharacter position memory16, a used-tag determining unit18, and a used-tag register19.
• In the horizontal-rule determining unit11, a horizontal rule contained in the text data is extracted based on the information registered in the horizontal-rule character register12, and is tagged with a predetermined tag. In the ruled-linecharacter determining unit13, a ruled line contained in the text data is extracted based on the information registered in the continuous-character-based ruled-line character register14 and the ruled-line character register17, and based on the information specified by the continuous-character-number specifying unit15, and is tagged with a predetermined tag. In thecharacter position memory16, a tag indicating the position information of each line in the original text data is added to each line of the input text data. In the used-tag determining unit18, a non-use tag contained in the text data is extracted based on the information registered in the used-tag register19, and is deleted.
• The text data is thus divided into blocks to generate block-structured data through the above-described process, and is then stored in a block-structured-data storage20 that takes up a predetermined area of a storage medium such as an HDD.
• Adocument structuring unit21 executes the process in step S30 in the flowchart ofFIG. 1. Thedocument structuring unit21 includes anunderline determining unit22, anunderline character register23, aquotation determining unit24, aquotation character register25, aheading determining unit26, a headingcharacter register27, atable determining unit28, a regular-expression determining unit29, a regular-expression register30, a blank-line determining unit31, a quotation-mark determining unit32, aparagraph determining unit33, and an English-sentence determining unit34.
• In theunderline determining unit22, an underline contained in the text data is extracted based on the information registered in theunderline character register23, and is tagged with a predetermined tag. In thequotation determining unit24, a quoted section contained in the text data is extracted based on the information registered in thequotation character register25, and is tagged with a predetermined tag. In theheading determining unit26, a heading section contained in the text data is extracted based on the information registered in the headingcharacter register27, and is tagged with a predetermined tag. Thetable determining unit28 extracts a table section contained in the text data and parses the table structure, which is then tagged with a predetermined tag. In the regular-expression determining unit29, a section to be extractable using a regular expression which is contained in the text data is detected based on the information registered in the regular-expression register30, and is tagged with a predetermined tag. In the blank-line determining unit31, a blank section contained in the text data is extracted, and is tagged with a predetermined tag. The quotation-mark determining unit32 checks for quotation marks contained in the text data, which are then tagged with predetermined tags, while correcting a paragraph break determined by theparagraph determining unit33, as described below, depending upon the position of the quotation marks. In theparagraph determining unit33, a paragraph break in the document information is detected, and is tagged with a predetermined tag. The English-sentence determining unit34 extracts an English sentence contained in the document, which is then tagged with a predetermined tag, and hyphenates the English sentence.
• The text data is thus tagged with a predetermined tag for each element through the above-described process, and is structured to generate sentence-structured data. Then, the text data is stored in a sentence-structured-data storage35 that takes up a predetermined area of a storage medium such as an HDD.
• Asentence extractor36 executes the process in step S40 in the flowchart ofFIG. 1. Thesentence extractor36 includes atree structuring unit37, a tree-structured-data storage38, atag determining unit39, a tag-action-data register40, a unit table41, and anextraction mode42.
• In thetree structuring unit37, the tagged text data stored in the sentence-structured-data storage35 is converted into tree-structured data, and is then stored in the tree-structured-data storage38. In thetag determining unit39, an action which is registered in the tag-action-data register40 and which is allocated to each tag is taken with respect to a tag added to the text data stored in the sentence-structured-data storage35. The unit table41 is referred to, for example, when sentences in a table are extracted together with units specified in that. When a sentence is extracted from the text data stored in the sentence-structured-data storage35, theextraction mode42 is used to specify a sentence to be extracted based on the tags added to the sentence.
• According to an embodiment of the present invention, a template stored in a sentence-extraction-template storage44 may be used when a sentence is extracted from the structured text data. The template is registered in a predetermined manner in atemplate register43, and is stored in the sentence-extraction-template storage44. The sentence-extraction-template storage44 takes up a predetermined area of a storage medium such as an HDD. Based on the information specified by atemplate search mode46, atemplate search unit45 searches the stored segmentation templates for an appropriate template.
• FIG. 3 shows the structure of acomputer apparatus100 incorporating thedocument processing apparatus300. As shown inFIG. 3, thedocument processing apparatus300 can be implemented on the general-purpose computer apparatus100. ACPU110, a RAM (random access memory)111, a ROM (read-only memory)112, and agraphics unit116 are connected to abus101. TheCPU110 uses theRAM111 as a working memory, and controls theoverall computer apparatus100 according to a predetermined program. TheRAM111 is also used as theconversion buffer9, as described above. TheROM112 stores, in advance, a program and data by which thecomputer apparatus100 is launched.
• In theCPU110, a predetermined display control signal is generated according to the instruction of the program, and is supplied to thegraphics unit116 via thebus101. Thegraphics unit116 generates a display signal which is displayable on adisplay130 in response to the supplied display control signal. The display signal is supplied from thegraphics unit116 to thedisplay130, such as a CRT (cathode-ray tube) or an LCD (liquid crystal display), for display in a predetermined manner.
• An input/output (I/O)unit113, a hard disk drive (HDD)114, and a communication interface (I/F)115 are also connected to thebus101.
• The I/O unit113 controls data exchange between thecomputer apparatus100 and an external device. For example, akeyboard120 and amouse121 are connected to the I/O unit113. Character information input from thekeyboard120, and moving information and button information of themouse121 are supplied to the I/O unit113, and are further supplied to, for example, theCPU110 via thebus101.
• Adisk drive122 may also be connected to the I/O unit113. Thedisk drive122 may be a CD-ROM drive capable of playing back a CD-ROM (compact disc ROM), and serves to input text data recorded in the CD-ROM to thecomputer apparatus100. Thedisk drive122 need not be a CD-ROM drive, and may be a flexible disk drive or an MO (magneto-optical disk) drive.
• An external input/output (I/O)123 may have a predetermined type of connector, and is connected to another device having a connector of the type compatible therewith via a cable so that data may be communicated therebetween. The text data prepared by an external device may be input to thecomputer apparatus100 through the external I/O123. For example, a sentence which is finally extracted from text data by thecomputer apparatus100 may be output to an external device through the external I/O123. The external I/O123 is not necessarily connected via a cable, and may be an interface capable of communication using infrared signals.
• TheHDD114 has areas for, for example, thedocument data storage4, the block-structured-data storage20, the sentence-structured-data storage35, and the sentence-extraction-template storage44, as described above, and the respective data are stored in the areas. The data or tables registered by the registers shown inFIG. 2 are stored in theHDD114. TheHDD114 may be used as theconversion buffer9. TheHDD114 also contains an OS (operating system) program for a basic control system of thecomputer apparatus100, and programs and data for implementing thedocument processing apparatus300 in thecomputer apparatus100.
• The communication I/F115 is connected between thecomputer apparatus100 and an external network such as the Internet, and controls communication to/from the external network according to the instruction of theCPU110. The text data prepared by another device connected to the network may be input to thecomputer apparatus100 through the communication I/F115. Of course, a sentence which is finally extracted from text data by thecomputer apparatus100 may be output to an external device through the communication I/F115. As an alternative, program data for constructing thedocument processing apparatus300 according to the present embodiment on thecomputer apparatus100 may be acquired from a network through the communication I/F115.
• Although not shown inFIG. 3, thecomputer apparatus100 may further include a voice synthesizer and a voice output device. The voice synthesizer generates a synthetic voice according to the supplied text data. The synthetic voice is audibly output by the voice output device. This enables a sentence which is processed and extracted by thedocument processing apparatus300 constructed on thecomputer apparatus100 to be audibly read aloud.
• In thecomputer apparatus100, first required is an installation of a program for constructing thedocument processing apparatus300. For example, a CD-ROM having a program recorded thereon is placed onto thedisk drive122 for playback. The program data read from the CD-ROM is loaded in a predetermined manner and stored on, for example, theHDD114 to complete the installation. After the installation, the program is launched on a predetermined device with respect to thecomputer apparatus100 to construct thedocument processing apparatus300 according to the present embodiment on thecomputer apparatus100.
• The program is not necessarily supplied by a recording medium such as a CD-ROM or an MO, and may be acquired, for example, from another computer apparatus connected to a network. Under control of the communication I/F115, the program data is downloaded from the network. The downloaded program data is loaded in a predetermined manner and stored on, for example, theHDD114 to complete the installation. As an alternative, program data may be acquired from another external device through the external I/O123.
• Now, the operation of thedocument processing apparatus300 according to an embodiment of the present invention is described in more detail.
• FIG. 4 is a flowchart which schematically illustrates a document processing sequence according to an embodiment of the present invention.FIG. 4 shows the flowchart ofFIG. 1 in greater detail, in which the same numerals are given to the corresponding steps.
• First, the type of text format of input document data is determined in step S10, followed by step S11, in which the character coding used for character information is converted into a character coding which can be internally processed by thedocument processing apparatus300.
• In step S20, the resulting document data, which can be internally processed, is divided into blocks having a predetermined unit, and text data which is block-structured data is generated in step S21. The generated text data is stored in the block-structured-data storage20.
• In step S30′, the block-structured data is tagged in each block to structure the text data. Step S30′ is illustrated in the document structuring step S30 inFIG. 1. The tagging in each block in step S30′ is followed by step S31 in which quotation-marks are checked, step S32 in which an English sentence is checked, and step S33 in which the data is segmented into sentences, thereby generating structured text data (step S34). The resulting structured text data (sentence-structured data) is stored in the sentence-structured-data storage35.
• Finally, in step S40, the sentences are extracted from the text data stored in the sentence-structured-data storage35.
• FIG. 5 is a flowchart which illustrates a process for determining a text format type in step S10 in greater detail, and this process is performed by the text-format determining unit5. InFIG. 5, symbols A and B correspond to the same symbols inFIG. 4, respectively.
• Before an explanation of the flowchart ofFIG. 5, an outline of tags is given. In general, a pair of tags, each having a pair of brackets, which indicates the start and end of a section, respectively, is embedded into text to specify any range of section. For example, a tag indicating the start of a section (referred to as a “starting tag”) has a predefined character string bracketed with “<” and “>”, and a tag indicating the end of the section (referred to as a “closing tag”) has the same character string bracketed with “</” and “>”. The character string bracketed with “<” and “>” (or “</” and “>”) has a specific meaning to the section enclosed by a pair of tags. A tag may also contain a predetermined parameter. Depending upon a meaning defined for a tag, the tag may consist of a starting tag only.
• InFIG. 5, in step S100, the character type of input text data is determined. The encoding method of the input text data is first checked by the character-type determining unit8. For example, it is determined whether or not the input character information is encoded version of standard text data using an encoding technique such as Base64 or uuencode. An encoded text data would be decoded using the corresponding technique.
• The text-format determining unit5 further determines whether or not the character coding of the input text data is identical to the character coding specified by the character-coding specifying unit6. If the character coding of the text data decoded by the character-type determining unit8 is different from the character coding specified by the character-coding specifying unit6, the text data is passed to the character-coding converting unit7 to convert the text data into data in the specified coding system.
• If a processed character coding is not specified by the character-coding specifying unit6, the text data is processed according the original coding system of the text data.
• Subsequently, the text is classified using tags in steps S101, S102, and S103. The text-format determining unit5 determines, for example, whether or not a tag bracketed with “< >” is placed at the beginning of the converted text data. If a tag is placed, the type of that tag is determined. If the tag indicates an HTML format, it is determined that the text data is in an HTML format. If the tag indicates an XML (Extensible Markup Language) format, it is determined that the text data is in an XML format.
• If the tag is a tag unique to thedocument processing apparatus300 indicating block-structured data, it is determined that the text data is in a block-structured data format. If the tag is a tag indicating sentence-structured data, it is determined that the text data is in a sentence-structured data format. The types of tags are described below.
• If the text-format determining unit5 determines that the text data does not use a tag, it is determined whether or not symbol “:” is inserted on each line. If one or more symbols “:” are inserted, a section before the first symbol “:” on each line is interpreted as a heading. If the heading contains “DATE”, “FROM”, and “TO”, the text data is interpreted as an e-mail message.
• Accordingly, it is determined in step S101 whether or not the text data is block-structured data. If it is determined that the text data is block-structured data which has been subject to the block structuring process defined in thedocument processing apparatus300, the process follows a sequence indicated by “A” inFIG. 5, and proceeds to step S30′, bypassing a process for dividing data into blocks in step S20 in the flowchart ofFIG. 4.
• On the other hand, if it is determined in step S101 that the text data is not block-structured data, the process proceeds to step S102. In step S102, it is determined whether or not the text data is sentence-structured data. If it is determined that the text data is sentence-structured data which has been subject to the sentence structuring process defined in thedocument processing apparatus300, the process follows a sequence indicated by “B” inFIG. 5, and proceeds to step S40, bypassing a process for tagging in a block in step S30′ through a process for generating sentence-structured data in step S34 in the flowchart ofFIG. 4.
• If it is determined in step S102 that the text data is not sentence-structured data, the process proceeds to step S103. In step S103, it is determined whether the text data is tagged text in which a tag indicating an HTML or XML format is embedded. If it is determined that the text data is tagged text, the process proceeds to step S105, in which the text format of the text data is set for “tagged text”.
• If it is determined in step S103 that the text data is not tagged text, the process proceeds to step S104. In step S104, it is determined whether or not the text data was sent by e-mail. If it is determined that the text data was sent by e-mail, the process proceeds to step S107, in which the text format of the text data is set for “e-mail format”. The text data in an e-mail format is essentially plain text.
• If it is determined in step S104 that the text data was not sent by e-mail, the process proceeds to step S106, in which the text format of the text data is set for “plain text format”.
• The text data whose text format type has been determined in the flowchart ofFIG. 5 is converted in terms of the character coding, etc., if necessary, and is then stored in theconversion buffer9.
• A process for dividing data into blocks in step S20 in the flowchart ofFIG. 4 is now described in greater detail.
• FIG. 6 is a flowchart which illustrates a process for dividing data into blocks in step S20 in greater detail, and this process is performed by theblock dividing unit10. If the text data input from theconversion buffer9 is in an untagged text format such as an e-mail format or a plain text format, theblock dividing unit10 divides the text data into blocks in a simple manner such that elements in the blocks can be checked based on the character type.
• In step S200, it is determined by theblock dividing unit10 whether or not the text data which has been subject to the process in the flowchart ofFIG. 5 and which is stored in theconversion buffer9 is in a plain text format.
• If it is determined that the text data is in a plain text format, the process proceeds to step S201. In step S201, a ruled-line character contained in the text data is checked by the ruled-linecharacter determining unit13. Then, it is determined in step S202 whether or not the checked ruled-line character forms a ruled line. If the ruled-line character forms a ruled line, then, in step S203, it is tagged with a ruled-line tag that is defined as indicating a ruled line.
• FIGS. 7A and 7B schematically show tagging for ruled-line characters. As shown inFIG. 7A, when the document contains a ruled line, first, it is determined whether or not the ruled line is formed by ruled-line characters. A ruled-line character is a character, such as a single-byte English character or a two-byte Japanese character, capable of forming a part of a ruled line.
• Ruled-line characters are registered in the ruled-line character register17.FIG. 8 shows the ruled-line characters registered in the ruled-line character register17. The ruled-line characters are classified into a plurality of patterns, and are registered in the ruled-line character register17. In this example, three types of character patterns, namely, Type=7, Type=8, and Type=9, are registered. Matching information with the registered ruled-line characters is also registered in the ruled-line character register17. The matching information includes information on ruled-line characters which can be combined in each type of ruled-line character pattern when the ruled-lined characters continuously appear in a row or column.
• Some of the ruled-line characters and the matching information may be registered in advance as default data. Any addition or modification may be made to or on the registered ruled-line characters and matching information by a user from the ruled-line character register17.
• By referring to the registered ruled-line characters, it is determined which type of character pattern the ruled-line character contained in the text data belongs to. Furthermore, ruled-line characters are checked line-by-line, and it is determined whether or not the same type of ruled-line character appears in a continuous manner. If more than a predetermined number of ruled-line characters continuously appear, then matching between the ruled-line characters is checked. If match is found therebetween, a section in which the ruled-line characters continuously appear is identified as one block. In this case, for example, a ruled-line character that will be at the end of the line may also be determined based on the ruled-line character matching information.
• InFIG. 7A, in a row containing “|WEIGHT|LENGTH|PRICE|” and a row containing “|10|20|30|”, ruled-line characters and non-ruled-line characters are mixed. Based on a relationship (position relationship or matching) between ruled-line characters in the rows thereabove and therebelow, for example, it can be determined whether or not these rows are in a ruled-line-character block. The continuous number of ruled-line characters can be specified by the continuous-character-number specifying unit15. For example, the continuous number of ruled-line characters may be registered in advance in the continuous-character-number specifying unit15, and the continuous number of ruled-line characters may also be specified by a user.
• Once a block has been specified based on the ruled-line characters in this way, a tag indicating a rule-line-based block structure (hereinafter referred to as a “ruled-line tag”) is added to the head and tail, that is, the start and end positions, of that block.FIG. 7B shows that the document shown inFIG. 7A is tagged with ruled-line tags. A starting tag <TC_TSF_BLOCK> and a closing tag </TC_TSF_BLOCK> indicate a block structure according to an embodiment of the present invention. The pair of tags <TC_TSF_BLOCK> and </TC_TSF_BLOCK> uses parameter “type” to indicate the type of the block, and parameter “type=0” indicates a plain-text block.
• In the example shown inFIG. 7B, the starting tag <TC_{— TSF}_BLOCK> uses parameter “type=7” to indicate that a section enclosed by the pair of tags is block-structured data based on the ruled-line characters of Type=7.
• In this case, a block is specified not only based on the above-described ruled-line characters but also based on ruled lines formed by predetermined characters.
• FIGS. 9A and 9B shows tagging for character-based ruled lines. In a plain-text document, it is common to use normal characters to form a ruled line. Characters used for a ruled line may include “+”, “−”, “*”, and “=”, each of which may be repeated a plurality of times to form a ruled line. Any combination of the characters may be used to form a ruled line. Character “|” may also be used for a vertical ruled-line. In the example shown inFIG. 9A, characters “±”, “−”, “∓” and “|” are used to express ruled liens, thus forming a table.
• Hereinafter, a ruled line formed by such normal characters is referred to as a “character-based ruled line”, and a character which can form a character-based ruled line is referred to as a “character-based ruled-line character”.
• A character-based ruled line is determined by referring to character-based ruled-line characters registered in the continuous-character-based ruled-line character register14.FIG. 10 shows characters registered in the continuous-character-based ruled-line character register14. As shown inFIG. 10, a character-based ruled-line character and what minimum number of continuous character-based ruled-line characters is used to identify a ruled line are registered in a one-to-one relation. For example, character “−” which continuously appears more than twice forms a character-based ruled line.
• Such a character-based ruled line may be registered in the continuous-character-based ruled-line character register14. The character-based ruled-line characters and the minimum numbers may be registered in advance. Any addition, modification, or deletion may be made to, on, or from the registered information by a user in the continuous-character-based ruled-line character register14.
• Once a block has been specified based on the character-based ruled-line characters in this way, a ruled-line tag is added to the head and tail, that is, the start and end positions, of that block.FIG. 9B shows that the document shown inFIG. 9A is tagged with ruled-line tags. Tags <TC_TSF_BLOCK> and </TC_TSF_BLOCK> indicating a block use parameter “type=10” to indicate that a section enclosed by the pair of tags is block-structured data based on the character-based ruled-line characters of Type=10.
• Turning back toFIG. 6, after the process in steps S201 to S203, the process proceeds to steps S204. In step S204, a horizontal-rule character contained in the text data is checked by the horizontal-rule determining unit11. In step S205, it is determined whether or not the checked horizontal-rule character forms a horizontal rule. If the horizontal-rule character forms a horizontal rule, then, in step S206, it is tagged with a horizontal-rule tag defined as indicating a horizontal rule.
• FIGS. 11A and 11B show tagging for a horizontal rule formed by horizontal-rule characters. In a plain-text document, it is common to use normal characters to form a horizontal rule. Characters used for a horizontal rule may include “−”, and “*”, which may be repeated a plurality of times to form a horizontal rule. Any combination of the characters may be used to form a horizontal rule, and a combination thereof.
• A horizontal rule is determined by referring to horizontal-rule characters registered in the horizontal-rule character register12.FIG. 12 shows horizontal-rule characters registered in the horizontal-rule character register12. When a horizontal-rule character is continuously repeated on one line, and terminates on that line, it is determined that the horizontal-rule character forms a horizontal rule. The horizontal-rule characters may be registered in advance. Any addition, modification, or deletion may be made to, on, or from the registered information by a user in the horizontal-rule character register12.
• Once a block has been specified based on the horizontal-rule characters in this way, a horizontal-rule tag is added to the lines above and below the horizontal rule.FIG. 11B shows that the document shown inFIG. 11A is tagged with horizontal-rule tags. Tags <TC_TSF_BLOCK> and </TC_TSF_BLOCK> indicating a block use parameter “type=1” to indicate that a section enclosed by the pair of tags is block-structured data based on the horizontal-rule character of Type=1.
• Returning toFIG. 6, after the process in steps S204 to S206, the process proceeds to steps S207. In step S207, a blank line contained in the text data is checked by a blank-line determining unit (not shown). In step S208, a section defined between the blank lines is tagged with a block tag which identifies that section as a block.
• FIGS. 13A and 13B shows tagging for blank lines with block tags. In text shown inFIG. 13A, a blank line that consists of blank or white-space characters is checked in the text line-by-line. In the example shown inFIG. 13A, the first line, the middle line, and the last line are identified as blank lines. The sections between the blank lines are determined as blocks, each block being tagged with a starting tag <TC_TSF_BLOCK> and a closing tag </TC_TSF_BLOCK>. The tags <TC_TSF_BLOCK> and </TC_TSF_BLOCK> indicating a block use parameter “type=0” to indicate that a section enclosed by the pair of tags is plain-text block-structured data of Type=0, which is defined between blank lines.
• After the process in steps S207 to S208, the process proceeds to steps S209. In step S209, a portion of the text data that uses a regular expression is detected by the regular-expression determining unit29. In the example shown inFIG. 2, the regular-expression determining unit29 and the regular-expression register30 are shared by theblock dividing unit10 and thedocument structuring unit21. In step S210, it is determined whether or not the detected portion is a block indicated using a two-dimensional regular expression. If YES is obtained, then, in step S211, this portion is tagged with a regular-expression block tag which is defined as indicating a block indicated using a two-dimensional regular expression.
• FIGS. 14A and 14B schematically show tagging for a two-dimensional regular expression. InFIG. 14A, if the document contains a section defined by a predetermined pattern, regular-expression patterns registered in the regular-expression register30 is referred to by the regular-expression determining unit29 to determine whether or not the pattern matches a two-dimensional regular expression.
• FIG. 15 shows regular expressions registered in the regular-expression register30. This information includes standard one-dimensional regular expression patterns that are placed at the beginning and end of a block, respectively, data indicating the maximum number of lines which is permitted between the patterns, and data indicating the type of tag added to the block that is determined as a two-dimensional regular-expression block. The regular expressions may be registered in advance. Any addition, modification, or deletion may be made to, on, or from the registered information by a user in the regular-expression register30.
• In the example shown inFIG. 15, in a block starting with double “((black star)”, namely, “((”, and ending with the corresponding end pattern “((”, if five text lines or less are between these patterns, it is determined that the starting and end patterns correspond to the start and end of the block, respectively, and are tagged with tags <TC_TSF_BLOCK> and </TC_TSF_BLOCK> indicating a block. The tags <TC_TSF_BLOCK> and </TC_TSF_BLOCK> indicating a block use parameter “type=101” to indicate that a section enclosed by the pair of tags is block-structured data based on the two-dimensional regular expression of Type=101. In this example, the block-structured data based on a two-dimensional regular expression also indicates a heading, and is also tagged with a tag using parameter “tag=HEAD”.
• As shown inFIG. 14B, further, for example, if text data contains a line in which any combination of symbols “\”, “−”, and “+”, and alphabetic letters “A” to “Z” is repeated in a continuous manner and which ends with the corresponding end pattern, the line is identified as a block. Then, the line is tagged with tags <TC_TSF_BLOCK> and </TC_TSF_BLOCK> indicating a block. The tags <TC_TSF_BLOCK> and </TC_TSF_BLOCK> indicating a block use parameter “type=101” to indicate that a section enclosed by the pair of tags is block-structured data based on the two-dimensional regular expression of Type=101. In this example, the block-structured data base on a two-dimensional regular expression also indicates a horizontal rule, and is also tagged with a tag using parameter “tag=HR”.
• The data registered in the regular-expression register30, and the regular-expression determining unit29 can be used for the general purpose, and are shared by theblock dividing unit10 and thedocument structuring unit21 for tagging, as described above. Then, in a tag corresponding to block-structured data and a tag corresponding to sentence-structured data, a regular expression described therein is checked. Therefore, it is automatically determined which process of theblock dividing unit10 or thedocument structuring unit21 the described data is used for, by using a tag added thereto.
• After the process in steps S209 to S211, the process proceeds to step S212. In step S212, it is determined whether or not the text data to be processed has been completely processed. If it is determined that the processing for the text data has not been completed, the process returns to step S200. If it is determined that the text data has been completely processed, the series of process for dividing data into blocks ends.
• If it is determined in step S200 that the text data is not in a plain text format, the process proceeds to step S220. In this case, the text data is in a tagged text format. In step S220, it is determined by the used-tag determining unit18 whether or not an unwanted tag that is not used in thedocument processing apparatus300 is embedded in the text data in a tagged text format (hereinafter referred to as a “tagged text”).
• A tag embedded in the tagged text is detected, and it is determined in step S221 whether or not the detected tag is used for sentence extraction in thedocument processing apparatus300. If it is determined that the detected tag is not used, the process proceeds to step S222, in which that tag is deleted. A tag paired with that tag would also be deleted. If the unwanted tag is deleted or if it is determined in step S221 that the detected tag is used, the process proceeds to step S209.
• FIGS. 16A and 16B show how an unwanted tag is deleted from tagged text. In the tagged text shown inFIG. 16A, tags are detected line-by-line. Then, it is determined by the used-tag determining unit18 whether or not the detected tag is a tag registered in the used-tag register19.FIG. 17 shows a list of used tags which are registered in the used-tag register19. In the table shown inFIG. 17, used tags are listed in the left column, and non-use tags to be deleted are listed in the right column. In the example shown inFIG. 17, the closing tags corresponding to the registered tags, and a parameter used in the starting tags are not shown. The used tags and the non-use tags may be registered in advance. Any addition, modification, or deletion may be made to, on, or from the registered tags by a user in the used-tag register19.
• By referring to the list of the used tags, an unwanted tag to be deleted is detected in the tagged text shown inFIG. 16A. In the example shown inFIG. 16A, tag <!-- . . . --> indicating a comment and tag <A> indicating reference of other documents are registered as non-use tags, and these tags and the corresponding closing tags are deleted, resulting tagged text shown inFIG. 16B, by way of example.
• Although not shown in the flowchart ofFIG. 6, a character position tag indicating the character position on each line of original text data is added by thecharacter position memory16.FIGS. 18A and 18B show tagging for the character position on each line. A tag at the beginning of each line indicates the character position on that line. Parameter “pos=nn”, where nn denotes a numerical value, indicates at what number of byte of data from the beginning of a block containing the line in that block the beginning of the line is positioned. Parameter “top=nn” indicates to what number of line the line corresponds in a block containing the line. Parameter “left=nn” indicates with what number of data from the left the line starts. Parameter “right=nn” indicates at what number of byte of data from the left the end of the line is positioned. Although not shown inFIG. 18B, parameter “row=nn” indicates the number of lines of data in a block. Parameter “cols=nn” in the tag <TC_TSF_BLOCK> indicates the maximum number of characters per line in a block.
• In tagged text such as HTML, a formatted-text section enclosed by tags <PRE> and </PRE> may be subject to the same process as the process for dividing text data in a text format into blocks, such as the process in steps S201 to S211 inFIG. 6.
• In this way, the text data is block-structured by theblock dividing unit10. The block-structured text data is stored in the block-structured-data storage20. The text data is tagged with tag <?TSF . . . ?> unique to thedocument processing apparatus300 indicating data that is divided into blocks. The block-structured text data may also be stored in an external storage device via thedisk drive122 or the external I/O123.
• If it is determined by the text-format determining unit5 that the input text data stored in theconversion buffer9 is a tagged text in a non plain text format, the input text data is tagged with the tag <?TSF . . . ?>, and is stored in the block-structured-data storage20 in the same manner as block-structured text data.
• The text data may be stored in the block-structured-data storage20 with a comment such as tag <!-- . . . --> in tagged language such as HTML being removed from the text data.
• The present invention is not limited to the order of the process in the flowchart ofFIG. 6. In the flowchart ofFIG. 6, the process may be broken into four sections, namely, steps S201 to S203 to check for a ruled-line character, steps S204 to S206 to check for a horizontal-rule character, steps S207 to S208 for a block break using a blank line, and steps S209 to S211 to check for a regular expression. These sections are interchangeable in order.
• Following the process in step S30′ inFIG. 4, the block-structured data is tagged in each block to structure the document. That is, the block-structured data is passed to thedocument structuring unit21 by thecontroller1 in order to convert the block-structured data into tree-structured tagged text.
• FIG. 19 is a flowchart of a process for structuring the document which is performed by thedocument structuring unit21. The process in the flowchart ofFIG. 19 is executed block-by-block in the block-structured data, and, in each block, is executed line-by-line.
• In step S300, it is determined by theunderline determining unit22 whether or not a underline character is contained in the block-structured data. A character string which it is determined in step S301 that is specified by an underline character is tagged with an underline tag indicating an underlined character string. As used herein, the “underline character” means a character which appears as underlining the character thereabove. The underline character is used to emphasize the character above the underline character.
• FIGS. 20A and 20B shows how a character string emphasized with an underline by underline characters is tagged with an underline tag indicating underline emphasis. As shown inFIG. 20A, underline characters are inserted to the block-structured data to emphasize character strings or a phrase “cherry trees”. The underline characters may be “□P” or “˜”, and are inserted on a line below the line containing a character string or character strings to be emphasized by the underline characters.
• Theunderline determining unit22 refers to underline characters registered in the underline character register23 to check for an underline character.FIG. 21 shows underline characters registered in theunderline character register23. More than a predetermined number of underline characters appear in a continuous manner to underline the character string above the underline characters, and the character string is identified as being emphasized. The underline characters may be registered in advance. Any addition, modification, or deletion may be made to, on, or from the registered underline characters by a user theunderline character register23.
• Once an underline character has been specified in this way, the character string emphasized by the underline character is tagged with underline tags <EM underline=“□P”> and </EM> indicating underline emphasis. Furthermore, the line containing the underline character can be deleted, or can be removed after a predetermined comment is added thereto. The underline tag indicates that an underline character quoted with “ ” in a parameter is used for underline emphasis.
• After the process in steps S300 to S302, the process proceeds to step S303, in which it is determined by thequotation determining unit24 whether or not a quotation character is placed at the beginning of a line in the block-structured data. In step S304, it is determined whether or not a line (character string) into the quotation character is inserted at the beginning of the line is quoted in, for example, an e-mail message. If YES is obtained, then, in step S305, the quotation character of that line is removed, and a quotation tag indicating which type of the quotation character is added to that line.
• FIGS. 22A and 22B show tagging for a character string which uses a quotation character indicating a quotation from a different document. In this example, symbol “?” is used as a quotation character, and is inserted to the beginning of a quoted line or character string.
• Thequotation determining unit24 refers to quotation characters registered in thequotation character register25 to check for a quotation character.FIG. 23 shows quotation characters registered in thequotation character register25. If a registered quotation character appears at the beginning of two lines or more, it is determined that the lines at the beginning of which that quotation character is inserted are quoted lines of, for example, an e-mail message. As shown as an example inFIG. 22B, a line identified as a quoted line has a quotation character removed therefrom, and is tagged with quotation tags <BLOCKQUOTE header=“?”> and </BLOCKQUOTE> indicating a quotation. The quotation tags indicate that a section enclosed thereby is a quoted section, and uses parameter “header” to indicate what type of quotation character is inserted to the section. That is, a character or symbol used as a quotation character is quoted with “ ” in parameter “header=“?””.
• In an embodiment of the present invention, as shown inFIG. 22B, once a quoted section has been specified, this quoted section is enclosed by quotation tags, and is further enclosed by tags <P> and </P> indicating a paragraph in HTML and by tags <PRE> and </PRE> indicating formatted text. In the block-structured data, tags <TC_TSF_BLOCK> and </TC_TSF_BLOCK> indicating a block are deleted.
• A quotation character added to original block-structured data may also be tagged with a tag indicating a quotation character.FIGS. 24A and 24B show an example in which quotation characters are tagged. Quotation characters are detected in data shown inFIG. 24A, and the quotation characters themselves are tagged with tags <QUOTE> and </QUOTE> indicating a quotation character, as shown inFIG. 24B.
• A tag indicating a quotation character may use a parameter indicating an attribute of quotation, such as a quoted person or the depth of quotation, according to the type of quotation characters, duplication of a quotation character, etc., in the original data.
• Although a section having two lines or more at the beginning of which a quotation character is inserted is identified as a quoted section in the above description, the present invention is not limited to this form. For example, a section which spans more than a specified number of series of lines at the beginning of which a quotation character is inserted may also be identified as a quoted section. The number of lines may be specified by a user, or may be previously determined.
• Furthermore, in block-structured data of input text, any block containing a quotation, and the other blocks may also be identified as a quotation even though a line starting with a registered quotation character does not continuously appear in the block-structured data. Thus, if two ore more consecutive lines containing a quotation are located at any position in the block-structured data, only one line containing the quotation may also be identified as a quoted line. Furthermore, any number of lines starting with a quotation may be identified as a quoted line.
• After the process in steps S303 to S305, the process proceeds to step S306. In step S306, it is determined by the heading determiningunit26 whether or not the block-structured data contains a heading. A heading line is checked for in step S307, and is then tagged with a tag indicating a heading line in step S308.
• FIGS. 25A and 25B show tagging for a heading line which is detected. As shown inFIG. 25A, symbol “(double circle)” is used as a heading character in the block-structured data to indicate that the line containing this heading character is a heading line. A heading character is checked by referring to heading characters registered in the headingcharacter register27.FIG. 26 shows heading characters registered in the headingcharacter register27. When a character identical to a registered heading character appears at the beginning of a line in a block, that line is identified as a heading line. The heading characters may be registered in advance. Any addition, modification, or deletion may be made to, on, or from the registered heading characters by a user in the headingcharacter register27.
• Once a heading line has been specified in this way, as shown as an example inFIG. 25B, the heading line is tagged with tags <HEAD> and </HEAD> indicating a heading line. It is determined that a line is a heading line if that line contains a heading character and if a character wrapping to the next line, such as comma “,”, is placed at the end of that line.
• According to an embodiment of the present invention, as shown inFIG. 25B, once a heading line has been specified, in a block containing the heading line, the specified heading line is enclosed by tags indicating a heading line, while the other lines in that block are enclosed by tags <P> and </P> indicating a paragraph in HTML and by tags <PRE> and </PRE> indicating a formatted text in HTML. In that block, tags <TC_TSF_BLOCK> and </TC_TSF_BLOCK> indicating a block are deleted.
• Based on the character position indicated by a character position tag or the number of characters on a line, the heading determiningunit26 determines whether or not a line in a block includes a centered or indented character string to check for a heading according to the result.FIGS. 27A and 27B show that a centered character string is identified as a heading. As shown inFIG. 27A, if character string “Question” is a centered character string, it is determined that the line containing this character string is a heading line, and the line is tagged with a tag indicating a heading line, as shown inFIG. 27B.
• Based on the character position indicated by a character position tag, the heading determiningunit26 may also determine whether or not a line in a block is shifted to the left with respect to the other lines in that block to check for a heading.FIGS. 28A and 28B show that a character string is identified as a heading based on the character position. As shown inFIG. 28A, if a character string “Question” is shifted to the left with respect to the other lines in that block, it is determined that the line containing this character string is a heading line, and the line is tagged with a tag indicating a heading line, as shown inFIG. 28B.
• The heading determiningunit26 may also determine whether or not a line in a block is a line including a character string bracketed with predetermined symbols to check for a heading. For example, it is determined whether or not a character string bracketed with a pair of predetermined brackets terminates within a line.FIGS. 29A and 29B show that a bracketed character string is identified as a heading. As shown inFIG. 29A, if a character string “Question” is bracketed with square brackets, it is determined that the line containing this character string is a heading line, and the line is tagged with a tag indicating a heading line, as shown inFIG. 29B.
• A bracket indicating a heading line may be registered by a user as desired, or may be registered in advance. Any addition, modification, or deletion may be made to, on, or from user-registered brackets.
• If lines each of which is identified as a heading line according to the above-noted heading determining process appears in a sequential manner under the same condition, the heading determiningunit26 may further determine that these lines form list items, and the lines are then tagged with a tag.FIGS. 30A and 30B show list items. In the block shown inFIG. 30A, “1.”, “2.”, and “3.” are registered as heading characters to identify lines containing the heading characters as heading lines. Since the lines identified as heading lines appear in a sequential manner under the same condition, it is determined that the lines are list items. Then, the lines are tagged with tags <L1> and </L1> indicating a list item in HTML, as shown inFIG. 30B.
• After the process in steps S306 to S308, the process proceeds to step S309, in which it is determined by thetable determining unit28 whether or not a table is contained in the block-structured data. If the block-structured data is in a tagged text format, for example, in an HTML format, and the block-structured data is tagged with tags <TABLE> and </TABLE> indicating a table in HTML, it is determined that the data contains a table, and the tags are used without change.
• If the block-structured data is in a plain text format, in step S310, ruled lines detected by the ruled-linecharacter determining unit13 in steps S201 to203 inFIG. 6 are used to detect cells that configure a table to extract a cell from the table.FIG. 31 shows a table formed by ruled-line characters contained in the block-structured data. In the block-structured data, the table shown inFIG. 31 is tagged with tags <TC_TSF_BLOCK type=10> and </TC_TSF_BLOCK> indicating a ruled-line character, as described above with reference toFIG. 7B. Ruled-line characters are extracted based on the tags to analyze the type of the ruled-line characters used and the viewing position of the ruled-line characters, so that the a cell can be extracted from the table.
• For example, all lines enclosed by tags indicating a ruled-line character are scanned to extract lines consisting of ruled-line characters, and lines containing a mixture of ruled-line characters (vertical ruled-lines in this example) and normal characters. It is also determined whether or not the scanned portions are surrounded by the ruled-line characters. A section surrounded by ruled-line characters may be identified as a table. The position at which vertical ruled-lines appear on each line is recorded, and the maximum number of cells is calculated. Based on the position of vertical ruled-lines and the maximum number of cells in row, it is determined whether or not cells are connected in row. The table is thus parsed.
• In step S311, an extracted cell is tagged with, for example, tags indicating a table in HTML.FIG. 32 shows that the table shown inFIG. 31 is segmented into cells which are extracted and then tagged with tags indicating a table. The extracted cells are enclosed by tags <TD> and </TD>. The cells aligned in the same row are enclosed by tags <TR> and </TR>.
• In the example shown inFIG. 32, character strings in each cell are handled as a block. A cell spanning a plurality of rows or columns would be tagged with a tag <TD> which uses parameter “rowspan=“nn”” or “colspan=“nn”” indicating what number of rows or columns the cell spans. In the example shown inFIG. 32, a cell, such as “Software 1”, “Software 2”, or “Software 3”, which spans a plurality of rows, as shown inFIG. 31, is identified as a cell spanning a plurality of rows (three rows in this example), and is tagged with a tag <TD rowspan=“3”>.
• After the process in steps S310 to S311, the process proceeds to steps S312, in which a regular expression contained in the text data is checked by the regular-expression determining unit29. The regular-expression determining unit29 executes the same process as the process in steps S209 to S211 inFIG. 6 which is executed by theblock dividing unit10. In step S313, the data registered in the regular-expression register29 is searched for only data satisfying conditions relating to the tags to be processed by thedocument structuring unit21. As a result of search, in step S314, the data satisfying the conditions is tagged with specified tags.
• FIGS. 33A and 33B show regular expressions in the block-structured data.FIG. 33A shows the same contents as that inFIG. 14A, showing block-structured data after the process in steps S209 to S211 inFIG. 6. After the process in steps S312 to S314, the block-structured data is tagged with tags <HR> and </HR> and tags <HEAD> and </HEAD> indicating a horizontal rule based on a regular expression, in place of tags <TC_TSF_BLOCK type=101 tag=HR> and </TC_TSF_BLOCK>, and tags <TC_TSF_BLOCK type=101 tag=HEAD> and </TC_TSF_BLOCK>, as shown inFIG. 33B.
• The tagging process in steps S312 to S314 is performed after a block based on a regular expression, as shown inFIG. 14, by theblock dividing unit10.
• After the process in steps S312 to S314, the process proceeds to step S315, in which a blank line for a block break in each block is checked by the blank-line determining unit31.FIGS. 34A and 34B show a block break using a blank line.
• In the flowchart ofFIG. 5, if the block-structured data is in a plain text format, a block break has been performed in steps S207 and S208 inFIG. 6 by theblock dividing unit10.
• If the block-structured data is in a tagged text format, however, a block into which the data is once divided may be potentially divided into sub-blocks at a blank line, as shown inFIG. 34A, by way of example. Then, in step S316, it is determined whether or not the block contains a blank line. If YES is obtained, then, in step S317, the block is further divided into sub-blocks at the blank line in the block, and the divided sub-blocks are tagged with a tag indicating a block. In this example, the sub-blocks are tagged with tags <P> and </P>, and tags <PRE> and </PRE>.
• After the process in steps S315 to S317, the process proceeds to step S318, in which the matching of quotation marks in a block or blocks is checked by the quotation-mark determining unit32.FIGS. 35A and 35B show how matching of quotation marks is checked by the quotation-mark determining unit32. For example, as shown inFIG. 35A, if a pair of quotation marks are placed in two blocks, it is determined that the quotation marks do not match in a block. In step S318, matching of quotation marks in a block is checked, and it is determined in step S319 whether or not the quotation marks match. If it is determined that the quotation marks do not match in the block, the process proceeds to step S320, in which matching of the quotation marks in that block and the adjacent block is checked. If the quotation marks match in the block and the adjacent block, these blocks are merged into one block, as shown inFIG. 35B.
• After the process in steps S318 to S320, the process proceeds to step S321, in which a paragraph break in a block is checked by theparagraph determining unit33. Theparagraph determining unit33 checks for the position at which each line starts in a block. If lines start at two different positions in a block, it is determined that a line starting at a position shifted to the right with respect to the other position introduces a new paragraph. Then, the block is divided into sub-blocks.
• A threshold shifting amount by which it is determined that a line introduces a new paragraph is predefined, and is stored in theHDD114 or the like. If the shifting amount of a line is over this threshold, it is determined that the line does not introduce a new paragraph.
• FIGS. 36A and 36B show that a block is divided based on a paragraph break. In step S321, a line whose start position is shifted to the right in the block shown inFIG. 36A is determined. For example, if it is determined in step S322 that the shifting amount of the line is within the threshold, and it is determined that a paragraph break is formed before the line, then, in step S323, the line is tagged with a tag indicating a paragraph.FIG. 36B shows that tags indicating a paragraph are added. In this example, tags <P> and </P> and tags <PRE> and </PRE>, which indicate a paragraph, are added to the sub-blocks into which the block is divided at a paragraph break.
• The position information for each line which is stored in thecharacter position memory16 may be used to check for a paragraph break.
• After the process in steps S321 to S323, the process proceeds to step S324, in which an English sentence is checked by the English-sentence determining unit34. In step S325, it is determined whether or not a line in a block consists of alphanumeric characters or symbols. If YES is obtained, then, it is determined that the line is an English line.
• If an English line continuously appears in a block, in step S326, end-of-line processing for English-sentence processing is performed. Specifically, if a line ends with the hyphen (“-”), the hyphen and the carriage return symbol next thereto are deleted so that the end-of-line word wraps to the first word of the next line into one word. If a line does not end with a delimiter such as the comma (“,”) or the period (“.”), but ends with an English word, a white space is inserted between the end-of-line word and the first word of the next English line, while the carriage return symbol is deleted from the line. A tag <POS . . . eol=1 or 0> indicates a relationship between a line and the next line. Parameter “eol=1” indicates that a line is continued to the next line.
• Accordingly, after the process in steps S300 to S326, the process proceeds to step S327, in which it is determined whether or not, for example, the document data stored in thedocument data storage4 has been completely processed. If it is determined that any block has not been processed, the process proceeds back to step S300 to perform the sequence of process on the unprocessed block.
• The present invention is not limited to the order of the process in the flowchart ofFIG. 19. In the flowchart ofFIG. 19, the process may be broken into nine sections, namely, steps S300 to S302, steps S303 to S305, steps S306 to S308, steps S309 to S311, steps S312 to S314, steps S315 to S317, steps S318 to S320, steps S321 to S323, and steps S324 to S326. These sections are interchangeable in order.
• If it is determined that all the input document data has been completely processed, lines, such as Japanese lines, which are identified as non-English lines by the English-sentence determining unit34 and in which the carriage return symbol still remain in an untagged form in the block are all continued. A white space, as a character string, at the end of a line or at the beginning of a line is deleted, and the presence of a white space is recognized based on the start position of the line and the number of characters on the line. A tag <pos . . . eol=1 or 0> indicates a relationship between a line and the next line. Parameter “eol=1” indicates that a line is continued to the next line.
• Thedocument structuring unit21 segments each block into sentences based on the period (“.”).FIGS. 37A and 37B show that a block is segmented into sentences based on the period (“.”). The block shown inFIG. 37A is segmented into sentences based on the period (“.”), and the resulting sentences are then tagged with a predetermined tag, as shown inFIG. 37B.
• The block shown inFIG. 37A is segmented into sentences every period (“.”) Each of the segmented sentences is tagged with tags <PRE> and </PRE>, thus indicating one sentence. If a line break occurs in one sentence, the tag <pos . . . eol=1> indicates the line-break position, or the end-of-line position, and indicates that the line continue to the next line.
• Through the foregoing process, a document is structured with a tag using a sentence as a minimum unit to generate sentence-structured data. Accordingly, each block segmented into sentences is tagged with a document format assertion tag <?SSF . . . ?> unique to thedocument processing apparatus300 indicating sentence-structured data.
• The sentence-structured data tagged with a document format assertion tag <?SSF . . . ?> is stored in the sentence-structured-data storage35. As an alternative, the sentence-structured data may be stored in, for example, a storage medium external to thedocument processing apparatus300 via thedisk drive122 or the external I/O123. The sentence-structured data may also be transmitted to an external network via the communication I/F115, and may be stored in another storage connected to the network.
• Accordingly, the input text is determined in type, and is converted into structured text which is tagged so as to be processed sentence-by-sentence in a uniform character coding. In the above description, a so-called filter system for converting plain-text data which cannot be processed sentence-by-sentence into tagged text such as HTML text has been introduced. Now, a system for processing structured text which has been converted is described.
• According to the present invention, sentence-structured data, which can be processed sentence-by-sentence, is structured into a tree, for example, according to tags added to the data. A template which is used to determine whether or not a sentence is extracted according to the type of tags may be used. An action tag indicating the process of an application on an extracted sentence, which is allocated to each tag, may be used.
• FIG. 38 is a flowchart of a process for extracting a sentence from tree-structured sentence-structured data. In step S400, tree-structured data is generated from sentence-structured data.FIG. 39 schematically shows example tree-structured data. Each ofdata200,201,202, and203 includes “pointer to higher layer of hierarchy” and “pointer to lower layer of hierarchy”, which represent position information indicating higher/lower (previous/next) layers of hierarchy, “pointer to upward node in the same layer” and “pointer to downward node in the same layer”, which represent position information indicating previous/next tagged information in the same layer, “character string of this node” which forms the substantial body of the data, and “tag information” indicating a tag which is added to the “character string of this node”.
• A higher (previous) layer of hierarchy is located more at the left side inFIG. 39. Thus, thedata200,201, and202 are arranged in this order as to the arrangement of sentences, and layers of hierarchy are arranged in this order. A high and low (previous and next) relation in the same layer of hierarchy is also defined, such that an earlier sentence in the same layer is higher (previous). Thedata201 and203 are in the same layer, and thedata201 appears earlier. A tree structure is established based on the high and low (previous and next) relation. In a tree structure, thedata200,201,202, and203 are referred to as nodes.
• Referring back toFIG. 38, in step S400, sentence-structured data is structured into a tree according to the tags added to the sentence-structured data and the sequence of the sentence-structured data. Thesentence extractor36 extracts a sentence using the tree-structured data, and the tree-structured data facilitates migration in a unit of layer and migration in a unit of sentence in the same layer of hierarchy in order to extract a new sentence.
• Once tree-structured data is generated, the process proceeds to step S401. As described above, according to an embodiment of the present invention, a template may be used to extract a sentence from tree-structured data. A template is registered in thetemplate register43, for example, according to the instruction of a user, and is stored in the sentence-extraction-template storage44. In step S401, a template adaptable to the tree-structured data generated in step S400 is searched from the registered templates. Such a template is searched based on a text ID added to the data to be processed. The template and template search are described below.
• In step S402, it is determined whether or not the searched template is adapted. If it is determined that the template is adapted according to the instruction of a user, the process proceeds to step S411. The process in step S411 and the subsequent steps to adapt or create a template are described below. If it is determined that the template is not adapted, the process proceeds to step S403.
• In step S403, theextraction mode42 is referred to. Using theextraction mode42, it is determined whether or not a sentence is extracted with respect to a tag added to data.FIG. 40 shows examples of theextraction modes42. It can be determined whether or not a sentence is extracted with respect to each element corresponding to each tag. In this example, a sentence tagged with a tag corresponding to the element that is turned “ON” is extracted, while a sentence tagged with a tag corresponding to the element that is turned “OFF” is not extracted.
• Theextraction mode42 is specified according to the instruction of a user, and is stored in, for example, theHDD114. Alternatively, anextraction mode42 in which each element is turned “ON” or “OFF” may also be stored asdefault extraction mode42 in advance in, for example, theHDD114.
• Then, tags are sequentially detected, and it is determined in step S404 whether or not a detected tag is a tag for extraction. If it is determined that the detected tag is not a tag for extraction, the process proceeds to step S409.
• If it is determined in step S404 that the detected tag is a tag for extraction, the process proceeds to step S405. In step S405, it is determined whether or not the tag indicates a table. If it is determined that the tag does not indicate a table, the process proceeds to step S407. If it is determined that the tag indicates a table, the process proceeds to step S406, in which table processing is performed.
• As described above, a table is tagged by thedocument structuring unit21 for each cell. Thus, thesentence extractor36 can extract a sentence for each cell row-by-row or column-by-column from tree-structured data. As described above with reference toFIGS. 31 and 32, a sentence can be extracted for each cell according to the tags <TD> and </TD>, and can be extracted row-by-row or column-by-column according to the tags <TR> and </TR>. Such table processing in step S406 enables a sentence to be extracted from the table.
• According to an embodiment of the present invention, when a sentence is extracted from a table, the unit table41 is referred to, and an appropriate unit can be added to the extracted sentence.FIG. 41 is an example of the unit table41. The unit table41 contains a plurality of units in various forms. The unit table41 having predetermined units registered in advance therein is stored in, for example, theHDD114. A user may register units in the unit table41.
• At the time when a sentence is extracted from a table, data has been structured into a tree, and each cell has been tagged with a tag. For example, if a cell containing a unit, which is registered in the unit table41, at the first table row or column, and a cell consisting of numerical information in the subsequent table row or column are repeated, the unit table41 is referred to, and sentences having a numerical section endowed with the unit in the corresponding row or column can be extracted from the cells. It can be determined according to theextraction mode42 whether or not a unit is added to a sentence (numerical value) in a cell.
• While a unit has been described, the present invention is not limited thereto. For example, a cell may be extracted together with a character string described in the first table row or column. In this case, again, it can be determined according to theextraction mode42 whether or not the content of cell in the first row or column is added.
• Although not clearly illustrated inFIG. 38, an extraction process using theextraction mode42 may also be performed on other tags, in addition to a table tag.
• For example, when text is sequentially extracted, if quotation extraction is enabled in theextraction mode42, a section tagged with a quotation tag in sentence-structured data is also extracted. If quotation extraction is disabled in theextraction mode42, however, a sentence can be extracted while ignoring a quoted section. If quotation extraction is enabled in theextraction mode42, based on a parameter used in a tag indicating a quotation, thetag determining unit39 determines the type of quotation symbol used.
• The process proceeds to step S407, in which it is determined whether or not a user tag defined by a user is contained in the data. According to an embodiment of the present invention, therefore, a user can define a tag, and can allocate a predetermined action to an existing tag and a user-defined tag. A tag defined by a user, and a tag to which a predetermined action is allocated by a user are referred to as a “user tag”. An action allocated to a tag by a user is registered in the tag-action-data register40 as tag action data. The tag action data is stored in, for example, theHDD114.
• FIG. 42 shows example tag action data. As shown inFIG. 42, a predetermined action can be allocated to existing tags in HTML, such as <H> and <TABLE>. Furthermore, a user can define his own tags, such as <USER_—01>, <USER_—02>, and <USER_—03>, and predetermined actions may be allocated to for the predefined tags.
• A tag to which an action is allocated may be used in combination with a normal display device to display a sentence with the tag in a style according to variations in attribute, such that the sentence is displayed in a different color, is highlighted, or is underlined on the display device. A tag to which an action is allocated may be used in combination with a text reading aloud apparatus to read aloud a sentence with the tag in a different voice or at a different rate according to variations in attribute.
• Taking a tag indicating a heading as an example, a heading section in a document may only be colored, or may be read aloud, or read aloud in a different voice.
• In particular, a tag indicating a heading, a tag indicating a quotation, and a tag indicating a paragraph have a significant meaning in the document structure. It is useful on a display device or a text reading aloud apparatus to take predetermined actions on sentences corresponding to these kinds of tags.
• Returning toFIG. 38, in step S407, tag action data is referred to by thetag determining unit39 to check for a sentence tagged with a tag registered in the tag-action-data register40. If it is determined that there is no sentence tagged with a tag registered in the tag-action-data register40, the process proceeds to step S409.
• If it is determined in step S407 that there is a sentence tagged with a tag registered in the tag-action-data register40, the process proceeds to step S408, in which an action set for the tag-action-data register40 is taken on the sentence tagged with that tag.
• For example, if a highlighting action is allocated to a tag, a sentence tagged with the tag, the tag, and the action data defined for the tag are passed to thecontroller1 via thesentence extractor36 from thetag determining unit39. A predetermined display control signal is generated based on the above data by thecontroller1, and a display signal based on the display control signal is supplied to thedisplay device3. This allows the sentence specified by the tag to be highlighted on thedisplay device3.
• In step S409, it is determined whether or not the next sentence is also extracted. If it is determined that the next sentence is not extracted, the process ends. If it is determined that the next sentence is extracted, the process proceeds to step S410, in which it is determined whether or not all sentences to be processed have been completely processed. If all sentences to be processed have been completely processed, the process ends. If any sentence has not been processed, the process returns to step S402.
• If any sentence has not been processed in step S410, the process may return to step S404, as indicated by a dotted line inFIG. 38.
• Accordingly, in thesentence extractor36, tree-structured data is generated based on the sentence-structured data, and the tree structure is detected to extract a sentence.
• A template stored in the sentence-extraction-template storage44 is now described.
• A template is paired with tree-structured data, and each node is associated with flag information for determining whether or not that node is extracted. According to an embodiment of the present invention, when a sentence is extracted by thesentence extractor36, a template stored in the sentence-extraction-template storage44 is used to extract the sentence according to a sentence extraction method specified in the template.
• FIG. 43 shows the structure of a template stored in the sentence-extraction-template storage44. In a template, tags added to sentences and the hierarchical structure of the tags are described using each tag as a node, and each node is given a code indicating whether or not the node is extracted. Such a template is generated based on, for example, tree-structured data such that tree is constructed based on the tag information in the tree-structured data and the position information indicating a position relationship between nodes in the tree-structured data.
• In the template, a node indicated by “! (circle)” at a tree branch is a node to be extracted, and a node indicated by “((cross)” is a node not to be extracted. The higher a node is in a tree, the higher the priority. A template can be registered by a user from thetemplate register43. A template may also be prepared in advance and stored in, for example, theHDD114.
• A template may be registered by thetemplate register43 in the sentence-extraction-template storage44 in such a manner that the template is associated with an ID unique to data to which that template is adapted. This unique ID is shown as a text ID inFIG. 43. For example, the file name or URL (uniform resource locator) of the text data to which that template is adapted may be used as a text ID. This facilitates a search for a template adaptable to an input text.
• In documents whose formats are similar, such as newspaper articles, the same template may be commonly used for the documents. In this case, the file names or URLs of the documents may be possibly similar, and the file name or URL of a document file that is the source of the original template may be used to readily search for a template adaptable to the documents by a fuzzy search described below.
• Alternatively, for example, a template specified by a user may be used for input text.
• In thetemplate register43, the flag information in a template for each node may be pointed by theinput device2 on thedisplay device3. The following two methods for pointing the flag information may be contemplated.
• The first method is to point a text image on thedisplay device3 according to the tree-structured data, as shown inFIG. 44. InFIG. 44, an image of the text to be processed is rendered in two-dimensional manner according to the tree-structured data. As shown inFIG. 44, a predetermined pointing tool, such as a cursor, capable of moving on a screen of thedisplay device3 as themouse121, as theinput device2, moves may be used to point a section to be extracted. In this example, a sentence pointed by a cursor is switched to a non-extraction state by button operation of themouse121.
• The second method is to display a tree of the tree-structured data on which a node is pointed, as shown inFIG. 45. In this example, again, a cursor is used to point symbol “! (circle)” or “((cross)” indicating whether or not the sentence on a node is extracted. According to button operation of themouse121, the sentence may be switched between an extraction state and a non-extraction state. InFIG. 45, a sentence “E-mail Quotation” tagged with a tag <SPAN> is switched from an extraction state to a non-extraction state.
• Referring back to the flowchart ofFIG. 38, in step S402, if it is determined that the template is adapted, the process proceeds to step S411. In step S411, it is determined whether or not there is a template adaptable to the data to be currently processed. For example, a predetermined area of theHDD114 is searched by thetemplate search unit45 to check for the presence of the template.
• If a template is associated with a file name or a URL as described above, the template is verified by thetemplate search unit45 under control of thecontroller1. If thetemplate search mode46 sets a fuzzy search for the file names or URLs of the templates stored in the sentence-extraction-template storage44, thetemplate search unit45 determines that match is found between a character string specified by a search character and the file name or URL to be searched if both do not exactly match, and the template is adapted.
• FIG. 46 shows examples of thetemplate search mode46. In thetemplate search mode46, items of the template reference mode are specified which are used to search the sentence-extraction-template storage44 for a template to be adapted. In the example shown inFIG. 46, it is determined whether or not a fuzzy search using a text ID is made in order to search for a template, and, if a fuzzy search is made, the precision of the fuzzy search is determined. It is also determined whether or not a fuzzy adaptation is made in order to adapt a searched extraction template to the data, and, if a fuzzy adaptation is made, the precision of the fuzzy adaptation is determined.
• In addition to settings for a text ID or for a search or adaptation condition of a template, as shown inFIG. 46, settings for a template editing mode, automatic saving for a template, template mismatch warning, etc., are specified in thetemplate search mode46.
• FIG. 47 schematically shows an example fuzzy search based on a text ID. InFIG. 47, with respect to atext ID400 of text data input from theinput device2, a template corresponding to atext ID401 stored in the sentence-extraction-template storage44 is searched for. In thetemplate search mode46, a character string is referred to using a character-string search, such as a forward match search. In the example shown inFIG. 47, 40 bytes of a 49-byte character string of the storedtext ID401 match thetext ID400 of the input text data. In other words, approximately 82% of the character string of thetext ID401 matches thetext ID400, and the precision is 82%.
• Since the precision of fuzzy search using a text ID is 70% in thetemplate search mode46 shown inFIG. 46, it is determined that thetext ID400 matches thetext ID401. Then, the template can be adapted even if match is not exactly found therebetween in terms of the file name or URL.
• If a fuzzy search for a text ID is turned “OFF” in thetemplate search mode46, only when match is exactly found between thetext ID400 of the input text and thetext ID401 stored in the sentence-extraction-template storage44, a template corresponding to thetext ID401 is adapted.
• If a fuzzy adaptation of a template is turned “ON” in thetemplate search mode46, thetemplate search unit45 sequentially adapts a template from a higher node in the hierarchy of the tree-structured data. For fuzzy adaptation, an excessive or deficient node in the tree-structured data may be absorbed. The fizzy adaptation herein may be performed by any technique. For example, the type of tags used, the node position, and the number of tags of the same type may be used as measures of the precision.
• If a template fuzzy search is turned “OFF” in thetemplate search mode46, a template is adapted only when the template matches the tree structure of data to which the template is to be adapted.
• Based on the foregoing description with respect to a template, a template-related process shown inFIG. 38 is now described. If it is determined in step S402 that a template is adapted, the process proceeds to step S411, in which it is determined whether or not a template adaptable to the data to be currently processed is stored in the sentence-extraction-template storage44. The template is search for using the above-described fuzzy search.
• If it is determined that the adaptable template is stored in the sentence-extraction-template storage44, the process proceeds to step S412, in which the searched template is adapted to the data to be processed, for example, using the above-described fuzzy adaptation. After template adaptation, the process proceeds to step S413.
• If it is determined in step S411 that the adaptable template is not stored in the sentence-extraction-template storage44, the process proceeds to step S414. In step S414, a new template is created. For example, a new template is created by the method described with reference toFIG. 44 or45 based on the tree-structured data of the document data to be currently processed. The new template may be stored in the sentence-extraction-template storage44. After a template is created, the process proceeds to step S413.
• In step S413, it is determined whether or not the data to be process contains a node for extraction according to the template. If it is determined that a node for extraction is present, the process proceeds back to step S403, in which a sentence is extracted. If it is determined that a node for extraction is absent, the process proceeds to step S409, in which it is determined whether or not the next sentence is extracted.
• Accordingly, sections to be extracted and the other sections in text are pointed using a template. Since a fuzzy search is used to search for a template, the template may be adapted to the time-varying content such as the content which is refreshed on the Internet, while keeping tack of the content when the template is stored or reused.
• While thedocument processing apparatus300 according to the present invention is implemented in software running on, for example, a personal computer in the foregoing description, the present invention is not limited thereto. Thedocument processing apparatus300 may be incorporated into other apparatuses. As an example, thedocument processing apparatus300 together with a tool for providing an audio output in a synthetic voice according to text information may be incorporated in a robotic apparatus, thus achieving an advantage as if the robotic apparatus read aloud an e-mail message or text on a home page (web site) on the Internet.
• In this case, thedocument apparatus300 according to the present invention may be combined with a predetermined computer-manipulated mechanism, thereby setting an action according to tag action data.
• Furthermore, thedocument processing apparatus300 according to the present invention may be used for services on a network such as the Internet. Text on a typical home page which is publicly accessible on the Internet may be segmented into sentences, before being transmitted to a personal computer accessed thereto. As an application, a service may also be contemplated in which voices are synthesized according to text extracted from a typical home page (web site) and the resulting audio output is transmitted to a cellular telephone device.
• Furthermore, in a network, the components shown inFIG. 2 may be distributed into a plurality of servers, and the components distributed on the plurality of servers may be integrally processed. In this case, theinput device2 may be a cellular telephone device.
• As described above, according to the present invention, input text data is divided into blocks based on character patterns in the data, and the blocks are tagged with a tag indicating a block. The data divided into blocks is converted into structured data which is structured according to the tags indicating a block. The structured data is then structured into a tree, and sentences are extracted from the tree-structured data.
• According to the present invention, therefore, advantageously, text data can be controlled such that text is extracted without a quotation symbol in an e-mail message or elements in text, such as a table expressed by character-based ruled lines, are extracted.
• According to an embodiment of the present invention, advantageously, text in a plain text format, text in a tagged text format, and text in an e-mail format, which are typically processed by separate processors, may be unitarily presented and processed by a single processor. This advantageously makes a simplified system for document processing.
• According to an embodiment of the present invention, advantageously, sections to be extracted from tagged text and the other sections, which are typically processed manually because they cannot be determined only by tags, may be specified with ease.
• The present invention may advantageously be used for pre-processing of a system for reading aloud text in a synthetic voice, thereby achieving a system capable of readily reading aloud an e-mail message or a home page (web site) on the Internet.
• Accordingly, the present invention can provide various advantages for the overall text processing art.

Claims (84)

1. A document processing apparatus comprising:

block dividing means for dividing input document data into blocks in a predetermined manner according to the structure of the document data;

document structuring means for structuring the document data by parsing a block into which the document data is divided by said block dividing means according to the document structure of the block, and by adding tag information to text data constituting the block, said tag information indicating an attribute of the text data;

storing means for storing an extraction mode for determining whether or not a sentence is extracted with respect to a tag information added to text data; and

sentence extraction means for controlling an extraction of the text data according to the tag information added to the text data by said document structuring means and said extraction mode stored in said storing means.

2. A document processing apparatus according toclaim 1, wherein said block dividing means outputs block-structured data, said block-structured data being tagged with predetermined tag information indicating the blocks into which the document data has been divided by said block dividing means, and

said document structuring means processes said block-structured data.

3. A document processing apparatus according toclaim 1, wherein the input document data is generated by an external device, and said document structuring means processes block-structured data, said block-structured data being tagged with predetermined tag information indicating the blocks into which the document data has been divided by said block dividing means.

4. A document processing apparatus according toclaim 1, wherein said document structuring means outputs sentence-structured data, said sentence-structured data being tagged with predetermined tag information indicating the document data which has been structured by said document structuring means, and

said sentence extraction means processes said sentence-structured data.

5. A document processing apparatus according toclaim 1, wherein the input document data is generated by an external device, and said sentence extraction means processes sentence-structured data, said sentence-structured data being tagged with predetermined tag information indicating the document data which has been structured by said document structuring means.

6. A document processing apparatus according toclaim 1, further comprising:

text-format determining means for determining a text format type of the input document data,

wherein a document data output from said text-format determining means is input to said block dividing means.

7. A document processing apparatus according toclaim 1, further comprising text-format determining means including:

decoding means which determines an encoding method of the input document data to decode the document data; and

converting means for converting a character coding of the document data which is provided from said decoding means into a predetermined character coding,

wherein the document data whose character coding has been converted into the predetermined character coding by said converting means is input to said block dividing means.

8. A document processing apparatus according toclaim 7, wherein said text-format determining means further includes character-coding specifying means for specifying a processed character coding, and selects the character coding in place of the predetermined character coding.

9. A document processing apparatus according toclaim 8, wherein the document processing apparatus processes the document data according to an original character coding if said character-coding specifying means does not specify a character coding.

10. A document processing apparatus according toclaim 6, wherein said block dividing means identifies a blank line as a block break when it is determined by said text-format determining means that the input document data is in a text format.

11. A document processing apparatus according toclaim 6, wherein said block dividing means identifies, as the block, a group of lines having a same number of characters when it is determined by said text-format determining means that the input data is in a text format.

12. A document processing apparatus according toclaim 6, wherein said block dividing means identifies, as the block, a group of lines whose character string starts at a same position when it is determined by said text-format determining means that the input data is in a text format.

13. A document processing apparatus according toclaim 6, wherein said block dividing means identifies, as the block, a section enclosed by a predefined character string for a ruled line when it is determined by said text-format determining means that the input data is in a text format.

14. A document processing apparatus according toclaim 13, further comprising ruled-line character registering means which allows a user to register the character string for a ruled line.

15. A document processing apparatus according toclaim 6, wherein said block dividing means identifies a series of predefined characters or character strings as a ruled line, and identifies a section enclosed by the ruled line as the block when it is determined by said text-format determining means that the input data is in a text format.

16. A document processing apparatus according toclaim 15, further comprising continuous-character-based ruled-line character registering means which allows a user to register the series of characters or character strings which is identified as a ruled line.

17. A document processing apparatus according toclaim 15, further comprising continuous-character-number specifying means for specifying a number of characters or character strings which continuously appear to form a ruled line.

18. A document processing apparatus according toclaim 6, wherein said block dividing means identifies, as a block break, a break at a predefined character string for a horizontal rule when it is determined by said text-format determining means that the input document data is in a text format.

19. A document processing apparatus according toclaim 18, further comprising horizontal-rule character registering means which allows a user to register the character string for a horizontal rule.

20. A document processing apparatus according toclaim 6, wherein said block dividing means stores a character position of original text as the tag information when it is determined by said text-format determining means that the input document data is in a text format.

21. A document processing apparatus according toclaim 6, wherein said block dividing means identifies, as the block, a section specified by a function tag indicating a comment or a document type when it is determined by said text-format determining means that the input document data is in a tagged text format.

22. A document processing apparatus according toclaim 6, wherein said block dividing means performs a block dividing process on a section enclosed by tag information indicating formatted text when it is determined by said text-format determining means that the input document data is in a tagged text format, said block dividing process being performed when it is determined by said text-format determining means that the input document data is in an untagged text format.

23. A document processing apparatus according toclaim 6, wherein said block dividing means deletes disused tag information, which is not used in the document processing apparatus, of the tag information added to the input document data when it is determined by said text-format determining means that the input document data is in a tagged text format.

24. A document processing apparatus according toclaim 23, wherein a comment in predetermined tagged language is removed as the disused tag information.

25. A document processing apparatus according toclaim 23, wherein the document processing apparatus allows a user to register a table for differentiating the tag information to be used from the disused tag information.

26. A document processing apparatus according toclaim 1, wherein said document structuring means detects a cell from a block extracted based on characters used for a ruled line to separate a sentence from the cell, said cell being defined by a character used for a vertical ruled-line.

27. A document processing apparatus according toclaim 1, wherein said document structuring means detects a cell from a block extracted based on characters used for a ruled line to separate a sentence from the cell, said cell being defined by a character used for a vertical ruled-line, and stores a character pattern of the characters used for the ruled line as the tag information.

28. A document processing apparatus according toclaim 27, wherein said document structuring means adds different tag information to a cell containing a table heading and a unit and to a cell containing a numerical value.

29. A document processing apparatus according toclaim 1, wherein said document structuring means adds tag information indicating emphasis to a character string which is underlined with a predetermined underline character string in the text data in the block.

30. A document processing apparatus according toclaim 29, further comprising underline character registering means for registering an arbitrary character string as the predetermine underline character string.

31. A document processing apparatus according toclaim 1, wherein said document structuring means identifies, as a quoted line, a line of the text data in the block which starts with a quotation character string indicating a quotation, and separates a sentence from which the quotation character string has been removed from the quoted line.

32. A document processing apparatus according toclaim 31, wherein said document structuring means adds tag information indicating a quotation to the sentence from which the quotation character string has been removed, and separates the sentence.

33. A document processing apparatus according toclaim 31, wherein said document structuring means adds the tag information which uses a parameter indicating an attribute of quotation to the sentence from which the quotation character string has been removed, and separates the sentence.

34. A document processing apparatus according toclaim 31, further comprising quotation character string registering means for allowing a user to register an arbitrary character string as the quotation character string.

35. A document processing apparatus according toclaim 1, wherein said document structuring means identifies, as a quoted line, only a line of the text data in the block which starts with a quotation character string indicating a quotation, and adds tag information indicating a quotation character string to the quotation character string.

36. A document processing apparatus according toclaim 1, further comprising quotation character string registering means for allowing a user to register an arbitrary character string as a quotation character string indicating a quotation,

wherein said document structuring means compares a character string at a beginning of each line of the text data in the block with the quotation character string registered in said quotation character string registering means, identifies, as a quoted line in an e-mail message, a section in which a same character string as the quotation character string appears on two or more lines of the text data in the block, removes the same character string as the quotation character string from said section, and adds tag information indicating which quotation character string is used to quote said section.

37. A document processing apparatus according toclaim 36, wherein a number of consecutive lines in the quoted section which start with the same character string as the quotation character string is specified by a user.

38. A document processing apparatus according toclaim 1, wherein, if at least one block in the block-structured data uses a quotation, the at least one block and other blocks in the block-structured data are identified as quotations if lines which start with a quotation symbol indicating a quotation are not continued in the other blocks.

39. A document processing apparatus according toclaim 1, wherein a line starting with a quotation symbol is identified as a quotation.

40. A document processing apparatus according toclaim 1, wherein said document structuring means includes heading determining means for determining whether or not text in the block includes a heading character string indicating a heading, and

if it is determined by said heading determining means that the text in the block includes the heading character string, separates a sentence with tag information indicating a heading line being added to a line containing the heading character string.

41. A document processing apparatus according toclaim 40, wherein said heading determining means identifies, as the heading line, a line which starts with a top-of-heading character string used at a beginning of a line to indicate a heading and which does not end with a predetermined continue-character indicating that an end of line continues to the next line.

42. A document processing apparatus according toclaim 40, wherein said heading determining means registers an arbitrary character string as the top-of-heading character string.

43. A document processing apparatus according toclaim 40, further comprising heading character registering means which is processed by said heading determining means and which registers an arbitrary character string as a top-of-heading character string.

44. A document processing apparatus according toclaim 40, wherein said heading determining means identifies a centered line in the block as the heading line, and adds tag information indicating a heading line to the line.

45. A document processing apparatus according toclaim 40, wherein said heading determining means identifies, as the heading line, a line whose start position is shifted to the left with respect to the other lines in the block, and adds tag information indicating a heading line to the line.

46. A document processing apparatus according toclaim 40, wherein said heading determining means identifies, as the heading line, a line containing a character string bracketed with predetermined brackets indicating a heading.

47. A document processing apparatus according toclaim 1, wherein said document structuring means includes heading determining means for determining whether or not text in the block includes a heading character string indicating a heading,

if it is determined by said heading determining means that the text in the block includes the heading character string, and if heading lines each including the heading character string sequentially appear, determines that the heading lines form list items, and

separates a sentence with tag information indicating a list item being added to the heading lines.

48. A document processing apparatus according toclaim 1, wherein said document structuring means includes table determining means for extracting a cell from a section in the block which is tagged with tag information indicating a table, and for adding tag information indicating a cell to the cell.

49. A document processing apparatus according toclaim 48, wherein said table determining unit adds tag information when the cell is extracted, said tag information indicating what number of rows or columns in the table the cell spans, and extracts the cell from the table, in which rows or columns are not equally sectioned, the cell being tagged with tag information indicating a cell.

50. A document processing apparatus according toclaim 1, wherein said document structuring means further includes blank line determining means which identifies a blank line in the block as a sentence break to segment the block into sentences.

51. A document processing apparatus according toclaim 1, wherein said document structuring means further includes quotation-mark determining means for checking for matching of quotation marks in the block, for referring to one or a plurality of blocks before and after the block if the quotation marks do not match, and for, if the quotation marks in the blocks match, restructuring the blocks in which the quotation marks match into a single block.

52. A document processing apparatus according toclaim 1, wherein said document structuring means further includes paragraph determining means for checking for a paragraph break based on a position at which a line of the block starts, and for adding tag information indicating a paragraph to a section of a paragraph.

53. A document processing apparatus according toclaim 1, wherein said document structuring means further includes paragraph determining means for determining a paragraph break based on a position at which a line of the block starts and based on a number of characters in the line, and for adding tag information indicating a paragraph to a section of a paragraph.

54. A document processing apparatus according toclaim 1, wherein, when the input document data is in a predetermined tagged text format, the input document data being tagged with tag information specifying the document structure, said document structuring means uses the tag information.

55. A document processing apparatus according toclaim 1, wherein said document structuring means further includes English-text determining means for determining whether or not text in the block is in English, and for, if the text is in English, segmenting the English text into sentences such that a line is continued to a next line if a hyphen is inserted at an end of the line and a line is continued to the next line with a white space inserted therebetween if no hyphen is inserted at the end of the line and if the line does not end with a delimiter.

56. A document processing apparatus according toclaim 1, wherein said document structuring means segments the block into sentences based on a period used as a sentence break.

57. A document processing apparatus according toclaim 1, wherein said sentence extraction means expresses the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data.

58. A document processing apparatus according toclaim 1, wherein said sentence extraction means expresses the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data, and controls an extraction of the text data according to the tag information added to the tree-structured data.

59. A document processing apparatus according toclaim 1, wherein said sentence extraction means expresses the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data, and controls movement of an objective point on the document according to the tag information added to the tree-structured data.

60. A document processing apparatus according toclaim 1, wherein said sentence extraction means expresses the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data, and extracts the text data row-by-row according to the tree-structured data when the tag information added to the tree-structured data indicates a table.

61. A document processing apparatus according toclaim 1, wherein said sentence extraction means expresses the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data, and extracts the text data column-by-column according to the tree-structured data when the tag information added to the tree-structured data indicates a table.

62. A document processing apparatus according toclaim 1, wherein said sentence extraction means expresses the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data, and, when the tag information added to the tree-structured data indicates a table having a numerical unit at a first row or column and having numerical information at a subsequent respective row or column, extracts the text data with the numerical unit added to the numerical information.

63. A document processing apparatus according toclaim 1, wherein said sentence extraction means expresses the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data, and, when the tag information added to the tree-structured data indicates a table having a numerical unit at a first row or column and having numerical information at a subsequent respective row or column, explicitly directs to extract the text data with the numerical unit added to the numerical information.

64. A document processing apparatus according toclaim 1, wherein said sentence extraction means expresses the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data, and, when the tag information added to the tree-structured data indicates a table, extracts the text data with the text data at a first column or row in the table added to the text data in a subsequent respective column or row.

65. A document processing apparatus according toclaim 1, wherein said sentence extraction means expresses the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data, and, when the tag information added to the tree-structured data indicates a table, explicitly directs to extract the text data with the text data at a first column or row in the table added to the text data in a subsequent respective column or row.

66. A document processing apparatus according toclaim 1, wherein said sentence extraction means extracts the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data, and determines whether or not a quoted section is extracted when the tag information added to the tree-structured data indicates a quotation.

67. A document processing apparatus according toclaim 1, wherein said sentence extraction means expresses the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data, and extracts the text data paragraph-by-paragraph using tag information added to the tree-structured data which indicates a paragraph.

68. A document processing apparatus according toclaim 1, wherein said sentence extraction means expresses the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data, and extracts the text data heading-by-heading using tag information added to the tree-structured data which indicates a heading.

69. A document processing apparatus according toclaim 1, wherein said sentence extraction means further includes tag determining means for taking an action according to the tag information, and

said tag determining means determines a type of tag information for the text data tagged with tag information according to the tag information and tag action data including action data indicating an action associated with the tag information, and takes the action set for the tag action data.

70. A document processing apparatus according toclaim 69, wherein the tag action data is registered by a user.

71. A document processing apparatus according toclaim 1, wherein said sentence extraction means expresses the document data, which is structured according to the tag information generated by said document structuring means, as tree-structured data, and includes a sentence-extraction template which is paired with the tree-structured data in which each node is associated with an extraction control flag, and

if the extraction control flag prohibits extraction of the text data, said sentence extraction means does not extract the text data flagged with the extraction control flag.

72. A document processing apparatus according toclaim 71, further comprising template registering means for allowing a user to register an extraction control using the extraction control flag in the sentence-extraction template.

73. A document processing apparatus according toclaim 72, further comprising:

display means for displaying a tree structure of the document data to be processed; and

pointing means which allows a user to point a position on said display means, wherein said template registering means registers the extraction control flag by marking the tree structure displayed on said display means with a predetermined mark by said pointing means.

74. A document processing apparatus according toclaim 72, wherein said template registering means registers the sentence-extraction template which is associated with an ID indicating the input document data from which the sentence-extraction template originates.

75. A document processing apparatus according toclaim 72, wherein said template registering means uses the sentence-extraction template specified by a user.

76. A document processing apparatus according toclaim 72, wherein said template registering means stores the sentence-extraction template so as to be associated with a URL or a file.

77. A document processing method comprising the steps of:

dividing input document data into blocks in a predetermined manner according to a structure of the document data;

structuring the document data, thereby generating structured data, by parsing a block into which the document data is divided in said block dividing step according to a document structure of the block, and by adding tag information to text data constituting the block, said tag information indicating an attribute of the text data; and

controlling an extraction of the text data according to the structured data and a predetermined condition, wherein the predetermined condition provides an indication of a method to be utilized to perform the extraction of the text data.

78. A document processing program for causing a computer apparatus to execute a document processing method comprising the steps of:

dividing input document data into blocks in a predetermined manner according to a structure of the document data;

structuring the document data, thereby generating structured data, by parsing a block into which the document data is divided in said block dividing step according to a document structure of the block, and by adding tag information to text data constituting the block, said tag information indicating an attribute of the text data; and

controlling an extraction of the text data according to the structured data and a predetermined condition, wherein the predetermined condition provides an indication of a method to be utilized to perform the extraction of the text data.

79. A recording medium having a document processing program recorded thereon, the document processing program causing a computer apparatus to execute a document processing method comprising the steps of:

dividing input document data into blocks in a predetermined manner according to a structure of the document data;

structuring the document data, thereby generating structured data, by parsing a block into which the document data is divided in said block dividing step according to a document structure of the block, and by adding tag information to text data constituting the block, said tag information indicating an attribute of the text data; and

controlling an extraction of the text data according to the structured data and a predetermined condition, wherein the predetermined condition provides an indication of a method to be utilized to perform the extraction of the text data.

80. A document processing apparatus according toclaim 1, wherein the predetermined condition comprises an indication that a template be utilized by said sentence extraction means for controlling the extraction of the text data.

81. A document processing apparatus according toclaim 1, wherein the predetermined condition comprises an indication that an extraction mode be utilized by said sentence extraction means for controlling the extraction of the text data.

82. A document processing apparatus according toclaim 1, wherein the predetermined condition comprises an indication that tag action data be utilized by said sentence extraction means for controlling the extraction of the text data.

83. A document processing apparatus according toclaim 1, wherein the structured data comprises sentence-structured data.

84. A document processing apparatus according toclaim 1, wherein the structured data comprises tree-structured data.

Images