INFO-Text CONCORD
CONCORD
[
A
LL] [[DF_name
[
N
EW] [system_item]
[system_variable]
[numeric_literal]
[
R
EPEAT]]
builds a concordance of words and phrases found in the text files referenced in the A- or concordable C-type items in the selected extended datafile.
arguments
ALL indexes text in concordable items in all selected records whether or not they are currently concorded. ALL deletes the old index information in the associated dictionary file and replaces it.
NEW indexes text in concordable items in the selected records that need to be concorded. It flags unselected records that need to be concorded for concording at a later time. These unselected records are not available for text query until they have been concorded. The dictionary file is deleted and rebuilt, saving none of the old entries.
An unqualified CONCORD command indexes only the concordable items in those selected records that have been added or changed since you last issued the
CONCORD command for the selected extended datafile.
The selected set may contain both concorded and unconcorded datafile records.
DF_item | system_item | system_variable |
numeric_literal this argument refers to batch size in terms of the number of input records needing concording that INFO-Text will use. By default, CONCORD will concord all records needing concordance. Sometimes, due to disc file quotas and other system constraints, the user may prefer to release a limited number of records for concordance. When used on its own, without the REPEAT qualifier, CONCORD will concord only as many records as are specified in the batch.
REPEAT a qualifier of batch (argument 2). When used in conjunction with batch, CONCORD will run repeatedly in sizes of batch until all records have been concorded.
INFO Reference Manual Commands 109
CONCORD notes
INFO-Text
n
You cannot include more than 30 concordable items per extended datafile. The maximum length in characters of a concordable word (or number) is 40 characters.
n
For protected datafiles, you can use the CONCORD command only if you used the SELECT command with the control-level protection key. (See the PROTECT and
PASSWORD commands for more information about protected datafiles.) n
INFO-Text treats concorded dates as three groups of numbers. Concorded numbers containing colons are treated similarly (for example 9:28 is concorded as 9 and
28).
n
The dictionary associated with a concorded datafile is available for processing word expressions only when that datafile is selected. The dictionaries of related extended datafiles are not available for querying.
n
If you issue the CONCORD NEW command from an oddnumbered program section, INFO-Text keeps the current stopword list and does not ask you if you want to retain it.
discussion
The CONCORD command builds a concordance, an index of all occurrences of terms in the concordable items in the selected extended datafile. Building the concordance is based on the concord-level defined for each concordable item in an extended datafile. The concordance information is used by INFO-Text in subsequent ASELECT and
RESELECT commands to allow queries based on word expressions. (See the Building Expressions chapter for more information about word expressions.)
The CONCORD command indexes each record in the selected set that is marked for concording, or all records whether or not they have been marked for concording.
INFO-Text marks a record in an extended datafile for concording whenever it is added, updated, or modified in any way using INFO-Text.
110 Commands INFO Reference Manual
INFO-Text CONCORD
There are several concord levels, listed below in order from least to most comprehensive concordance. Though concordable C-type items must be concorded to the record, item, or word level, A-type items can be concorded to any of the following levels: n
Record level INFO-Text can tell you the record that contains the word expression.
n
Paragraph level INFO-Text can tell you the record, item, and paragraph that contains the word expression. Use only with X-type items.
n
Sentence level INFO-Text can tell you the record, item, paragraph, and sentence that contains the word expression.
n
Word level INFO-Text can tell you the record, item, paragraph, sentence, and word that contains the word expression.
As INFO-Text concords a file, it issues messages as follows: n
nnnWORDS tells the total number of indexed words. If an item is defined for upper- and lower-case concording, the number of words will be at least double the number of items. (For example, if a word appears twice in an item that is defined for upper- and lower-case concording, the number of words displayed reflects four occurrences of that word for the item.) n
SORT COMPLETE indicates that processing is complete and the new dictionary entries are sorted.
If the datafile is marked concord inconsistent (that is, the concordance option for an item definition has been altered or modified), you must use the NEW option. If all datafile records are selected, the ALL option should be used. It is more efficient in that case.
When performing a CONCORD NEW command, INFO-
Text displays the prompt:
DO YOU WISH TO RETAIN EXISTING STOPWORDS (Y OR N)?
INFO Reference Manual Commands 111
CONCORD INFO-Text
Respond with Y (yes) to retain the set of stopwords currently associated with the selected extended datafile. If you respond with N (no), INFO-Text uses either your own default stopword file or the INFO-Text default stopword file for the new concord operation. See the STOPWORD command for more information regarding stopwords.
112 Commands INFO Reference Manual
