ΟΙ ΣΥΝΕΡΓΑΤΕΣ ΠΟΥ

A HIGHLY ADVANCED CONTENT ANALYSIS AND TEXT-MINING SOFTWARE WITH UNMATCHED HANDLING AND ANALYSIS CAPABILITIES,

WordStat is a flexible and easy-to-use text analysis software – whether you need text mining tools for fast extraction of themes and trends, or careful and precise measurement with state-of-the-art quantitative content analysis tools. WordStat‘s seamless integration with SimStat – our statistical data analysis tool – and QDA Miner – our qualitative data analysis software – gives you unprecedented flexibility for analyzing text and relating its content to structured information, including numerical and categorical data.

WHAT IT IS USED FOR?

WordStat can be used by anyone who needs to quickly extract and analyze information from large amounts of documents. Our content analysis and text mining software is used for:

• Content analysis of open-ended responses, interview or focus group transcripts
• Business intelligence and competitive web sites analysis
• Information extraction and knowledge discovery from incident reports, customer complaints
• Content analysis of news coverage or scientific literature
• Automatic tagging and classification of documents
• Fraud detection, authorship attribution, patent analysis
• Taxonomy development and validation

KEY AND UNIQUE FEATURES

Powerful CONTENT ANALYSIS AND TEXT MINING SOFTWARE for handling large amounts of unstructured information. WordStat can process up to 20 million words per minute and identify all references to user-defined concepts using categorization dictionaries.

Integrated EXPLORATORY TEXT MINING AND VISUALIZATION TOOLS such as clustering, multidimensional scaling, proximity plots, and more, to quickly extract themes and automatically identify patterns.

RELATES UNSTRUCTURED TEXT WITH STRUCTURED DATA such as dates, numbers or categorical data for identifying temporal trends or differences between subgroups or for assessing relationship with ratings or other kinds of categorical or numerical data.

Use existing or create your own HIERARCHICAL CONTENT ANALYSIS DICTIONARIES OR TAXONOMIES composed of words, word patterns, phrases as well as proximity rules (such as NEAR, AFTER, BEFORE) for achieving precise measurement of concepts.

Truly unique COMPUTER ASSISTANCE FOR DICTIONARY BUILDING with tools for extracting common phrases and technical terms and for quickly identifying in your text collection, misspellings, synonyms, antonyms and related words.

One click access to KEYWORD-IN-CONTEXT AND KEYWORD RETRIEVAL TOOLS for easy identification and coding of relevant text segments, validation of content analysis dictionaries, word-sense disambiguation or for drilling down to the source documents.

Seamless integration with a state of the art QUALITATIVE CODING TOOL (QDA Miner), allows more precise exploration of data or more in-depth analysis of specific documents or extracted text segments when needed.

MACHINE LEARNING FOR AUTOMATIC DOCUMENT CLASSIFICATION using Naive Bayes and K-Nearest Neighbours algorithms with automatic features selection and validation tools. Classification models may then be saved on disk and reapplied on new data.

Easy IMPORTATION of databases, spreadsheets and documents (including PDF and HTML)  as well as EXPORTATION of text analysis results to common industry file formats (Excel, SPSS, ASCII, HTML, XML, MS Word) and graphs (PNG, BMP and JPEG).

LIST OF FEATURES

TEXT PROCESSING CAPABILITIES

1. Content analysis on collection of ANSI or RTF document (several mb each) and short alphanumeric variables (up to 255 characters).
2. Dictionary moderated lemmatization and stemming (English, French, Italian, German and Spanish; contact us for other languages).
3. Ability to call external text pre-processing EXE or DLL (sample English porter stemmer and n-grams transformation are include)
4. Optional exclusion of pronouns, conjunctions, etc, by the use of user-defined exclusion lists (or stop list).
5. Categorization of words or phrases using existing or user-defined dictionaries.
6. Word categorization based on Boolean (AND, OR, NOT) and proximity rules (NEAR, AFTER, BEFORE)
7. Word and phrase substitution and scoring using wildcards and weighting.
8. Frequency analysis on keywords, phrases, derived categories or concepts, or user-defined codes entered manually within a text.
9. Interactive development and easy maintenance of hierarchical dictionaries, taxonomies, or categorization schema.
10. Drag and drop editor for easy assignments of words, phrases into categories!
11. Ability to restrict the analysis to specific portions of a text or to exclude comments and annotations.
12. Ability to perform an analysis on a random sample of cases.
13. Integrated spell-checking with support for more than 20 languages such as English, French, Spanish, etc.
14. Integrated thesaurususe to assist the creation of taxonomies and comprehensive categorization schemas (English, French, Spanish, Italian, Portuguese and German).
15. Powerful case filtering on any numeric or alphanumeric field and on code occurrence (with AND, OR, and NOT boolean operators)
16. Prints presentation quality tables
17. Imports ANSI and Unicode text files, MS Word, WordPerfect, RTF and HTML, PDF.
18. Exports any table to Excel,SPSS, ASCII, Tab separated or comma separated value files, or HTML files.
19. Flexible keyword highlighting (the text editor can display all categories using different colors).

UNIVARIATE KEYWORD FREQUENCY ANALYSIS

1. Univariate word frequency analysis (word or category count and record occurrence).
2. Word x word co-occurrence matrix.
3. Word x case data matrix.
4. Integrated multidimensional scaling with 2D and 3D maps.
5. Proximity plot.

FEATURE EXTRACTION

1. Vocabulary finder extracts technical terms, product and company names as well as common misspellings.
2. Phrase finder allows one to easily identify recurring phrases and expressions

NORM CREATION AND COMPARISON

1. Ability to create norm files based on frequency analysis of words or content categories.
2. Comparison of obtained frequencies to previously saved norm files.

KEYWORD RETRIEVAL FUNCTION

1. A powerful keyword retrieval function allows identification of text units (documents, paragraph or sentences) containing one keyword or a combination of keywords with optional filtering of cases.
2. Ability to attach QDA Miner codes to retrieved segments.
3. Retrieved segments may be exported to disk in tabular format (Excel or delimited text files) or as text reports (Rich Text Format).

KEYWORD CO-OCCURRENCE ANALYSIS

1. Integrated clustering and dendrogram display of keyword co-occurrence.
2. First- and second-order proximity analysis.
3. Proximity plot to easily identify all keywords that co-occurs with a target keyword.
4. 2D and 3D multidimensional scaling on either joint frequency or co-occurrence of words or categories.
5. Flexible keyword co-occurrence criteria (within a case, a sentence, a paragraph, a window of n words, a user-defined segment) as well as clustering methods (first- and second-order proximity, choice of similarity measures).
6. Easy text retrieval from dendrogram or proximity plots.

ANALYSIS OF CASE OR DOCUMENT SIMILARITY

1. Hierarchical clustering, multidimensional scaling and proximity plot may be used to explore the similarity between documents or cases.

MULTIPLE RESPONSES AND COMPARISONS

1. Can perform univariate frequency analysis and crosstabulation on information stored in several alphanumeric fields (memo or string variables).
2. Comparison of keyword occurrence between different fields.
3. Computes inter-raters agreement measures (pct. of agreement, Cohen’s Kappa, Scott’s Pi, Krippendorff’s R and r-bar, free marginal) based on codes manually entered in different variables.

BIVARIATE COMPARISONS BETWEEN SUBGROUPS

1. Bivariate comparison between any textual field and any nominal or ordinal variable (such as the sex of the respondent, specific subgroups, years of publication, etc.).
2. Choice between 11 different association measures to assess the relationship between word occurrence and nominal or ordinal variables (Chi-square, Likelihood ratio, Tau-a, Tau-b, Tau-c, symmetric Somers’ D, asymmetric Somers’ Dxy and Dyx, Gamma, Person’s R, Spearman’s Rho)
3. Computation statistics on either absolute or relative frequency
4. Ability to sort matrix in alphabetic order of words, by word frequency or word occurrence, on the obtained statistics or on its probability.
5. Visually compare items between subgroups using bar charts and line charts.

1. Correspondence analysis (statistics, 2D & 3D joint plots). This feature is accessible from the crosstab page and allows one to see graphically the relationship between nominal variables and codes resulting from a content analysis.
2. Heatmap plot (with dual-clustering of keywords and variables)

AUTOMATED TEXT CLASSIFICATION

1. Machine learning algorithms (Naive Bayes and K-Nearest Neighbors) for document classification.
2. Flexible feature selection for automatic selection of best subsets of attributes.
3. Numerous validation methods (leave-but-one, n-fold crossvalidation, split sample).
4. Experimentation module allows easy comparison of predictive models and fine-tuning of classification models.
5. Classification models may be saved to disk and applied later using either a standalone document classification utility program, a command line program or a programming library . Note: The command line and the programming library are part of WordStat Software Developer’s kit (SDK) which is sold separately.

KEYWORD-IN-CONTEXT (KWIC)

1. Ability to display a KWIC table to examine the textual context of a word, word pattern, or category.
2. Ability to sort the table on any independent (numeric) variables.
3. Ability to jump from a KWIC keyword to the textual variable in order to view or edit the original text.
4. KWIC list can be saved in data files for further processing.
5. Customizable KWIC display (paragraph, sentence or user defined segment).
6. Concordance report (displays all hits as a list of paragraphs, sentences or user defined segments)

FULL INTEGRATION WITH A STATISTICAL SOFTWARE

1. Alphanumeric variables can be stored in the same file as all other numeric variables.
2. Variable selection, statistical analysis and content analysis are performed within the same application program.
3. Matrix outputs are automatically added to existing statistical outputs.
4. New variables representing occurrence of words, keywords or concepts can be added to the existing data file or exported to a new data file in order to be submitted to further statistical analysis (such as cluster analysis on words or cases, principal coordinate analysis, correspondence analysis, multiple regression, etc.).
5. Data can be imported from and exported to different file format including dBase, Paradox, Excel, Quattro Pro, Lotus 1-2-3, SPSS for DOS, SPSS for Windows, comma or tab separated text files, etc.
6. Ability to perform numeric and alphanumeric transformation or to apply filters on records of the data file to restrict the analysis to specific subgroups. .

UTILITY PROGRAMS

1. Dictionary building assistant to find related words (synonyms, antonyms, holonyms, meronyms, hypernyms, hyponyms) in a WordNet based thesaurus (English only). (100,000 synonyms, 120,000 root words)

1. WS Document Classifier, a small standalone application to apply previously saved categorization and classification models to external documents.
2. Document Conversion Wizard- Utility program to easily import documents. Various file formats may be directly imported such as Plain text (ANSI, Unicode) HTML, RTF, MS Word, WordPerfect, Adobe PDF
3. Optional removal of leading and trailing spaced and hard returns.
4. Extraction of numeric, alphanumeric and date variables from structured documents.
5. Extraction options may be saved on disk and later retrieved.
6. Documents may be stored as plain ANSI text or as RTF documents.