lemmatize

For languages with a developed morphology (such as Russian), counts of lexical features are only reliable if they are based on lemmatized data.

The target collocations occur with various frequencies in the Corpus of Contemporary American English (COCA) as established by lemmatized searches, the only exception being to sack employees, which is in the British National Corpus (BNC) and marked as especially British English (McIntosh et al., 2009, p.

At that time, all words are registered to create a dictionary, as well as a dictionary of their lemmatized forms (words reduced to their roots), intended to avoid irrelevant differences (words written in singular or plural, verbs conjugated in different tenses, etc.; Chabchoub, 2008).

Jockers first places his subject matter in the larger history of the rapidly growing area of the digital humanities--a history that begin in the 1940s with a lemmatized index of the corpus of the works of Thomas Aquinas.

Using WordStat, a textual analysis software, I used this sample to create two lemmatized (4) word-frequency lists, each listing one newspaper's most common words (Kilgarriff, 1997).

The titles were tokenized (i.e., split into distinct words), and stemmed and lemmatized, which reduce inflected word forms to base forms (e.g., "walking" and "walked" are both converted to "walk") using the Stanford CoreNLP package [13].

It is tokenized, pos-tagged, lemmatized and categorized in terms of genre and topic, but there is no annotation for derivational morphology.

After the extraction task, we shall have for result a set of significant, lemmatized and labelled terms.