SHACHI - Language Resource Metadata Database

The corpus contains 100 million words in more than 22,000 transcripts of ten American soap operas from 2001 to 2012. It provides very useful insight into informal, colloquial American speech.

ukWaC is a 2 billion word corpus constructed from the Web limiting the crawl to the .uk domain and using medium-frequency words from the BNC as seeds. The corpus is POS-tagged and lemmatized.

deWaC is a 1.7 billion word corpus constructed from the Web limiting the crawl to the .de domain and using medium-frequency words from the SudDeutsche Zeitung corpus and basic German vocabulary lists as seeds. The corpus is POS-tagged and lemmatized.

itWaC is a 2 billion word corpus constructed from the Web limiting the crawl to the .it domain and using medium-frequency words from La Repubblica Corpus and basic Italian vocabulary lists as seeds. The corpus is POS-tagged and lemmatized.

frWaC is a 1.6 billion word corpus constructed from the Web limiting the crawl to the .fr domain and using medium-frequency words from the Le Monde Diplomatique corpus and basic French vocabulary lists as seeds. The corpus is POS-tagged and lemmatized.

PukWac is a 2 billion word corpus built by syntactically annotating ukWaC. ukWaC is a corpus constructed from the Web limiting the crawl to the .uk domain and using medium-frequency words from the BNC as seeds. The ukWaC corpus is POS-tagged and lemmatized.

SdeWaC is a 0.88 billion word corpus derived from deWaC, a 1.7 billion word corpus constructed from the Web limiting the crawl to the .de domain. In SdeWaC, duplicate sentences and some noise have been removed. SdeWaC comes in two versions, in POS-tagged / lemmatized version or as a one sentence per line format.

WaCkypedia_EN is a 2009 dump of the English Wikipedia (about 800 million tokens), annotated with POS, lemma and full dependency information. Dependency parsesing was performed with the MaltParser (http://maltparser.org/). The texts were extracted from the dump and cleaned using the Wikipedia extractor (http://medialab.di.unipi.it/wiki/Wikipedia_extractor).

Morph-it! is a free morphological lexicon for the Italian language, containing 505,074 entries and 35,056 lemmas. Morph-it! can be used as a data source for a lemmatizer / morphological analyzer / morphological generator.

A collection of newspaper texts. The texts are tokenized, pos-tagged (with the Treetagger trained with ad-hoc resources), lemmatized (with Morph-it) and categorized.