OntoNotes Release 1.0

registration: 2008/03/10 03:07:49, last modified: 2016/08/17 13:26:41
title
  • OntoNotes Release 1.0
title.abbreviation
title.alternative
  • OntoNotes Release 1.0
creator
  • developer BBN Technologies (coreference annotation)
  • developer University of Colorado (Chinese Treebank, Chinese/English PropBank, word sense for verb)
  • developer University of Pennsylvania (English Treebank and English PropBank)
  • developer University of Southern California's Information Sciences Institute (word sense for nouns and ontology)
  • researcher Ralph Weischedel, BBN Technologies (coreference annotation)
  • researcher Lance Ramshaw, BBN Technologies (coreference annotation)
  • researcher Linnea Micciulla, BBN Technologies
  • researcher Sameer Pradhan, BBN Technologies
  • researcher Martha Palmer, University of Colorado (Chinese Treebank, Chinese/English PropBank, word sense for verb)
  • researcher Nianwen Xue, University of Colorado (Chinese Treebank, Chinese PropBank)
  • researcher Mitchell Marcus, University of Pennsylvania (English Treebank)
  • researcher Ann Taylor, University of Pennsylvania
  • researcher Olga Babko-Malaya, University of Pennsylvania (English PropBank)
  • researcher Eduard Hovy, University of Southern California's Information Sciences Institute (word sense for nouns and ontology)
  • researcher Robert Belvin, University of Southern California's Information Sciences Institute
  • researcher Ann Houston, Grammarsmith
subject
  • syntactically annotated corpus
  • semantically annotated corpus
  • named entity tagged corpus
  • word sense annotated corpus
subject.linguisticField
  • computational_linguistics
  • syntax
  • text_and_corpus_linguistics
  • semantics
subject.monoMultilingual
  • multilingual
subject.resourceSubject
  • corpus
description
  • *Introduction*

    Natural language applications like machine translation, question answering, and summarization currently are forced to depend on impoverished text models like bags of words or n-grams, while the decisions that they are making ought to be based on the meanings of those words in context. That lack of semantics causes problems throughout the applications. Misinterpreting the meaning of an ambiguous word results in failing to extract data, incorrect alignments for translation, and ambiguous language models. Incorrect coreference resolution results in missed information (because a connection is not made) or incorrectly conflated information (due to false connections). Some richer semantic representation is badly needed.

    The OntoNotes project is a collaborative effort between BBN Technologies, the University of Colorado, the University of Pennsylvania, and the University of Southern California's Information Sciences Institute to produce such a resource. It aims to annotate a large corpus comprising various genres of text (news, conversational telephone speech, weblogs, use net, broadcast, talk shows) in three languages (English, Chinese, and Arabic) with structural information (syntax and predicate argument structure) and shallow semantics (word sense linked to an ontology and coreference). OntoNotes builds on two time-tested resources, following the Penn Treebank for syntax and the Penn PropBank for predicate-argument structure. Its semantic representation will include word sense disambiguation for nouns and verbs, with each word sense connected to an ontology, and coreference. The current goals call for annotation of over a million words each of English and Chinese, and half a million words of Arabic over five years.

    The authors wish to make this resource available to the natural language research community so that decoders for these phenomena can be trained to generate the same structure in new documents. Lessons learned over the years have shown that the quality of annotation is crucial if it is going to be used for training machine learning algorithms. Taking this cue, we ensure that each layer of annotation in OntoNotes will have at least 90% inter- annotator agreement. Our pilot studies have shown that predicate structure, word sense, ontology linking, and coreference can all be annotated rapidly and with better than 90% consistency.

    *Samples*

    The following screen captures provide examples of the data contained in this corpus.

    * English tree.
    * English sense predicate structure.
    * Chinese tree and sense predicate structure.

    *Sponsorship*

    This work was suppported in part by the Defense Research Advanced Projects Agency, GALE Program Grant No. HR0011-06-C-0022. The content of this publication does not necessarily reflect the position or policy of the Government, and no official endorsement should be inferred.
description.price *This metadata is only as a guide
description.language
  • English
description.inputDevice
description.inputEnvironment
description.speakingStyle
description.speechMode
description.samplingRate
description.additionalData
publisher
contributor
  • sponsor Defense Research Advanced Projects Agency, GALE Program Grant No. HR0011-06-C-0022
contributor.attribute.author.motherTongue
  • native Journalists and writers at Wall Street Journal, Sinorama Magazine and Xinhua News Agency
contributor.attribute.author.dialect
  • standard_dialect
contributor.attribute.author.level
  • professional Journalists and writers at Wall Street Journal, Sinorama Magazine and Xinhua News Agency
contributor.attribute.author.age
  • adult
contributor.attribute.author.gender
  • male
  • female
contributor.attribute.speaker.motherTongue
contributor.attribute.speaker.dialect
contributor.attribute.speaker.level
contributor.attribute.speaker.age
contributor.attribute.speaker.gender
contributor.attribute.speaker.number
date.created
date.issued
  • 2007-05-17
date.modified
type
  • Text
type.discourseType
  • report
  • narrative
type.linguisticType
  • primary_text
type.purpose
  • analysis machine translation, natural language processing
  • developing_technologies machine translation, natural language processing
type.style
  • written newswire
  • written newspaper
type.form
  • unfixed
type.sentence
  • short
  • long
type.annotation
  • annotated coreference based on the BBN Technologies' co-reference guidelines : http://www.ldc.upenn.edu/Catalog/docs/LDC2007T21/coreference
  • annotated syntactic structure and part-of-speech based on the Penn Treebank II guidelines (http://www.cis.upenn.edu/~treebank/) with addendum (http://www.ldc.upenn.edu/Catalog/docs/LDC2007T21/treebank/)
  • annotated PropBank annotation (predicate-argument structure) : http://www.ldc.upenn.edu/Catalog/docs/LDC2007T21/propbank
  • annotated word sense annotation carried out at the University of Colorado and Information Sciences Institute
  • annotated ontology based on Omega ontology : http://omega.isi.edu/
  • annotated entity names (11 entity names and 7 value types)
type.annotationSample
type.sample
  • [English Treebank] :

    http://www.ldc.upenn.edu/Catalog/desc/addenda/LDC2007T21_eng_tbk.jpg
  • [English Sense Predicate Structure] :

    http://www.ldc.upenn.edu/Catalog/desc/addenda/LDC2007T21_sense_pred.jpg
  • [Chinese Tree and Sense Predicate Structure] :

    http://www.ldc.upenn.edu/Catalog/desc/addenda/LDC2007T21_chi_comp.jpg
  • [Word Sense]:

    wsj/02/wsj_0242@wsj@en@on 0 4 complain-v ?,? 1
    wsj/02/wsj_0242@wsj@en@on 0 9 push-v ?,? 1
    wsj/02/wsj_0242@wsj@en@on 0 15 create-v ?,? 1
    wsj/02/wsj_0242@wsj@en@on 0 25 affect-v ?,? 1
    wsj/02/wsj_0242@wsj@en@on 1 3 pace-v ?,? 1
    wsj/02/wsj_0242@wsj@en@on 1 11 aim-v ?,? 2
    wsj/02/wsj_0242@wsj@en@on 1 24 reduction-n ?,? 1
    wsj/02/wsj_0242@wsj@en@on 1 36 register-v ?,? 1
    wsj/02/wsj_0242@wsj@en@on 2 3 call-v ?,? 3
    wsj/02/wsj_0242@wsj@en@on 2 6 agreement-v ?,? 1

    “OntoNotes Release 1.0 with OntoNotes DB Tool v.0.9 beta” (2007), pp. 35.
    http://www.ldc.upenn.edu/Catalog/docs/LDC2007T21/ontonotes-1.0-documentation.pdf
  • [Coreference]:

    wsj_0037.mrg
    * Judging from the American in Haruki Murakami 's `` A Wild Sheep Chase '' -LRB- Kodansha , 320 pages , $18.95 *U* -RRB- , baby boomers on both sides of the Pacific have a lot in common .
    Although *-2 set *-1 in Japan , the novel 's texture is almost entirely Western , especially American .
    Characters drink Salty Dogs , whistle `` Johnny B. Goode '' and watch Bugs Bunny reruns .
    They read Mickey Spillane and talk about Groucho and Harpo .
    They worry about their careers , drink too much and suffer through broken marriage and desultory affairs .

    The rest is omitted.

    “OntoNotes Release 1.0 with OntoNotes DB Tool v.0.9 beta” (2007), pp. 36.
    http://www.ldc.upenn.edu/Catalog/docs/LDC2007T21/ontonotes-1.0-documentation.pdf
  • [Entity Names]:


    wsj/02/wsj_0242@wsj@en@on
    Some U.S. allies are complaining that President Bush is pushing conventional-arms talks too quickly , creating a risk that negotiators will make errors that could affect the security of Western Europe for years .
    Concerns about the pace of the Vienna talks -- which are aimed at the destruction of some 100,000 weapons , as well as major reductions and realignments of troops in central Europe -- also are being registered at the Pentagon .
    Mr. Bush has called for an agreement by next September at the latest .
    But some American defense officials believe the North Atlantic Treaty Organization should take more time to examine the long-term implications of the options being considered .

    “OntoNotes Release 1.0 with OntoNotes DB Tool v.0.9 beta” (2007), pp. 36-37.
    http://www.ldc.upenn.edu/Catalog/docs/LDC2007T21/ontonotes-1.0-documentation.pdf
format.extent
  • Medium: 1 DVD
  • Words (English) : 300K words
  • Words (Chinese) : 400K words
  • Corpus size: 752640 KB
format.medium
  • Web Download
format.encoding
format.markup
  • ENAMEX (for entity names annotation)
  • Treebank bracketing
format.functionality
  • "OntoNotes DB Tool v0.9 beta":
    For assembling the database from the original annotation files and for deriving various views of the data from the database. Can provide an API that can implement new queries or views. Included in the package.
identifier
identifier.doi
identifier.islrn
  • 722-221-552-342-8
source
  • English : C-001546,Treebank-2 (newspaper articles of late 1980's from Wall Street Journal)
  • Chinese : C-000695,Chinese Treebank 5.0 (newspaper articles and newswires from Xinhua, Ingormation Service Department of HKSAR and Sinorama magazine)
language
  • English American English
  • Chinese
  • Mandarin Chinese
language.area
  • America United States, North America
  • Asia China
relation
relation.utilization *This metadata is automatically extracted
coverage.temporal
  • 1989 (English materials)
  • 1994 - 2001 (Chinese materials)
coverage.spacial
  • United States
  • China
rights