TIPSTER Volume 2

registration: 2007/06/20 08:35:52, last modified: 2016/01/17 10:20:56
title
  • TIPSTER Volume 2
title.abbreviation
title.alternative
  • MUC, Tipster, TREC
creator
  • Donna Harman and Mark Liberman
subject
  • information retrieval, language modeling
subject.linguisticField
subject.monoMultilingual
  • monolingual
subject.resourceSubject
  • corpus
description
  • LDC93T3A - Complete TIPSTER corpus

    LDC93T3B - Volume 1 of the TIPSTER corpus

    LDC93T3C - Volume 2 of the TIPSTER corpus

    LDC93T3D - Volume 3 of the TIPSTER corpus

    TIPSTER 2 is sometimes also called the Text Research Collection Volume 2 or TREC-2.

    The TIPSTER project was sponsored by the Software and Intelligent Systems Technology Office of the Advanced Research Projects Agency (ARPA/SISTO) in an effort to significantly advance the state of the art in effective document detection (information retrieval) and data extraction from large, real-world data collections.

    The detection data is comprised of a test collection built at NIST for the TIPSTER project and the related TREC project. The TREC project has many other participating information retrieval research groups, working on the same task as the TIPSTER groups, but meeting once a year in a workshop to compare results (similar to MUC). The test collection consists of three CD-ROMs of SGML encoded documents distributed by LDC plus queries and answers (relevant documents) distributed by NIST.

    Source
    Year
    Approx. # Words (Millions)

    Associated Press
    1988
    37

    Wall Street Journal
    1990
    11

    Wall Street Journal
    1991
    22

    Wall Street Journal
    1992
    5

    Federal Register
    1998
    30

    Ziff/Davis
    1989-09
    26

    The documents in the test collection are varied in style, size and subject domain. The first disk contains material from the Wall Street Journal (1986, 1987, 1988, 1989), the AP Newswire (1989), the Federal Register (1989), information from Computer Select disks (Ziff-Davis Publishing) and short abstracts from the Department of Energy. The second disk contains information from the same sources, but from different years. The third disk contains more information from the Computer Select disks, plus material from the San Jose Mercury News (1991), more AP newswire (1990) and about 250 megabytes of formatted U.S. Patents. The format of all the documents is relatively clean and easy to use, with SGML-like tags separating documents and document fields. There is no part-of-speech tagging or breakdown into individual sentences or paragraphs as the purpose of this collection is to test retrieval against real-world data.

    The three Tipster discs so far released have been re-issued with updates and corrections and all recipients of the earlier versions should have received these replacements free of charge. If you think you have the unrevised original, contact LDC for confirmation.
description.price *This metadata is only as a guide
description.language
  • English
description.inputDevice
description.inputEnvironment
description.speakingStyle
description.speechMode
description.samplingRate
description.additionalData
publisher
contributor
  • sponsor the Software and Intelligent Systems Technology Office of the Advanced Research Projects Agency (ARPA/SISTO)
contributor.attribute.author.motherTongue
  • native
contributor.attribute.author.dialect
  • standard_dialect
contributor.attribute.author.level
  • professional
contributor.attribute.author.age
  • adult
contributor.attribute.author.gender
contributor.attribute.speaker.motherTongue
contributor.attribute.speaker.dialect
contributor.attribute.speaker.level
contributor.attribute.speaker.age
contributor.attribute.speaker.gender
contributor.attribute.speaker.number
date.created
date.issued
  • 1993-00-00
date.modified
type
  • Text
type.discourseType
  • report
type.linguisticType
  • primary_text
type.purpose
  • developing_technologies test retrieval against real-world data
type.style
  • written news paper
type.form
  • unfixed
type.sentence
  • short
  • long
type.annotation
  • plain
type.annotationSample
type.sample
format.extent
format.medium
  • Web Download
format.encoding
format.markup
  • SGML
format.functionality
identifier
identifier.doi
identifier.islrn
  • 532-662-320-210-9
source
  • varied; The first disk; the Wall Street Journal (1986, 1987, 1988, 1989), the AP Newswire (1989), the Federal Register (1989), information from Computer Select disks (Ziff-Davis Publishing)
  • short abstracts from the Department of Energy
  • the second disc; information from the same sources, but from different years
  • the third disc; the Computer Select disks, the San Jose Mercury News (1991), more AP newswire (1990) , U.S. Patents
language
  • English
language.area
  • Europe
relation
relation.utilization *This metadata is automatically extracted
coverage.temporal
coverage.spacial
rights