TC-STAR 2005 Evaluation Package - ASR Mandarin Chinese

registration: 2007/08/03 07:30:55, last modified: 2016/08/17 13:32:03
title
  • TC-STAR 2005 Evaluation Package - ASR Mandarin Chinese
title.abbreviation
title.alternative
creator
subject
  • Evaluation Package
subject.linguisticField
  • translating_and_interpreting
subject.monoMultilingual
  • monolingual
subject.resourceSubject
  • corpus
description
  • Desktop/Microphone
    TC-STAR is a European integrated project focusing on Speech-to-Speech Translation (SST). To encourage significant breakthrough in all SST technologies, annual open competitive evaluations are organized. Automatic Speech Recognition (ASR), Spoken Language Translation (SLT) and Text-To-Speech (TTS) are evaluated independently and within an end-to-end system.

    The first TC-STAR evaluation campaign took place in March 2005.
    Two core technologies were evaluated during the campaign:
    • Automatic Speech Recognition (ASR),
    • Spoken Language Translation (SLT).

    Each evaluation package includes resources, protocols, scoring tools, results of the official campaign, etc., that were used or produced during the first evaluation campaign. The aim of these evaluation packages is to enable external players to evaluate their own system and compare their results with those obtained during the campaign itself.

    The speech databases made within the TC-STAR project were validated by SPEX, in the Netherlands, to assess their compliance with the TC-STAR format and content specifications.

    This package includes the material used for the TC-STAR 2005 Automatic Speech Recognition (ASR) first evaluation campaign for the Mandarin Chinese language. The same packages are available for both English (ELRA-E0002) and Spanish (ELRA-E0003) for ASR and for SLT in 3 directions, English-to-Spanish (ELRA-E0005), Spanish-to-English (ELRA-E0006), Chinese-to-English (ELRA-E0007).

    To be able to chain the components, ASR and SLT evaluation tasks were designed to use common sets of raw data and conditions. Two evaluation tasks, common to ASR and SLT, were selected: EPPS (European Parliament Plenary Sessions) task and VOA (Voice of America) task. This package was used within the VOA task and consists of 2 data sets:
    - Development data set: consists of 3 hours of audio recordings from the broadcast news of Mandarin Voice of America between 1 and 3 December 1998 which corresponds more or less to 42,000 Chinese characters.
    - Test data set: consists of 3 hours of audio recordings from news broadcast between 14 and 22 December 1998 and corresponds to 44,000 Chinese characters.
description.price *This metadata is only as a guide
description.language
  • English
description.inputDevice
  • broadcast
description.inputEnvironment
  • broadcast studios
description.speakingStyle
  • broadcast news
description.speechMode
description.samplingRate
description.additionalData
publisher
contributor
contributor.attribute.author.motherTongue
contributor.attribute.author.dialect
contributor.attribute.author.level
contributor.attribute.author.age
contributor.attribute.author.gender
contributor.attribute.speaker.motherTongue
contributor.attribute.speaker.dialect
contributor.attribute.speaker.level
contributor.attribute.speaker.age
contributor.attribute.speaker.gender
contributor.attribute.speaker.number
date.created
date.issued
  • 2006-03-21
date.modified
  • 2011-01-06
type
  • Sound
  • Text
type.discourseType
  • report
type.linguisticType
  • primary_text
type.purpose
  • developing_technologies to enable external players to evaluate their own system and compare their results with those obtained during the campaign itself
type.style
  • speech
type.form
  • unfixed
type.sentence
  • short
  • long
type.annotation
type.annotationSample
type.sample
format.extent
  • 3 hours of audio recordings from the broadcast news of Mandarin Voice of America between 1 and 3 December 1998 which corresponds more or less to 42,000 Chinese characters
  • hours of audio recordings from news broadcast between 14 and 22 December 1998 and corresponds to 44,000 Chinese characters
  • TEXT_DURATION3 hours for development data set and 3 hours for test data set
format.medium
  • DVD
format.encoding
format.markup
format.functionality
identifier
identifier.doi
identifier.islrn
  • 633-942-767-514-2
source
language
  • Mandarin Chinese
  • Chinese
language.area
  • Asia
relation
relation.utilization *This metadata is automatically extracted
coverage.temporal
  • 2004
coverage.spacial
rights
  • Rights available for: Evaluation Use