MAURDOR Evaluation Package

registration: 2016/01/17 10:20:39, last modified: 2016/01/17 10:20:39
title
  • MAURDOR Evaluation Package
title.abbreviation
title.alternative
creator
subject
subject.linguisticField
subject.monoMultilingual
subject.resourceSubject
description
  • Multimodal/Multimedia Resources
    The MAURDOR project consists in evaluating systems for automatic processing of written documents. Collected written documents are scanned documents (printed, typewritten or manuscripts).

    In order to get images for the evaluation of automatic analysis systems, 10,000 original documents were collected and annotated (5000 in French, 2500 in English and 2500 in Arabic). This package contains 8,129 documents out of the 10,000 originally collected.

    Each of the 8129 documents belongs to one of the 5 following categories:
    C1: Printed form (completed in manuscript)
    C2: Commercial, private or professional document, printed or photocopied
    C3: Manuscript private correspondence
    C4: Typewritten private or professional correspondence
    C5: Others

    Once collected, those documents were submitted to a manual annotation. This human analysis is used as a reference, known as ground truth, for the training and evaluation of automatic processing systems.

    Annotations aim to highlight the following information:
    1. How the document is structured (text zones, images...)?
    2. Which writings are present, with their type (manuscript/typewritten) and their language (French, English, Arabic, other)?
    3. What is the main information in the documents (author, recipient, subject, date...)?

    The MAURDOR evaluation campaign provides a common framework for the reporting of current performances of systems for automatic processing of digital documents. This package contains the material provided to the campaign participants:
    - Consistent development and test data corresponding to the application concerned;
    - Tools for the automatic measurement of system performances;
    - A common assessment protocol applicable to each processing stage, along with a complete automatic processing chain for written documents.

    The documents are provided in TIFF format and the annotations are provided in XML format.

    The aim of this evaluation package is to enable external players to evaluate their own system and compare their results with those obtained during the campaign itself.
description.price *This metadata is only as a guide
description.language
description.inputDevice
description.inputEnvironment
description.speakingStyle
description.speechMode
description.samplingRate
description.additionalData
publisher
  • ELRA (European Language Resources Association)
contributor
contributor.attribute.author.motherTongue
contributor.attribute.author.dialect
contributor.attribute.author.level
contributor.attribute.author.age
contributor.attribute.author.gender
contributor.attribute.speaker.motherTongue
contributor.attribute.speaker.dialect
contributor.attribute.speaker.level
contributor.attribute.speaker.age
contributor.attribute.speaker.gender
contributor.attribute.speaker.number
date.created
date.issued
  • 2015-02-25
date.modified
  • 2015-02-26
type
type.discourseType
type.linguisticType
  • primary_text
type.purpose
type.style
type.form
type.sentence
type.annotation
type.annotationSample
type.sample
format.extent
format.medium
format.encoding
format.markup
format.functionality
identifier
identifier.doi
identifier.islrn
source
language
  • French
  • English
  • Arabic
language.area
relation
relation.utilization *This metadata is automatically extracted
coverage.temporal
coverage.spacial
rights
  • Rights available for: Research Use, Evaluation Use, Commercial Use