Hungarian-English Parallel Text, Version 1.0

registration: 2008/03/15 05:34:37, last modified: 2016/01/17 10:21:15
title
  • Hungarian-English Parallel Text, Version 1.0
title.abbreviation
title.alternative
  • Hunglish Corpus, Version 1.0
creator
  • developer Media Research and Education Center at the Budapest University of Technology and Economics (BUTE) (http://mokk.bme.hu/index_html-en?set_language=en&cl=en)
  • developer Corpus Linguistics Department at the Hungarian Academy of Sciences Institute of Linguistics (http://www.nytud.hu/depts/corpus/index.html)
  • researcher Dániel Varga, BUTE (daniel@mokk.bme.hu)
  • researcher László Németh, BUTE (nemeth@mokk.bme.hu)
  • researcher Péter Halácsy, BUTE (hp@mokk.bme.hu)
  • researcher András Kornai, BUTE (kornai@mokk.bme.hu)
  • researcher Attila Vonyó (vonyoa@freemail.hu)
  • researcher Bálint Sass, Hungarian Academy of Sciences Institute of Linguistics (joker@nytud.hu)
  • researcher Gergely Bottyán, Hungarian Academy of Sciences Institute of Linguistics (bottyang@corpus.nytud.hu)
  • researcher Tamás Váradi, Hungarian Academy of Sciences Institute of Linguistics (varadi@nytud.hu)
  • researcher Enikő Héja, Hungarian Academy of Sciences Institute of Linguistics (eheja@nytud.hu)
  • researcher Ágnes Gyarmati, Hungarian Academy of Sciences Institute of Linguistics (aagnes@nytud.hu)
  • researcher Ágnes Mészáros, Hungarian Academy of Sciences Institute of Linguistics (magnes@corpus.nytud.hu)
  • researcher Dávid Labundy, Hungarian Academy of Sciences Institute of Linguistics
  • researcher Viktor Trón, BUTE (v.tron@ed.ac.uk)
  • researcher Viktor Nagy (nagyv@nytud.hu)
subject
  • parallel text corpus
  • monolingual text corpus
subject.linguisticField
  • computational_linguistics
  • text_and_corpus_linguistics
  • translating_and_interpreting
subject.monoMultilingual
  • multilingual
subject.resourceSubject
  • corpus
description
  • *Introduction*

    Hungarian-English Parallel Text, Version 1.0 (also known as the "Hunglish Corpus") is a sentence-aligned Hungarian-English parallel corpus consisting of approximately two million sentence pairs. The corpus contains additional language resources for the Hungarian text, including a monolingual corpus, morphological toolset and aligner.

    Hungarian-English Parallel Text, Version 1.0 is a joint work of the Media Research and Education Center at the Budapest University of Technology and Economics (BUTE) and the Corpus Linguistics Department at the Hungarian Academy of Sciences Institute of Linguistics.

    Additional information about this release is available from the corpus website maintained by BUTE.

    *File formats, character encoding*

    This publication is issued on CD as a tarred zip file. Commonly available utilities such as Gnu Zip or Stuffit will readily extract this publication from its compressed form.

    Sentence pair (.bi) files consist of tab-separated, matching sentence pairs. The .bi files do not contain segments where deletion or contraction occurred. They are also filtered based on quality, so the full reconstruction of the raw texts is impossible. Some .bi files were shuffled (sorted alphabetically).

    Alignment "ladder" (.lad) files preserve the whole of both input texts with ordering, even those segments that were not successfully aligned. In .lad files, every line is tab-separated into two columns. The first is a segment of the Hungarian text. The second is a (supposedly corresponding) segment of the English text. Such segments of the source or target text will generally consist of exactly one sentence on both sides, but can also consist of zero, or more than one, sentence. In the latter case, the special separating token " ~~~ " is placed between sentences.

    The encoding of the sentence pair and the alignment files is mixed: ISO Latin-2 on the Hungarian side, and ISO Latin-1 on the English side. The overwhelming majority of the texts use compatible subsets of these two encodings, so for viewing, the files can be considered ISO Latin-2 encoded.

    hu and en are the raw texts used, in ISO Latin-2 and ISO Latin-1 encoding respectively.

    *Samples*

    For an example of the data contained in this corpus, please examine this sample screen capture of bilingual text.
description.price *This metadata is only as a guide
description.language
  • English
description.inputDevice
description.inputEnvironment
description.speakingStyle
description.speechMode
description.samplingRate
description.additionalData
publisher
contributor
  • sponsor Hungarian Ministry of Informatics and Communications (Grant number: IHM-ITEM 2003/76/6/2004)
  • editor András Aklán, BUTE (project management)
  • consultant Mike Maxwell, LDC
  • developer Magyar Telekom Rt. (infrastructure support)
contributor.attribute.author.motherTongue
  • native
contributor.attribute.author.dialect
  • standard_dialect
contributor.attribute.author.level
  • professional
contributor.attribute.author.age
  • adult
contributor.attribute.author.gender
  • male
  • female
contributor.attribute.speaker.motherTongue
contributor.attribute.speaker.dialect
contributor.attribute.speaker.level
contributor.attribute.speaker.age
contributor.attribute.speaker.gender
contributor.attribute.speaker.number
date.created
date.issued
  • 2008-01-22
date.modified
type
  • Text
type.discourseType
  • drama
  • formulaic_discourse
  • procedural_discourse
  • report
type.linguisticType
  • primary_text
type.purpose
  • developing_technologies cross-lingual information retrieval
  • developing_technologies machine translation
type.style
  • written legal documents
  • written literary works
  • written magazines
  • written manuals
  • written movie subtitles
type.form
  • unfixed
type.sentence
  • short
  • long
type.annotation
  • annotated
type.annotationSample
type.sample
format.extent
  • Total Number of Files: 41255 under data, 41854 total
  • Data Size (uncompressed): 1353 MB
  • Data Size (compressed): 546 MB
  • Total Number of Sentences in the Parallel Corpus: approximately 2.07 million sentence pairs
  • Total Number of Words in the Prallel Corpus: approximately 54.3 million words
  • Total Number of Sentences in the Hungarian Monolingual Corpus: approximately 3 million sentences
  • Total Number of Words in Hungarian Monolingual Corpus: approximately 46.4 million words
  • Medium: 1 CD
  • Corpus size: 1992294 KB
format.medium
  • Web Download
format.encoding
  • ISO Latin-2 (Hungarian)
  • ISO Latin-1 (English)
format.markup
format.functionality
identifier
identifier.doi
identifier.islrn
  • 694-868-944-045-4
source
  • (parallel corpus) Legal documents from CELEX database
  • (parallel corpus) The EU Constitution (legal documents)
  • (parallel corpus) Literary works from the Project Gutenberg collection (http://www.gutenberg.org/wiki/Main_Page)
  • (parallel corpus) Literary works from the Hungarian Electronic Library (http://mek.oszk.hu/)
  • (parallel corpus) Translations of English newspaper and magazine articles including "Diplomacy and Trade" and "National Geography"|,(parallel corpus) Technical manuals on software from OpenOffice.org, Mozilla, Gnome, KDE, and other major FOSS (Free Open Source Software) projects
  • (parallel corpus) Movie subtitles
  • (monolingual corpus) Hungarian National Corpus
language
  • English
  • Hungarian
language.area
  • Europe
  • America
relation
  • isReferencedBy [???Reference] Dániel Varga, et al., 2008, "Hungarian-English Parallel Text, Version 1.0," Linguistic Data Consortium, Philadelphia
  • references C-003333: Hungarian National Corpus
relation.utilization *This metadata is automatically extracted
coverage.temporal
coverage.spacial
  • Europe
  • United States
rights