CFP last date
20 January 2025
Reseach Article

Translation Shared Task on Statistical Machine Translation: A Comparison of the Systems Output

by Muhammad Arifur Rahman
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 55 - Number 1
Year of Publication: 2012
Authors: Muhammad Arifur Rahman
10.5120/8718-1559

Muhammad Arifur Rahman . Translation Shared Task on Statistical Machine Translation: A Comparison of the Systems Output. International Journal of Computer Applications. 55, 1 ( October 2012), 16-22. DOI=10.5120/8718-1559

@article{ 10.5120/8718-1559,
author = { Muhammad Arifur Rahman },
title = { Translation Shared Task on Statistical Machine Translation: A Comparison of the Systems Output },
journal = { International Journal of Computer Applications },
issue_date = { October 2012 },
volume = { 55 },
number = { 1 },
month = { October },
year = { 2012 },
issn = { 0975-8887 },
pages = { 16-22 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume55/number1/8718-1559/ },
doi = { 10.5120/8718-1559 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T20:56:08.959836+05:30
%A Muhammad Arifur Rahman
%T Translation Shared Task on Statistical Machine Translation: A Comparison of the Systems Output
%J International Journal of Computer Applications
%@ 0975-8887
%V 55
%N 1
%P 16-22
%D 2012
%I Foundation of Computer Science (FCS), NY, USA
Abstract

The ACL Workshop on Statistical Machine Translation proposed a translation shared task focused on European language pairs. Participants used their systems to translate into the target language a test set of unseen sentences in the source language. Involved languages were French, English, Spanish, German, Czech and Hungarian. The goal of this work is to quantitatively compare the translations generated by different systems. In particular, a selection of submitted runs for the French-English, German-English and Spanish-English tasks were analyzed. The systems involved in our investigation cover all the main approaches to machine translation, that is rule-based, statistical, example-based and hybrid.

References
  1. Philipp Koehn, Franz Josef Och, and Daniel Marcu. 2003. Statistical Phrase-based translation. In Proceedings of Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NACCL, pages 127-133. Edmonton, Alberta.
  2. 2 Brown, P. F. , Pietra, S. D. , Pietra, V. J. D. , and Mercer, R. L. , 1993. The mathematic of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263–311.
  3. Yu Chen, Andreas Eisele, Christian Federmann, Eva Hasler, Michael Jellinghaus and Silke Theison. 2007. Multiengine Machine translation with an open-source SMT decoder. In Proceedings of WMT 07, pages 193-196, Prague, Czech Republic, June. Association for Computational Linguistics.
  4. Chris Callison-Burch, Cameron Fordyce, Philipp Kohen, Christof Monz and Josh Schroeder. 2008. Further Meta-Evaluation of Machine translation. In Proceedings of WMT 08, pages 70-106, Columbus, Ohio, USA, June. Association for Computational Linguistics.
  5. Kishore Papineni, Salim Roukos, Todd Ward and Wei-Jing Zhu. 2002. BLEU: a method for automatic evaluation of machine translation. In proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL-2002). Philadelphia, Pennsylvania.
  6. Andrew Finch, Young-Sook Hwang and Eiichiro Sumita, "Using Machine Translation Evaluation Techniques to Determine Sentence-level Semantic Equivalence", pages 17-24 Second International Joint Conference, Jeju Island, Korea.
  7. Rosetta, M. T. 1994. Compositional translation. International Series in Engineering and Computer Science, Kluwer Academic Publishers.
  8. Dorr Bonnie J. , Pamela W. Jordan, and John W. Benoit, 1998. A Survey of Current Paradigms in Machine Translation," Technical Report: LAMP-TR-027, UMIACS-TR-98-72, CS-TR-3961, University of Maryland, College Park.
  9. Boitet, C. Ch. Boitet, P. Guillaume, M. Quezel-Ambrunaz, 1982. Implementation and conversational environmerz of ARIANE-78. 4. In Proceedings of COLING-82, Prague.
  10. Jun-tcht Nakamura, Jun-tcht Tsujii, Makoto Nagao, 1984. Grammar Writing System (GRADE) of Mu-Machtne Translation Project and its Characteristics. In Proceedings of COLING-84, pages: 338-343, Stanford University, Stanford, California.
  11. Forgy, C. L. 1982. Rete : A fast algoritm for the many pattern/many object pattern match problems. September 1982, pages: 17-37. Artificial Intelligence, Vol 19(1).
  12. Sato, S. and Nagao, M, 1990. Towards memory based translation. In Coling-90: papers presented to the 13th International Conference on Computational Linguistics, volume 3, pages 173–180.
  13. Sato, S. 1993. Example-based translation of technical terms. In TMI-93: The Fifth International Conference on Theoretical and Methodological Issues in Machine Translation.
  14. Peter F. Brown, John Cocke, Stephan A. Della Pietra, Vincent J. Della Pietra, Fredrick Jelinek, John D. Laffferty, Robert L. Mercer and Paul S. Roossin. 1990. A statistical approach to machine translation. Computational Linguistics, 16(2):79-85.
  15. Yamada, K. and Knight, K. , 2001. A syntax-based statistical translation mode. In Proceedings of Association of Computational Linguistics.
  16. Graeme Blackwood, Adri`a de Gispert, Jamie Brunning, andWilliam Byrne. 2008. European language translation with weighted finite state transducers: The CUED MT system for the 2008 ACL workshop on SMT. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 131–134, Ohio, June. Association for Computational Linguistics.
  17. Daniel D´echelotte, Gilles Adda, Alexandre Allauzen, H´el`ene Bonneau-Maynard, Olivier Galibert, Jean-Luc Gauvain, Philippe Langlais, and Franc¸ois Yvon. 2008. Limsi's statistical translation systems for WMT'08. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 107–110, Columbus, Ohio, June. Association for Computational Linguistics.
  18. Philipp Koehn, Abhishek Arun, and Hieu Hoang. 2008. Towards better machine translation quality for the German-English language pairs. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 139–142, Columbus, Ohio, June. Association for Computational Linguistics.
  19. Nguyen Bach, Qin Gao, and Stephan Vogel. 2008. Improving word alignment with language model based confidence scores. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 151–154, Columbus, Ohio, June. Association for Computational Linguistics.
  20. Greg Hanneman, Edmund Huber, Abhaya Agarwal, Vamshi Ambati, Alok Parlikar, Erik Peterson, and Alon Lavie. 2008. Statistical transfer systems for French-English and German-English machine translation. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 163–166, Columbus, Ohio, June. Association for Computational Linguistics.
  21. Lo¨?c Dugast, Jean Senellart, and Philipp Koehn. 2008. Can we relearn an RBMT system? In Proceedings of the Third Workshop on Statistical Machine Translation, pages 175–178, Columbus, Ohio, June. Association for Computational Linguistics.
  22. John Tinsley, Yanjun Ma, Sylwia Ozdowska, and Andy Way. 2008. MaTrEx: The DCU MT system for WMT 2008. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 171–174, Columbus, Ohio, June. Association for Computational Linguistics.
  23. Holger Schwenk, Jean-Baptiste Fouet, and Jean Senellart. 2008. First steps towards a general purpose French/English statistical machine translation system. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 119–122, Columbus, Ohio, June. Association for Computational Linguistics.
  24. Andreas Eisele, Christian Federmann, Herv´e Saint-Amand, Michael Jellinghaus, Teresa Herrmann, and Yu Chen. 2008. Using moses to integrate multiple rule-based machine translation engines into a hybrid system. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 179–182, Columbus, Ohio, June. Association for Computational Linguistics.
  25. Zhuoran Wang and John Shawe-Taylor. 2008. Kernel regression framework for machine translation: UCL system description for WMT 2008 shared translation task. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 155–158, Columbus, Ohio, June. Association for Computational Linguistics.
  26. Sara Stymne, Maria Holmqvist, and Lars Ahrenberg. 2008. Effects of morphological analysis in translation between German and English. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 135–138, Columbus, Ohio, June. Association for Computational Linguistics.
  27. Maxim Khalilov, Adolfo Hern´andez H. , Marta R. Costajussa, Josep M. Crego, Carlos A. Henr´?quez Q. , Patrik Lambert, Jos´e A. R. Fonollosa, Jos´e B. Mari˜no, and Rafael E. Banchs. 2008. The TALP-UPC Ngrambased statistical machine translation system for ACLWMT 2008. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 127–130, Columbus, Ohio, June. Association for Computational Linguistics.
Index Terms

Computer Science
Information Sciences

Keywords

Shared Task SMT RBMT EBMT BLEU