Keywords
Machine Translation
post-editing
productivity
quality
How to Cite
Abstract
This article reports on a controlled study carried out to examine the possible benefits of editing Machine Translation and Translation Memory outputs when translating from English to Welsh. Using software capable of timing the translation process per segment, 8 professional translators each translated 75 sentences of differing match percentage, and post- edited a further 25 segments of Machine Translation. Basing the final analysis on 800 sentences and 17,440 words, the use of Fuzzy Matches in the 70-99% match range, Exact Matches and Statistical Machine Translation was found to significantly speed up the translation process. Significant correlations were also found between the processing time data of Exact Matches and Machine Translation post-editing, rather than between Fuzzy Matches and Machine Translation as expected. Two experienced translators were then asked to rate all translations for fidelity, grammaticality and style, whereby it was found that the use of translation technology either did not negatively affect translation quality compared to manual translation, or its use actually improved final quality in some cases. As well as confirming the findings of research in relation to translation technology, these findings also contradict supposed similarities between translation quality in terms of style and post-editing Machine Translation.
References
Andrews, Tegau. 2015. Cyd-destun gwleidyddol a chymdeithasol cyfieithu yn y Gymru gyfoes. Available at: https://www.cadarn.ac.uk/cy/adnodd/ysgrifau-chanllawiau-cyfieithu-%E2%80%93-delyth-prys-robat-trefor-goln (accessed: 27 January 2016).
Aranberri, Nora et al. 2014. “Comparison of post-editing productivity between professional translators and lay users”, in: Sharon O’Brien, Michel Simard and Lucia Specia (eds.) Proceedings of the Third Workshop on Post-Editing Technology and Practice. Vancouver, Canada, October 2014: AMTA, 20-33.
Bowker, Lynne and Jairo Ciro. 2015. “Investigating the usefulness of machine translation for newcomers at the library”, Translation and Interpreting Studies, 10(2): 165-186.
Bowker, Lynne and Melissa Ehgoetz 2009. “Exploring user acceptance of Machine Translation output”, in: Dorothy Kenny and Ryou Kyongjoo (eds.) Across Boundries: International Perspectives on Translation Studies. Newcastle: Cambridge Scholars Publishing, 209-225.
Bowker, Lynne. 2005. “Productivity v. Quality? A pilot study on the impact of translation memory systems”, Localisation Focus 15: 3-20.
Bowker, Lynne. 2009. “Can Machine Translation meet the needs of official language minority communities in Canada? A recipient evaluation”. Linguistica Antverpiensia 8: 123-155.
Brkić, Marija et al. 2009. Using Translation Memory to speed up translation process. Available at: http://darhiv.ffzg.unizg.hr/8036/ (accessed 14 August 2016).
Carl, Michael et al. 2011. The process of post-editing: A pilot study. Available at: http://mt- archive.info/NLPSC-2011-Carl-1.pdf (accessed: 11 March 2016).
Carl, Michael et al. 2015. “Post-editing Machine Translation: Efficiency, strategies and revision processes in professional translation settings”, in: Aline Ferreira and John W. Schwieter (eds.) Psycholinguistic and cognitive inquiries into translation and interpreting. Amsterdam/Philadelphia: John Benjamins Publishing Company, 145-174.
Daelemans, Walter and Veronique Hoste. 2009. “Introduction. Evaluation of translation technology”, Linguistica Antverpiensia 8: 9-17.
Daems, Joke, Lieve Macken and Sonia Vandepitte. 2013. “Quality as the sum of its parts: A two-step approach for the identification of translation problems and translation quality assessment for HT and MT+PE” , in: Sharon O’Brien et al. (eds.). Proceedings of the MT Summit XIV Workshop on Post-editing Technology and Practice. Nice, France, September 2 2013: AMTA, 63-71.
De Sousa, Sheila et al. 2011. “Assessing the post-editing effort for automatic and semi- automatic translations of DVD subtitles”, in: Galia Angelova et al. (eds.) Proceedings of the International Conference in Recent Advances in Natural Language Processing. Hissar, Bulgaria, 12-14 September, 2011: INCOMA, 97-104.
Depraetere, Ilse et al. 2014. “Post-Edited quality, post-editing behaviour and human evaluation: A case study”, in: Sharon O’Brien et al. (eds.) Post-editing of Machine Translation: Processes and applications. Newcastle: Cambridge Scholars Publishing, 78-109.
Elming, Jakob et al. 2014. “Investigating user behaviour in post-editing and translation using the CASMACAT workbench”, in: Sharon O’Brien et al. (eds.) Post-editing Machine Translation: Processes and Applications. Newcastle: Cambridge Scholars Publishing, 147-169.
Federico, Marcello et al. 2012. Measuring user productivity in Machine Translation enhanced computer assisted translation. Available at: https://www.matecat.com/wp- content/uploads/2012/11/Measuring_User_Productivity_in_Machine_Translation_Enhanced_matecat.pdf (accessed 07 March /2016).
Fiederer, Rebecca. and Sharon O’Brien. 2009. “Quality and Machine Translation: A realistic objective?”, Journal of Specialised Translation 11: 52-74.
Flourney, Raymond and Christine Duran. 2009. “Machine Translation and document localization at Adobe: From pilot to production”, in: Isabelle Pierre et al. (eds.) Proceedings of the 12th MT Summit. Ottawa, August 26-30, 2009: AMTA.
García, Ignacio. 2011. “Translating by post-editing: Is it the way forward?” Machine Translation 25(3): 217-237.
González, Marta García. 2005. “Translation of minority languages in bilingual and multilingual communities”, in: Albert Branchadell and Lovell Margaret West (eds.) Less Translated Languages. Amsterdam/Philadelphia: John Benjamins Publishing Company, 105-125.
Goves, Declan and Schmidtke, Dag. 2009. “Indentification and analysis of post-editing patterns for MT”, in: Isabelle Pierre et al. (eds.) Proceedings of the 12th MT Summit. Ottawa, August 26-30, 2009: AMTA.
Green, Spence, Jeffrey Heer and Christopher Manning. 2013. The efficacy of human post- Editing for language translation. Available at: https://nlp.stanford.edu/-pubs/green+heer+manning.chi13.pdf (accessed 13 May 2015).
Guerberof, Ana Arenas. 2009. “Productivity and quality in the post-editing of outputs from translation memories and Machine Translation”, International Journal of Localization 7(1): 11-21.
Guerberof, Ana Arenas. 2012. Productivity and quality in the post-editing of outputs from Translation Memories and Machine Translation. Unpublished PhD Thesis, Universitat Rovira I Virgili.
Guerberof, Ana Arenas. 2014. “The role of professional experience in post-editing from a quality and productivity perspective”, in: Sharon O’Brien et al. (eds.) Post-editng of Machine Translation: Processes and applications. Newcastle: Cambridge Scholars Publishing, 51-76.
Hutchins, John and Harold Somers. 1992. Introduction to Machine Translation. London: Academic Press.
Jimenez-Crespo, Miguel. 2009. “The effect of Translation Memory tools in translated web texts: Evidence from a comparative product-based study”, Linguistica Antverpiensia 8: 213-232.
Kanavos, Panagiotis and Dimitrios Kartsaklis, 2010. “Integrating Machine Translation with Translation Memory: A practical aprroach”, in: Ventsislav Zhechev (eds.) Proceedings of the second joint EM+/CNGL workshop “Bringing MT to the user: Research on integrating MT in the translation industry”. Denver, Colorado 4 Novemebr, 2010: AMTA, 11-20.
Kaufmann, Judith. 2010. “Cyfieithu a pholisi iaith”, Contemporary Wales 23(1): 171-183.
Kaufmann, Judith. 2012. “The Darkened glass of bilingualism? Translation and interpreting in Welsh language planning”, Translation Studies 5(3): 327-344.
Koehn, Phillip. 2009. “A process study of computer-aided translation”, Machine Translation 23(4): 241-263.
Koglin, Arlene. 2015. “An empirical investigation of cognitive effort required to post-edit machine translated metaphors compared to the translation of metaphors”, Translation and Interpreting 7(1): 126-14
Lange, Carmen Andres and Winfield Scott Bennett. 2000. “Combining Machine Translation with Translation Memory at Baan”, in: Robert C. Sprung (ed.) Translating into Success: Cutting-edge strategies for going multilingual in a global age. Amsterdam/Philadelphia: John Benjamin’s Publishing Company, 203-219.
Läubli, Samuel et al. 2013. “Assessing post-editing efficiency in a realistic translation environment”, in: Sharon O’Brien, Michel Simard and Lucia Specia (eds.) Proceedings of the XIV MT summit on post-editing technology and practice. Nice, France, 6-9 September 2013: EAMT, 83-91.
Lee, Jason and Posen Liao. 2011. “A comparative study of human translation and Machine Translation with post-editing”, Compilation and Translation Review 4(2): 104-149.
Mellinger, Christopher Davey. 2014. Computer-Assissted translation: An investigation of cognitive effort. Unpublished PhD Thesis, Kent State University.
Miguélez-Carballeira, Helena Angharad Price and Judith Kaufman et al. 2016. “Introduction: Translation in Wales: History, theory and approaches”, Translation Studies 9(2): 125-136.
Moran, John, David Lewis and Christian Saam. 2014. “Analysis of post-editing data: A productivity field test using an instrumented CAT tool”, in: Sharon O’Brien et al. (eds.) Post-editing of Machine Translation: Processes and applications. Newcastle: Cambridge Scholars Publishing, 126-147.
Ní Ghearáin, Helena. 2007. “Yr iaith Wyddeleg a’r Gyfraith: Rhai materion o ran statws a chorpws”, Cambrian Law Review, 38: 1-38.
Núńez, Gabriel González. 2013. “Translating for linguistic minorities in Northern Ireland: A look at translation policy in the judiciary, healthcare and local government”, Current Issues in Language Planning 14(3-4): 474-489.
O’Brien, Sharon. 2006. “Pauses as indicators of cognitive effort in post-editing Machine Translation output”, Across Languages and Cultures 7(1), 1-21.
O’Brien, Sharon. 2007a.” An empirical investigation of temporal and technical post-editing effort”, Translation and Interpreting Studies 2(1): 83-136.
O’Brien, Sharon. 2007b. “Eye-tracking and Translation Memory matches”, Perspectives: Studies in Translatology 14(3), 185-205.
O’Connell, Eithne and John Walsh. 2006. “The translation boom: Irish and language planning in the twenty-first century”, Administration, 54(3): 22-43.
O’Curran, Elaine. 2014. Machine Translation and post-editing for user generated content: An LSP perspective. Available at: http://www.amtaweb.org/AMTA2014Proceedings/AMTA-2014Proceedings_Research Track_final.pdf (accessed: 12 May 2015).
Offersgaard, Lene et al. 2008. Domain specific MT in use. Available at: http://www.mt- archive.info/05/EAMT-2008-Offersgaard.pdf (accessed: 4 September 2015).
Plitt, Mirko and François Masselot. 2010. “A productivity test of Statistical Machine Translation post-editing in a typical localisation context”, The Prague Bulletin of Mathematical Linguistics 93: 7-16.
Prys, Delyth, Gruffudd Prys and Dewi Bryn Jones. 2009. Gwell Offer Technoleg Cyfieithu ar gyfer y Diwydiant Cyfieithu yng Nghymru: Arolwg Dadansoddol. Available at: http://techiaith.bangor.ac.uk/wp- content/uploads/2016/06/CATcymru_Adroddiad-Terfynol_HE06fsp_CY.pdf (accessed: 15 May 2015).
Screen, Benjamin. 2016. “What does Translation Memory do to translation? The effect of Translation Memory output on specific aspects of the translation process”, Translation & Interpreting 8(1): 1-17.
Silva, Roberto. 2014. “Integrating post-editing MT in a professional translation workflow”, in: Sharon O’Brien et al. (eds.) Post-editing Machine Translation: Processes and applications. Newcastle: Cambridge Scholars Publishing, 24-51.
Skadiņš, Raivis et al. 2011. Evaluation of SMT in localization to under-resourced inflected language. Available: http://mt-archive.info/EAMT-2011-Skadins.pdf (accessed: 26 September 2016).
Somers, Harold. 2003. “Translation memory systems”, in: Harold Somers (ed.) Computers and translation: A Translator’s guide. Amsterdam/Philadelphia: John Benjamin’s Publishing Company, 31-49.
TAUS. 2010. Post-editing in practice. Available at: https://www.taus.net/think- tank/reports/postedit-reports/postediting-in-practice (accessed 07 December 2015).
Teixeira, Carlos. 2011. “Knowledge of provenance and its effects on translation performance in an integrated TM/MT environment”, in: Bernadette Sharp et al. (eds.) Proceedings of the 8th international NLPCS workshop - Special theme: Human-machine interaction in translation. Copenhagen Studies in Language 41. Frederiksberg: Samfundslitteratur. 107-118.
Uswak, V. 2014. “Einsatz der Maschinellen Übersetzung im Übersetzungsprozess in Unternehm”, in: Jan Mugele et al. (eds.). Tagungsband der Nachwuchswissenschaftlerkonferenz. Magdeburg, 24 April 2014. 70-73.
Vázquez, Lucía Morado et al. 2013. “Comparing forum data post-editing performance using translation memory and Machine Translation output: a pilot study”, in: Sharon O’Brien, Michel Simard and Lucia Specia. (eds.) Proceedings of the MT summit XIV workshop on post-editing technology and practice. Nice, France, September 2 2013: EAMT, 249-256.
Watkins, Gareth. 2012. Translation Tools and Technologies in the Welsh Language Context. Unpublished PhD Thesis, Swansea University.
Welsh Government and Welsh Language Commissioner. 2015. National Survey for Wales, 2013-2014: Welsh Language Use Survey. Cardiff: Welsh Government and Welsh Language Commissioner.
Welsh Government. 2012. A Living Language: A Language for Living - Welsh Language Strategy 2012-2017. Cardiff: Welsh Government.
Welsh Government. 2014. A Living Language: A Language for Living - Moving Forward. Policy Statement. Cardiff: Welsh Government.
Welsh Government. 2017. Cymraeg 2050 - A Million Welsh Speakers. Cardiff: Welsh Government.
Welsh Language Commissioner. 2012. Advice Document: Bilingual Drafting, Translation and Interpreting. Cardiff: Welsh Language Commissioner.
Welsh Language Commissioner. 2015. Annual 5-year Report. Cardiff: Welsh Language Commissioner.
Yamada, Masaru. 2011. “The effect of translation memory databases on productivity”, in: Anthony Pym (ed.) Translation research projects 3. Tarragona: Intercultural Studies Group, 63-73.
Zaretskaya, Anna. 2015. “Integration of Machine Translation in CAT tools: State of the art, evaluation and user attitudes”, Skase Journal of Translation and Interpretation 8(1): 76-89.
Zetzsche, Jost. 2007. “Translation Memory: State of the technology”, Multilingual Computing 8(6), 34-38.
Zhechev, Ventsislav. 2014. “Analysing the post-editing of Machine Translation at Autodesk”, in: Sharon O’Brien et al. (eds.) Post-editing of Machine Translation: Processes and applications. Newcastle: Cambridge Scholars Publishing, 2-24.
License
Copyright (c) 2017 Benjamin Screen
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.