Keywords
machine translation
legal translation
ChatGPT
Google Translate
human translation
Arabic-English translation
How to Cite
Abstract
This study examines the comparative accuracy and fluency of Neural Machine Translations (NMTs) and Language Model-based translations (LLMs), represented by ChatGPT and Google Translate (GT), in legal contexts. Texts from Farahaty’s "Arabic-English-Arabic Legal Translation," sourced from primary texts cited in the book and translated by renowned scholars such as Hatim, Shunnaq, Buckley, and Farahaty, were used as benchmarks for human translation (HT). Sixteen diverse texts encompassing various legal discourse subgenres were selected for analysis, with all Arabic in-text examples transliterated using the Library of Congress (LOC) system. Qualitative analysis was conducted to assess the extent to which NMTs and LLMs match HT in accuracy and fluency. The study also investigates the similarities and differences between ChatGPT and GT in their translation outputs. Findings highlight HT’s superiority in producing precise, stylistically appropriate translations, compared to the challenges faced by NMTs and LLMs in capturing legal terminology and subtle linguistic nuances. Despite variations, both ChatGPT and GT demonstrate efficiency and context sensitivity, suggesting their potential as valuable tools when coupled with human post-editing. The study concludes by advocating for a hybrid approach that leverages the strengths of automated translation systems and human expertise to enhance cross-linguistic legal communication.
References
Abdelaal, N. M., & Alazzawie, A. (2020). Machine translation: The case of Arabic-English translation of news texts. Theory & Practice in Language Studies, 10(4), 415-424.
Al Sawi I., & Allam, R. (2024). Exploring challenges in audiovisual translation: A comparative analysis of human- and AI-generated Arabic subtitles in Birdman. PLOS ONE 19(10): e0311020.
Al Sawi, I., & Alaa, A. (2024). Navigating the impact: a study of editors’ and proofreaders’ perceptions of AI tools in editing and proofreading. Discov Artif Intell 4, 23 (2024).
Alcaraz, E., & Hughes, B. (2002). Legal translation explained. Routledge.
Badawi, E., Carter, M., & Gully, A. (2004). Modern Written Arabic: A Comprehensive Grammar. Routledge.
Bahdanau, D., Cho, K., & Bengio, Y. (2015). Neural machine translation by jointly learning to align and translate. International Conference on Learning Representations. https://arxiv.org/abs/1409.0473
Baniata, L. H., Ampomah, I. K., & Park, S. (2021). A transformer-based neural machine translation model for Arabic dialects that utilizes subword units. Sensors, 21(19),
Bhatia, V. K. (1993). Analyzing genre: Language use in professional settings. Longman.
Borowski, M. (2015). Language and its influence on how we understand reality. SKASE Journal of Theoretical Linguistics, 12(2), 70-91.
Crystal, D., & Davy, D. (1969). Investigating English style. Longman.
El-Farahaty, H. (2015). Arabic-English-Arabic legal translation: Issues and strategies. Routledge.
Farzindar, A., & Lapalme, G. (2009). Machine translation of legal information and its evaluation. In Advances in Artificial Intelligence: 22nd Canadian Conference on Artificial Intelligence, Canadian AI 2009, Kelowna, Canada, May 25-27, 2009 Proceedings 22 (pp. 64-73). Springer.
Hatim, B., & Mason, I. (1997). The translator as communicator. Routledge.
Hendy, A., Abdelrehim, M., Sharaf, A., Raunak, V., Gabr, M., Matsushita, H., Jin Kim, Y., Afify, M., & Awadalla, H. H. (2023). How good are GPT models at machine translation? A comprehensive evaluation. CoRR. https://arxiv.org/abs/2302.09210
Jiang, Z., Lv, Q., & Zhang, Z. (2023). Distinguishing translations by human, NMT, and ChatGPT: A linguistic and statistical approach. arXiv preprint arXiv:2312.10750.
Karpinska, M., & Iyyer, M. (2023). Large language models effectively leverage document-level context for literary translation, but critical errors persist. arXiv preprint arXiv:2304.03245.
Killman, J. (2014). Vocabulary accuracy of statistical machine translation in the legal context. In Proceedings of the 11th Conference of the Association for Machine Translation in the Americas (pp. 85-98).
Killman, J. (2017). Applicability of EU multilingual resources: A case study of the translation into English of legal vocabulary in the judicial context of Spain. Babel, 63(6), 861-889.
Killman, J. (2023). Machine translation and legal terminology: Data-driven approaches to contextual accuracy. In Ł. Biel & H. J. Kockaert (Eds.), Handbook of terminology: Volume 3. Legal terminology (pp. 485-510). John Benjamins Publishing.
Kit, C., & Wong, T. M. (2008). Comparative evaluation of online machine translation systems with legal texts. Law Library Journal, 100(2), 221-240.
Kovács, T. (2022). Human and machine translation: A comparative analysis of neural machine and human-translated EN-HU and HU-EN legal texts. Porta Lingua, 1, 49-57.
Mileto, F. (2019). Post-editing and legal translation. H2D | Revista de Humanidades Digitais, 1(1), 35-46.
Sutskever, I., Vinyals, O., & Le, Q. (2014). Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems (NIPS 2014).
Tiersma, P. M. (1999). Legal language. University of Chicago Press.
Varga, M., & Grlić, T. (2023). Assessing machine translation from English to German: A case study.
Vigier-Moreno, F. J., & Pérez-Macías, L. (2022). Assessing neural machine translation of court documents: A case study on the translation of a Spanish remand order into English. Revista de Llengua i Dret, 78, 89-102.
Wilks, Y. (2008). Machine translation: Its scope and limits. Springer Science & Business Media.
Williams, C. (2005). Tradition and change in legal English: Verbal constructions in prescriptive texts. Peter Lang.
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gap, Q., Macherey, K., Klingner, J., Shah, A., Johnson, M., Liu, X., Kaiser, Ł., Gouws, S., Kato, Y., Kudo, T., Kazawa, H., Stevens, K., Kurian, G., Patil, N., Wang, W., Young, C., Smith, J., Riesa, J., Rudnick, A., Vinyals, O., Corrado, G., Hughes, M., & Dean, J. (2016). Google’s neural machine translation system: Bridging the gap between human and machine translation. arXiv preprint arXiv:1609.08144.
License
Copyright (c) 2025 Noureldin Abdelaal, Islam Al Sawi
This work is licensed under a Creative Commons Attribution 4.0 International License.
When submitting a paper the author agrees to the following publishing agreement and processing personal data.
PUBLICATION AGREEMENT, COPYRIGHT LICENSE, PERSONAL DATA PROCESSING CONSENT
This is a publication agreement and copyright license (“Agreement”) regarding a written manuscript currently submitted via Pressto platform
(“Article”) to be published in Comparative Legilinguistics International Journal for Legal Communication (“Journal”).
The parties to this Agreement are:
the Author or Authors of the submitted article (individually, or if more than one author, collectively, “Author”) and Comparative Legilinguistics International Journal for Legal Communication (“Publisher”), address al. Niepodległości 4, 61-874 Poznań, represented by its editor in chief Aleksandra Matulewska.
§1. LICENSE OF COPYRIGHT
a) The Author and the Publisher agree that the Author grants a Creative Commons Attribution 4.0 International License, which is incorporated herein by reference and is further specified at Creative Commons — Attribution 4.0 International — CC BY 4.0 copyright license in the Article to the general public.
b) The Author grants to the Publisher a royalty-free, worldwide nonexclusive license to publish, reproduce, display, distribute, translate and use the Article in any form, either separately or as part of a collective work, including but not limited to a nonexclusive license to publish the Article in an issue of the Journal, copy and distribute individual reprints of the Article, authorize reproduction of the entire Article in another publication, and authorize reproduction and distribution of the Article or an abstract thereof by means of computerized retrieval systems (such as Westlaw, Lexis and SSRN). The Author retains ownership of all rights under copyright in the Article, and all rights not expressly granted in this Agreement.
c) The Author grants to the Publisher the power to assign, sublicense or otherwise transfer any and all licenses expressly granted to the Publisher under this Agreement.
d) Republication. The Author agrees to require that the Publisher be given credit as the original publisher in any republication of the Article authorized by the Author. If the Publisher authorizes any other party to republish the Article under the terms of paragraphs 1c and 1 of this Agreement, the Publisher shall require such party to ensure that the Author is credited as the Author.
§2. EDITING OF THE ARTICLE
a) The Author agrees that the Publisher may edit the Article as suitable for publication in the Journal. To the extent that the Publisher’s edits amount to copyrightable works of authorship, the Publisher hereby assigns all right, title, and interest in such edits to the Author.
§3. WARRANTIES
a) The Author represents and warrants that to the best of the Author’s knowledge the Article does not defame any person, does not invade the privacy of any person, and does not in any other manner infringe upon the rights of any person. The Author agrees to indemnify and hold harmless the Publisher against all such claims.
b) The Author represents and warrants that the Author has full power and authority to enter into this Agreement and to grant the licenses granted in this Agreement.
c) The Author represents and warrants that the Article furnished to the Publisher has not been published previously. For purposes of this paragraph, making a copy of the Article accessible over the Internet, including, but not limited to, posting the Article to a database accessible over the Internet, does not constitute prior publication so long as the as such copy indicates that the Article is not in final form, such as by designating such copy to be a “draft,” a “working paper,” or “work-in-progress”. The Author agrees to hold harmless the Publisher, its licensees and distributees, from any claim, action, or proceeding alleging facts that constitute a breach of any warranty enumerated in this paragraph.
§4. TERM
a) The agreement was concluded for an unspecified time.
§5. PAYMENT
a) The Author agrees and acknowledges that the Author will receive no payment from the Publisher for use of the Article or the licenses granted in this Agreement.
b) The Publisher agrees and acknowledges that the Publisher will not receive any payment from the Author for publication by the Publisher.
§6. ENTIRE AGREEMENT
a) This Agreement supersedes any and all other agreements, either oral or in writing, between the Author and the Publisher with respect to the subject of this Agreement. This Agreement contains all of the warranties and agreements between the parties with respect to the Article, and each party acknowledges that no representations, inducements, promises, or agreements have been made by or on behalf of any party except those warranties and agreements embodied in this Agreement.
b) In all cases not regulated by this Agreement, legal provisions of Polish Copyright Act and Polish Civil Code shall apply.
c) Any disputes arising from the enforcement of obligations connected with this Agreement shall be resolved by a court competent for the headquarters of the Publisher.
d) Any amendments or additions to the Agreement must be made in writing and signed by authorised representative of both parties, otherwise being ineffective.
e) This Agreement is signed electronically and the submission of the article via the PRESSto platform is considered as the conclusion of the Agreement by the Author and the Publisher.
f) Clause for consent to the processing of personal data - general
g) The Author shall give his or her consent to the processing of their personal data in accordance with the Act of 10 May 2018 on the protection of personal data and Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of persons physical in connection with the processing of personal data and on the free movement of such data, and repealing Directive 95/46 / EC (General Data Protection Regulation) for the purpose and in connection with making publications available on the PRESSto scientific journals platform and DeGruyter platform, guaranteeing the security of services rendered, and improving them.
I HAVE READ AND AGREE FULLY WITH THE TERMS OF THIS AGREEMENT.
The Author The Publisher