Abstract
Artificial Intelligence (AI) applied in the legal field has gained considerable ground in the recent years and is used in many fields, amongst which the legal one is of no exception. This paper wishes to explore the quality of the translation (from English into Italian) of an arbitration clause performed by the ChatGPT chatbot. To do so, the automatically generated target text is post-edited by consulting the BoLC (Bononia Legal Corpus) and the web as corpus in the gov.it Italian governmental domain. General and legal dictionaries are also used. The paper findings report some inaccuracies at word level which are easily tackled by corpus consultation. In view of the results obtained, however, complete reliance upon AI-driven solutions is not recommendable at the time being. Conversely, the use of ad hoc corpora and of targeted web searches are the most feasible and reliable solutions, although time-consuming.
References
Abate, Salvatore C. 1998. Il documento legale anglosassone. Milan: Hoepli.
Berezowski, Łukasz J. 2021. Translating Latin legalese: between dynamic equivalence and formal correspondence. A comparative study case of Latin legal terms and maxims in English, Italian and Polish language. In: Traduttologia e Traduzioni Vol II, ed. Joanna Ciesielka, 35–51. http://hdl.handle.net/11089/39976 (accessed May 14, 2024). DOI: https://doi.org/10.18778/8220-676-0.04
Bhatia, Vijay K. 2010. Textbook on Legal Language and Legal Writing. New Delhi: Universal Law Publishing Co.
Brooks, Chay, Cristian Gherhes, and Tim Vorley. 2020. Artificial intelligence in the legal sector: Pressures and challenges of transformation. Cambridge Journal of Regions, Economy and Society, 13(1): 135–152. DOI: https://doi.org/10.1093/cjres/rsz026
Chalkidis, Ilias, Manos Fergadiotis, and Ion Androutsopoulos. 2021. MultiEURLEX – A Multi-lingual and Multi-label Legal Document Classification Dataset for Zero-shot Cross-lingual Transfer. Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2021), on-line and Punta Cana, Dominical Republic. https://aclanthology.org/2021.emnlp-main.559 (accessed May 14, 2024). DOI: https://doi.org/10.18653/v1/2021.emnlp-main.559
Coulthard, Malcolm, and Alison Johnson. 2007. An Introduction to Forensic Linguistics. Language in Evidence. London/New York: Routledge.
Emsley, Robin. 2023. ChatGPT: these are not hallucinations – they’re fabrications and falsifications. Schizophrenia, 9(52): 1–2. DOI: https://doi.org/10.1038/s41537-023-00379-4
Giampieri, Patrizia. 2023a. Is machine translation reliable in the legal field? A corpus-based critical comparative analysis for teaching ESP at tertiary level. ESP Today, 11(1): 119–137. DOI: https://doi.org/10.18485/esptoday.2023.11.1.6
Giampieri, Patrizia. 2023b. Legal Machine Translation Explained: MT in legal contexts. Newcastle Upon Tyne: Cambridge Scholars Publishing.
Giampieri, Patrizia. 2024. The Use of Comparable Corpora on (General) Terms and Conditions as a Pedagogical Tool in Translation Training between English and Italian. PhD dissertation. University of Malta. https://www.um.edu.mt/library/oar/handle/123456789/119427 (accessed May 14, 2024).
Gigi, Gisa M., Rajesh, Nikhitha, Sania, Ann, Mohan, Theresa, and Thekkanath Biju A. 2023. AI Contract: Future and Scope in Legal System. International Journal of Advance and Applied Research, 10(6): 237–240.
Guerreiro, Nuno M., Elena Voita, and André F.T.Martins. 2023. Looking for a needle in a haystack: A comprehensive study of hallucinations in neural machine translation. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, May 2023. (accessed May 14, 2024). DOI: https://doi.org/10.18653/v1/2023.eacl-main.75
Jacometti, Valentina, and Barbara Pozzo. 2018. Traduttologia e linguaggio giuridico. Milan: Wolters Kluwer.
Koehn, Philip. 2005. Europarl: A Parallel Corpus for Statistical Machine Translation. In: The Tenth Machine Translation Summit Proceedings of Conference, ed. John Hutchins, 79–86. International Association for Machine Translation. https://www.pure.ed.ac.uk/ws/portalfiles/portal/26315407/MTS_2005_Koehn.pdf (accessed May 14, 2024).
Ljubešić, Nikola, and Tomaž Erjavec. 2018. JRC EU DGT Translation Memory Parsebank DGT-UD 1.0. Slovenian language resource repository CLARIN.SI. http://hdl.handle.net/11356/1197 (accessed May 14, 2024).
McCarthy, John, Minsky, Martin, Shannon, Claude E., and Rochester, Nathanielì. 1955. “A proposal for the Dartmouth summer research project on artificial intelligence”. AI Magazine, 27(4): 12.
Moneus, Mohammed A. and Yousef Sahari. 2024. Artificial intelligence and human translation: A contrastive study based on legal texts. Heliyon, 10(6): 1–14. DOI: https://doi.org/10.1016/j.heliyon.2024.e28106
Nunes Vieira, Lucas, O’Hagan, Minako, and O’Sullivan, Carol. 2021. Understanding the societal impacts of machine translation: a critical review of the literature on medical and legal use cases. Information, Communication & Society, 24(11): 1515–1532. DOI: https://doi.org/10.1080/1369118X.2020.1776370
Pontrandolfo, Gianluca. 2019. Corpus methods in legal translation studies. In: Research methods in legal translation and interpreting, eds. Łucja Biel, Jan Engberg, Rosario Martín Ruano, and Vilelmini Sosoni, 13–28. London: Routledge. DOI: https://doi.org/10.4324/9781351031226-2
Rizzo, Camino Rea, and Maria J.M. Pérez. 2012. Structure and design of the British Law Report Corpus (BLRC): a legal corpus of judicial decisions from the UK. Journal of English Studies, 10: 131–145. DOI: https://doi.org/10.18172/jes.184
Rossini, Favretti, Rema, Fabio Tamburini, and Edoardo Martelli. 2007. Words from Bononia Legal Corpus. In: Text Corpora and Multilingual Lexicography, ed. Wolfgang Tuebert, 11–30. Amsterdam: John Benjamins. DOI: https://doi.org/10.1075/bct.8.03ros
Steinberger, Ralf, Bruno Pouliquen, Anna Widiger, Camelia Ignat, Tomaž Erjavec, Dan Tufis, and Dániel Varga. 2006. The JRC-Acquis: A multilingual aligned parallel corpus with 20+ languages. Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC'2006). Genoa, Italy, 24–26 May 2006. http://www.lrec-conf.org/proceedings/lrec2006/pdf/340_pdf.pdf (accessed May 14, 2024).
Thomson Reuters Institute. 2023a. ChatGPT and Generative AI within Law Firms. https://www.thomsonreuters.com/en-us/posts/wp-content/uploads/sites/20/2023/04/2023-Chat-GPT-Generative-AI-in-Law-Firms.pdf (accessed May 14, 2024).
Thomson Reuters Institute. 2023b. Stepping into the future: How generative AI will help lawyers improve legal service delivery. https://legal.thomsonreuters.com/content/dam/ewp-m/documents/legal/en/pdf/reports/lawyers-harnessing-power-of-ai.pdf (accessed May 14, 2024).
Tiedemann, Jörg. 2012. Parallel Data, Tools and Interfaces in OPUS. Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC’2012), European Language Resources Association, Istanbul, 2214–2218. http://www.lrec-conf.org/proceedings/lrec2012/pdf/463_Paper.pdf (accessed May 14, 2024).
Tiersma, Peter. 1999. Legal language. Chicago, IL: The University of Chicago Press.
Tiersma, Peter and Lawrence M. Solan. 2012. The Oxford Handbook of Language and Law. New York: Oxford University Press.
Vigier Moreno, Francisco. J. 2016. Teaching the Use of ad hoc Corpora. Language and Law / Linguagem e Direito, 3(1): 100–119. https://ojs.letras.up.pt/index.php/LLLD/article/view/1658 (accessed May 14, 2024).
Vigier Moreno, Francisco J., and María d. M. Sánchez Ramos. 2017. Using Parallel Corpora to Study the Translation of Legal System-Bound Terms: The Case of Names of English and Spanish Courts. In: Computational and Corpus-Based Phraseology EUROPHRAS 2017, Lecture Notes in Computer Science, ed. Ruslan Mitkov, 206–273. Cham: Springer. DOI: https://doi.org/10.1007/978-3-319-69805-2_19
Williams, Christopher. 2023. The Impact of Plain Language on Legal English in the United Kingdom. London/New York: Routledge. DOI: https://doi.org/10.4324/9781003025009
ChatGPT: https://chat.openai.com (accessed May 14, 2024).
Hoepli dictionary: https://www.dizionari.repubblica.it (accessed May 14, 2024).
Garner, Bryan A. 2004. Black’s Law Dictionary. Eighth edition. Eagan: Thomson West.
License
Copyright (c) 2024 Patrizia Giampieri
This work is licensed under a Creative Commons Attribution 4.0 International License.
When submitting a paper the author agrees to the following publishing agreement and processing personal data.
PUBLICATION AGREEMENT, COPYRIGHT LICENSE, PERSONAL DATA PROCESSING CONSENT
This is a publication agreement and copyright license (“Agreement”) regarding a written manuscript currently submitted via Pressto platform
(“Article”) to be published in Comparative Legilinguistics International Journal for Legal Communication (“Journal”).
The parties to this Agreement are:
the Author or Authors of the submitted article (individually, or if more than one author, collectively, “Author”) and Comparative Legilinguistics International Journal for Legal Communication (“Publisher”), address al. Niepodległości 4, 61-874 Poznań, represented by its editor in chief Aleksandra Matulewska.
§1. LICENSE OF COPYRIGHT
a) The Author and the Publisher agree that the Author grants a Creative Commons Attribution 4.0 International License, which is incorporated herein by reference and is further specified at Creative Commons — Attribution 4.0 International — CC BY 4.0 copyright license in the Article to the general public.
b) The Author grants to the Publisher a royalty-free, worldwide nonexclusive license to publish, reproduce, display, distribute, translate and use the Article in any form, either separately or as part of a collective work, including but not limited to a nonexclusive license to publish the Article in an issue of the Journal, copy and distribute individual reprints of the Article, authorize reproduction of the entire Article in another publication, and authorize reproduction and distribution of the Article or an abstract thereof by means of computerized retrieval systems (such as Westlaw, Lexis and SSRN). The Author retains ownership of all rights under copyright in the Article, and all rights not expressly granted in this Agreement.
c) The Author grants to the Publisher the power to assign, sublicense or otherwise transfer any and all licenses expressly granted to the Publisher under this Agreement.
d) Republication. The Author agrees to require that the Publisher be given credit as the original publisher in any republication of the Article authorized by the Author. If the Publisher authorizes any other party to republish the Article under the terms of paragraphs 1c and 1 of this Agreement, the Publisher shall require such party to ensure that the Author is credited as the Author.
§2. EDITING OF THE ARTICLE
a) The Author agrees that the Publisher may edit the Article as suitable for publication in the Journal. To the extent that the Publisher’s edits amount to copyrightable works of authorship, the Publisher hereby assigns all right, title, and interest in such edits to the Author.
§3. WARRANTIES
a) The Author represents and warrants that to the best of the Author’s knowledge the Article does not defame any person, does not invade the privacy of any person, and does not in any other manner infringe upon the rights of any person. The Author agrees to indemnify and hold harmless the Publisher against all such claims.
b) The Author represents and warrants that the Author has full power and authority to enter into this Agreement and to grant the licenses granted in this Agreement.
c) The Author represents and warrants that the Article furnished to the Publisher has not been published previously. For purposes of this paragraph, making a copy of the Article accessible over the Internet, including, but not limited to, posting the Article to a database accessible over the Internet, does not constitute prior publication so long as the as such copy indicates that the Article is not in final form, such as by designating such copy to be a “draft,” a “working paper,” or “work-in-progress”. The Author agrees to hold harmless the Publisher, its licensees and distributees, from any claim, action, or proceeding alleging facts that constitute a breach of any warranty enumerated in this paragraph.
§4. TERM
a) The agreement was concluded for an unspecified time.
§5. PAYMENT
a) The Author agrees and acknowledges that the Author will receive no payment from the Publisher for use of the Article or the licenses granted in this Agreement.
b) The Publisher agrees and acknowledges that the Publisher will not receive any payment from the Author for publication by the Publisher.
§6. ENTIRE AGREEMENT
a) This Agreement supersedes any and all other agreements, either oral or in writing, between the Author and the Publisher with respect to the subject of this Agreement. This Agreement contains all of the warranties and agreements between the parties with respect to the Article, and each party acknowledges that no representations, inducements, promises, or agreements have been made by or on behalf of any party except those warranties and agreements embodied in this Agreement.
b) In all cases not regulated by this Agreement, legal provisions of Polish Copyright Act and Polish Civil Code shall apply.
c) Any disputes arising from the enforcement of obligations connected with this Agreement shall be resolved by a court competent for the headquarters of the Publisher.
d) Any amendments or additions to the Agreement must be made in writing and signed by authorised representative of both parties, otherwise being ineffective.
e) This Agreement is signed electronically and the submission of the article via the PRESSto platform is considered as the conclusion of the Agreement by the Author and the Publisher.
f) Clause for consent to the processing of personal data - general
g) The Author shall give his or her consent to the processing of their personal data in accordance with the Act of 10 May 2018 on the protection of personal data and Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of persons physical in connection with the processing of personal data and on the free movement of such data, and repealing Directive 95/46 / EC (General Data Protection Regulation) for the purpose and in connection with making publications available on the PRESSto scientific journals platform and DeGruyter platform, guaranteeing the security of services rendered, and improving them.
I HAVE READ AND AGREE FULLY WITH THE TERMS OF THIS AGREEMENT.
The Author The Publisher