Hallucinations in automated texts – A critical view on the emerging terminology

Authors

DOI:

https://doi.org/10.62408/ai-ling.v1i1.9

Keywords:

hallucination, metaphor, AI, NLG, language change

Abstract

The term hallucination is used in AI discourse to describe AI-generated outputs that are unfounded and lack backing in input data, a phenomenon which occurs frequently enough for the academic community to shun widespread collaboration with AI writing tools, particularly in certain disciplines. The issue of hallucinatory outputs will diminish as AI advances, but the appropriateness of using the terms hallucinate and hallucination in this context remains under debate. Originating from Latin, terms related to hallucination were once exclusively used within specialized medical terminology. Over time, and across languages, its metaphorical meaning has evolved, becoming part of colloquial language through the semantic innovation characteristic of youth language. We also show how this trend coincides with the use of metaphors such as anthrophomorphisms in scientific discourse. The newest addition to hallucination’s list of meanings – an established metaphor for a new phenomenon – is contentious. On the one hand, there is a similarity in that both AI-induced and medically induced hallucinations are elusive and difficult to identify. On the other hand, it suggests a trivialization of medical conditions that remain significantly stigmatized in contemporary societies.

References

Baker, Simon & Kanade, Takeo. 2000. Hallucinating faces. Proceedings Fourth IEEE International Conference 2000. 83–88. DOI 10.1109/AFGR.2000.840616

Banfi, Emanuele. 1992. Conoscenza e uso di lessico giovanile a Milano e a Trento. In Banfi, Emanuele & Sobrero, Alberto A. (eds), Il linguaggio giovanile degli anni novanta. 99–138. Milano: Laterza.

Brin, Dana & Sorin, Vera & Vaid, Akhil & Soroush, Ali & Glicksberg, Benjamin S. & Charney, Alexander W. & Nadkarni, Girish & Klang, Eyal. 2023. Comparing ChatGPT and GPT-4 performance in USMLE soft skill assessments. Scientific Reports 13(1). 16492. DOI 10.1038/s41598-023-43436-9.

Brown, Theodore L. 2003. Making Truth. Metaphor in Science. Urbana (IL): University of Illinois Press.

Burkhardt, Armin. 1987. Wie die ‘wahre Welt’ endlich zur Metapher wurde. Zur Konstitution, Leistung und Typologie der Metapher. Conceptus: Zeitschrift für Philosophie 21(52). 39–67.

CDE = 2024. Cambridge Dictionary. Cambridge: Cambridge University Press, online (https://dictionary.cambridge.org/dictionary/english) (accessed 2024-05-10)

Cambridge Dictionary Team. 2023. The Cambridge Dictionary Word of the Year 2023 is … Cambridge: Cambridge University Press, online. (https://dictionary.cambridge.org/editorial/woty) (accessed 2024-05-10)

Chen, Canyu, & Shu, Kai 2023. Combating Misinformation in the Age of LLMs: Opportunities and Challenges. arXiv. http://arxiv.org/abs/2311.05656.

DELI = Cortelazzo, Manlio & Zolli, Paolo. 2002. Il nuovo etimologico: Dizionario etimologico della lingua italiana. Bologna: Zanichelli.

DLG = Manzoni, Gian R. & Dal Monte, Emilio. 1980. Pesta duro e vai tránquilo: dizionario del linguaggio giovanile. Milano: Feltrinelli Economica.

DRAE = Real Academia Española (ed.). 2001. Diccionario de la lengua española. 22nd edn. Madrid: RAE. (https://dle.rae.es) (accessed 2024-05-10)

DWDS = 2024. Digitales Wörterbuch der Deutschen Sprache. Berlin: Berlin-Brandenburgische Akademie der Wissenschaften, online. https://www.dwds.de (accessed 2024-05-10).

Emsley, Robin. 2023. ChatGPT: these are not hallucinations – they’re fabrications and falsifications. Schizophrenia (Heidelberg, Germany) 9(1). 52. DOI 10.1038/s41537-023-00379-4

Filippova, Katja. 2020. Controlled Hallucinations: Learning to Generate Faithfully from Noisy Data. Findings of the Association for Computational Linguistics: EMNLP 2020. 864–870. DOI 10.18653/v1/2020.findings-emnlp.76

GDLI = Battaglia, Salvatore & Ronco, Giovanni. 1973. Grande dizionario della lingua italiana. Torino: UTET.

Heinemann, Margot. 1990. Kleines Wörterbuch der Jugendsprache, 2nd ed. Leipzig: VEB Bibliographisches Institut.

Ickler, Theodor. 1993. Zur Funktion der Metapher, besonders in Fachtexten. Fachsprache 15 (3-4). 94–110.

Ji, Ziwei & Lee, Nayeon & Frieske, Rita & Yu, Tiezheng & Su, Dan & Xu, Yan & Ishii, Etsuko & Bang, Ye Jin & Madotto, Andrea & Fung, Pascale. 2023. Survey of Hallucination in Natural Language Generation. ACM Computing Surveys 55(12). 1–38. DOI 10.1145/3571730

Marcato, Carla. 1997. In para totale…una cosa da panico…: sulla lingua dei giovani in Italia. Italica 74 (4). 560. DOI 10.2307/479484

Maynez, Joshua & Narayan, Shashi & Bohnet, Bernd & McDonald, Ryan. 2020. On faithfulness and factuality in abstractive summarization. arXiv. DOI 10.48550/arXiv.2005.0061

McGowan, Alessia & Gui, Yunlai & Dobbs, Matthew & Shuster, Sophia & Cotter, Matthew & Selloni, Alexandria & Goodman, Marianne & Srivastava, Agrima & Cecchi, Guillermo A. & Corcoran, Cheryl M. 2023. ChatGPT and Bard exhibit spontaneous citation fabrication during psychiatry literature search. Psychiatry research 326. 115334. DOI 10.1016/j.psychres.2023.115334

Merriam-Webster = 2024. Merriam-Webster.com Dictionary. Springfield (MA): Merriam Webster. https://www.merriam-webster.com/dictionary (accessed 2024-05-10)

Müller-Thurau, Claus P. & Marcks, Marie. 1985. Lexikon der Jugendsprache. Düsseldorf: Econ.

Neuland, Eva. 1998. Zum Sprachgebrauch Jugendlicher verschiedener regionaler Herkunft. In Androutsopoulos, Jannis K. & Scholz, Arno (eds). Jugendsprache = Langue des jeunes = youth language: linguistische und soziolinguistische Perspektiven. 71–90. Frankfurt am Main, New York: Lang.

Neuland, Eva. 2018. Jugendsprache: Eine Einführung. Tübingen: Francke.

OED = 2024. Oxford English Dictionary: The historical English dictionary. Oxford: Oxford University Press online. DOI 10.1093/OED/5271413239

Østergaard, Søren Dinesen & Nielbo, Kristoffer Laigaard. 2023. False responses from Artificial Intelligence models are not hallucinations. Schizophrenia bulletin 49 (5). 1105–1107. DOI 10.1093/schbul/sbad068

PRob = Dictionnaires Le Robert. 2023. Le Petit Robert - Version numérique (version 5.8, mai 2023). Paris: Dictionnaires Le Robert; SEJER. https://www.lerobert.com (accessed 2024-05-10)

Pschyrembel = Pschyrembel Redaktion (ed.). 2004–2024. Pschyrembel online (Version 05.2021). Berlin: de Gruyter.

Radtke, Edgar. 1998. Ein italienisches Jugendsprachewörterbuch der Mikrodiachronie: Der ‘Dizionario della Lingua Parlata dei Giovani 1982–1992’ (DLPG). In Androutsopoulos, Jannis K. & Scholz, Arno (eds). Jugendsprache = Langue des jeunes = youth language: linguistische und soziolinguistische Perspektiven. 59–70. Frankfurt am Main, New York: Lang.

Salvagno, Michele & Taccone, Fabio Silvio & Gerli, Alberto Giovanni. 2023. Artificial intelligence hallucinations. Critical care (London, England) 27 (1). DOI 10.1186/s13054-023-04473-y

Seux, Bernard. 1997. Une parlure argotique de collégiens. Langue française 114, 82–103.

SG = Ambrogio, Renzo & Giovanni Casalegno. 2004. Scrostati gaggio! Dizionario storico dei linguaggi giovanili. Torino: UTET.

Sourdot, Marc. 1997. La dynamique du français des jeunes : sept ans de mouvement à travers deux enquêtes (1987–1994). Langue française 114. 56–81. DOI 10.3406/lfr.1997.5385

TLFi = Centre National de la Recherche Scientifique (CNRS), Analyse et traitement informatique de la langue française (ATILF-CNRS) & Université de Nancy 2. 2002. Trésor de la langue française informatisée. Nancy: ATILF http://stella.atilf.fr

TLL = Bayerische Akademie der Wissenschaften. [2024]. Thesaurus Linguae Latinae. München: BAW. https://tll.degruyter.com/ (accessed 2024-05-10)

Treccani Vocabolario = 2024. Il Vocabolario Treccani. Roma: Istituto della Enciclopedia Italiana. https://www.treccani.it/vocabolario (accessed 2023-11-15).

Ureña Gómez-Moreno, José Manuel. 2016. Refining the understanding of novel metaphor in specialised language discourse. Terminology. International Journal of Theoretical and Applied Issues in Specialized Communication 22(1). 1–29. DOI 10.1075/term.22.1.01ure

Westerman, David & Cross, Aaron C. & Lindmark, Peter G. 2019. I Believe in a Thing Called Bot: Perceptions of the Humanness of “Chatbots”. Communication Studies 70(3). 295–312. DOI 10.1080/10510974.2018.1557233

Zingarelli = Zingarelli, Nicola. 2024. Lo Zingarelli on-line: vocabolario della lingua italiana. Bologna: Zanichelli, https://dizionari.zanichelli.it

Published

2024-07-07

How to Cite

Gerstenberg, A. (2024). Hallucinations in automated texts – A critical view on the emerging terminology. AI-Linguistica. Linguistic Studies on AI-Generated Texts and Discourses, 1(1). https://doi.org/10.62408/ai-ling.v1i1.9

Issue

Section

Short-Length Article