| Title: |
Say the Same but Differently: Computational Approaches to Stylistic Variation and Paraphrasing |
| Authors: |
Wegmann, Anna Maria; Afd Intelligent Software Systems; van Deemter, Kees; Nguyen, Dong |
| Publisher Information: |
Universiteit Utrecht |
| Publication Year: |
2025 |
| Subject Terms: |
taalvariatie; parafrases in dialogen; taalkundige stijl; natuurlijke taalverwerking; stijlinbedding; tokenizer; evaluatie; natural language processing; language variation; paraphrases in dialog; linguistic style; style embedding; evaluation |
| Description: |
Consider two Dutch sentences "Ik ben een Utrechter" and "Ik ben een Utrechtenaar". Even thought their surface level presentation is different, a translation tool like DeepL might translate both of these sentences to "I am an Utrecht resident". This translation is perfectly reasonable as both "Utrechter" and "Utrechtenaar" refer to an inhabitant of the city of Utrecht. In this case, DeepL can be said to be robust to language variation: it treats both statements equally. However, there are also many cases in which NLP models benefit from being sensitive to language variation. The Utrecht example illustrates this: Historically, "Utrechtenaar" was the more common term. However, it has now been largely replaced by "Utrechter" in everyday language, as "Utrechtenaar" has been associated with gay men since the Utrecht sodomy trials (around 1730). Today, when someone uses "Utrechtenaar" over "Utrechter" to refer to themselves, we might know more about them–for example, that they are more likely part of the local queer community. Let's imagine a newspaper article in which two people refer to themselves as "Utrechter" and "Utrechtenaar": translating both terms as "resident of Utrecht" could obscure subtle differences in background and social identity—potentially leading to confusion or a loss of narrative nuance. In this dissertation, I develop methods to make language models both more sensitive and more robust to language variation. In Chapter 3, I examine tokenizers–a fundamental building block of language models–with respect to their sensitivity and robustness to language variation. I show that it is important to take language variation into account at all stages of language model development. In Chapters 4 and 5, I develop vector representations that are sensitive to one particular aspect of language variation: the style of a text. In Chapter 4, I propose the STyle Evaluation Framework (STEL), the first systematic method for evaluating how sensitive NLP methods are to stylistic variation in text. In Chapter 5, I train ... |
| Document Type: |
doctoral or postdoctoral thesis |
| File Description: |
application/pdf |
| Language: |
English |
| Relation: |
https://dspace.library.uu.nl/handle/1874/462903 |
| Availability: |
https://dspace.library.uu.nl/handle/1874/462903 |
| Rights: |
info:eu-repo/semantics/EmbargoedAccess |
| Accession Number: |
edsbas.8AD83B7C |
| Database: |
BASE |