Anthology of Computers and the Humanities · Volume 3

Estranged Predictions: Measuring Semantic Category Disruption with Masked Language Modelling

Yuxuan Liu1 ORCID , Haim Dubossarsky2 ORCID and Ruth Ahnert1 ORCID

  • 1 School of Arts, Queen Mary University of London, London, United Kingdom
  • 2 School of Electronic Engineering and Computer Science, Queen Mary University of London, London, United Kingdom

Permanent Link: https://doi.org/10.63744/GUArdaU1Y92u

Published: 21 November 2025

Keywords: masked language model, science fiction, distant reading, conceptual permeability

Abstract

This paper examines how science fiction destabilises ontological categories by measuring conceptual permeability across the terms human, animal, and machine using masked language modelling (MLM). Drawing on corpora of science fiction (Gollancz SF Masterworks) and general fiction (NovelTM), we operationalise Darko Suvin’s theory of estrangement as computationally measurable deviation in token prediction, using RoBERTa to generate lexical substitutes for masked referents and classifying them via Gemini. We quantify conceptual slippage through three metrics: retention rate, replacement rate, and entropy, mapping the stability or disruption of category boundaries across genres. Our findings reveal that science fiction exhibits heightened conceptual permeability, particularly around machine referents, which show significant cross-category substitution and dispersion. Human terms, by contrast, maintain semantic coherence and often anchor substitutional hierarchies. These patterns suggest a genre-specific restructuring within anthropocentric logics. We argue that estrangement in science fiction operates as a controlled perturbation of semantic norms, detectable through probabilistic modelling, and that MLMs, when used critically, serve as interpretive instruments capable of surfacing genre-conditioned ontological assumptions. This study contributes to the methodological repertoire of computational literary studies and offers new insights into the linguistic infrastructure of science fiction.