The Theory of Narrative Selection

Sarah Perry is a contributing editor of Ribbonfarm.

Why do some stories become popular, retold for hundreds of years, while others are forgotten? Why do you see the particular stories that you see in your social media feed and on the news? How can we tell whether stories are true? And why are false stories so maddeningly popular?

Here I will look at stories as if they were biological organisms. Stories can’t reproduce themselves; they rely on humans for their survival and reproduction. In that sense, stories are symbiotic (or perhaps parasitic) in their relationship with humans. New stories are constantly being invented, using existing and novel devices and elements. They take as their subject matter factual happenings, imaginings, or both. They are transmitted and retold at different rates; most stories peter out and die, while a few sweep across the world in hours. They exhibit all the hallmarks for natural selection to act: variation, differential survival and reproduction, and heritability. Reproduction is complicated. Stories may transmit copies of themselves (reprintings, oral retellings), or they may transmit their traits to new generations of stories.

The following are a few of the mechanisms of narrative selection for all kinds of stories, from detective fiction to scientific papers.

Technological Progress

In “The Slaughterhouse of Literature,” Franco Moretti (2000) begins by wondering why Sherlock Holmes has been popular for a century, while Arthur Conan Doyle’s many contemporaries are all forgotten. Moretti examines the features of mystery stories published during the last decade of the nineteenth century, and makes a surprising discovery: most stories didn’t use clues at all. Some writers mentioned clues (“I wish we had a clue!”) but failed to actually introduce any. Of those that did use clues, many were not made visible to the reader, but rather were mentioned for the first time during the detective’s explanation of the solution. Of those that used visible clues, in most cases they had no relation to the solution. And of those who produced visible, relevant clues, including even Doyle, the clues were often not reasonably decodable by the reader. Each of these stages – clues, visibility, relevance, decodability – represents a technological innovation.

Doyle innovated the integration of clues into a coherent story, and as a result, his work is remembered while that of his contemporaries is forgotten. But it would not be until a generation later, with Agatha Christie, that the genre would take as a given the four-part structure.

I am reminded of a different story of cultural evolution: that of the development of the pintle-and-gudgeon rudder in the Mediterranean (Mott 1991). Side-mounted rudders (kind of like oars) were simple, flexible technology, and dominated the Mediterranean from the first century to the fourteenth. Rudders mounted to the stern with iron fittings (pintle-and-gudgeon) were innovated by northern shipbuilders, but not adopted in the Mediterranean (despite ample contact) for centuries. In order to offer any real advantage over the side-mounted rudder system, pintle-and-gudgeon rudders had to wait for vertical sternposts (and novel sails and rigging) to evolve. Only when all parts of the package were present did the new, high-tech solution become dominant.

Each trait, or feature, then, may not be adaptive on its own; only when all the pieces fit together does a technological advance go viral. As for rudders, so for clues. Moretti (2000) says,

Detective fiction, writes Todorov, is made of two separate stories (crime and investigation, past and present, fabula and sjuzhet), and these two stories “have no point in common.” Well, not quite: clues are precisely that point in common. An incredibly central position, where the past is suddenly in touch with the present; a hinge that joins the two halves together, turning the story into something more than the sum of its parts: a structure. And the tightening up starts a morphological virtuous circle that somehow improves every part of the story: if you are looking for clues, each sentence becomes “significant,” each character “interesting”; descriptions lose their inertia; all words become sharper, stranger.

p. 218, citation omitted.

Elements of Fit

In the academic study of narrative selection, a popular approach has been to identify individual elements that might explain the success of particular stories. One body of research concerns minimally counterintuitive entities and elements: narrative elements that are counterintuitive enough to be interesting and memorable, but not so counterintuitive as to lose coherence (for instance, a mouse that talks, but not a mouse that talks, is 500 feet high, and can control the weather). There was even a suggestion that the ideal story has between one and three counterintuitive elements (see, e.g., Stubbersfield et al., 2013).

Another element suspected to have adaptive benefits for stories is the elicitation of emotion. Heath et al. (2001) found that stories that evoked disgust were more likely to be shared, and the more disgusting, the better. Food contamination legends remain one of the most popular categories of legend – even more so if the horror is magnified by the incorporation of human body parts. Food contamination is extremely relevant to the survival interests of humans. But only a minority of stories evoke disgust.

Brewer et al. (1980) found that evoking the emotions of curiosity, suspense, and surprise were crucial to viewers enjoying stories, and perceiving them as stories. Evoking these emotions, however, is a function of the entire structure of the story, not an isolated element of a story. Stories must evoke suspense and then resolve it, or evoke curiosity and then surprise.

A story’s quality, memorability, and story-ness are more than the sum of its parts. Upal (2011) found that minimally counterintuitive elements only predicted the memorability of a story if those elements “contribute to the global cohesion of the overall story.” As with the pintle-and-gudgeon rudder, the fit between all the elements of a story, and not those separate elements themselves, underlies success and memorability. Upal says:

Comprehension researchers have identified global cohesion among the elements of a narrative as a key factor in making it memorable. Cohesion of a piece of text is defined as connections among the elements of the text. Cohesion is not just a function of the text itself but also of the background knowledge that the reader possesses. The connections that make a text more or less cohesive include co-references, as well as causal and logical connections among its elements. A text is better remembered if its constituents can be made coherent by the reader. Furthermore, the more effort a reader spends in making a text coherent, the more memorable the text….counterintuitive ideas are better remembered because they attract a reader’s attention by violating the reader’s expectations about what is to come next in the text. When a reader’s expectations are violated, he/she will attempt to resolve the situation by reasoning to justify the inclusion of expectation-violating information by invoking the relevant mental knowledge that the reader possesses. If this post-diction effort is successful, the expectation-violating concepts become richly linked to the reader’s existing mental representations, which were retrieved to explain the inconsistency to derive a coherent theme, and to the story theme itself.

p. 32, citations omitted.

The Gospel of Mark is the earliest of the Synoptic Gospels; it ends at the empty tomb of Jesus, in a state of suspense, with no resolution. The later gospels of Matthew and Luke add a resolution: Jesus returns to his disciples and explains things, and promises to return. The addition of a resolution may be a mutation that increases the fitness of the story in a rare way: by adding an element that ameliorates the fit between the story elements. The resolution is almost always incorporated into retellings of the Christ story, although of course Mark is preserved in the canon.

Surprise, Suspense, and Curiosity

Hoeken et al. (2000) suggest that three emotions are core to the success of a story: surprise, suspense, and curiosity. For Moretti (2000), curiosity is backwards-looking: the murdered corpse evokes curiosity as to what happened, and then this is resolved. Suspense is forward-looking: events that suggest danger occur, and then the suspense is resolved. Interestingly, the emotion of surprise can be elicited even if readers know how a story ends.

Surprise is crucial to Murray Davis’ (1971) taxonomy of philosophical interestingness. Davis lists twelve ways in which an argument can be considered interesting, each one a pair of opposites. Each of these is a different way of evoking surprise. For instance:

What seems to be a good phenomenon is really a bad phenomenon.
What seems to be a bad phenomenon is really a good phenomenon.

What seems to be a stable and unchanging phenomenon is really an unstable and changing phenomenon.
What seems to be a changing and unstable phenomenon is really a stable and unchanging phenomenon.

What seem to be assorted heterogeneous phenomena are in reality composed of a single element.
What seems to be a single phenomenon is in reality composed of assorted heterogeneous elements.

The underlying structure of interestingness is surprise: an assumption (what seems to be this) and a challenge (is actually that). A particularly popular type of story is the mythical myth: a story about what people once believed. Here, the surprise is backwards: we all know this, but once people believed that.

Stories about past myths might be particularly likely to be transmitted, even if false, because they provide surprise and novelty and at the same time credibility, a feeling of strengthening one’s memetic immune system even as one admits a false belief. Consider the iconic, simple story of the tulip bubble, a purported crazy belief of our gullible predecessors, and the more complex story that suggests that tulip buyers were not so irrational, and that it is perhaps wrong to say that there even was a bubble. The tulip bubble story is surprising, fits together well, and is easy to remember; Cochrane’s analysis is complex and requires us to incorporate concepts like futures contracts and the peculiarities of Dutch society. The tulip bubble may never have taken place, but the story of the tulip bubble seems to possess greater memetic fitness than the boring truth.

Ingroup and Outgroup

The emotions of surprise, curiosity, and suspense are important predictors of the success not only of fictional stories, but also of stories told as true. Television news to this day uses the suspense tactic of “teasing” a story before reporting on it (“Find out which product in your house could kill you!”). “Active shooters” and car chases in progress evoke suspense on the news as well as on Twitter. And there are thousands of more subtle ways of evoking curiosity than “one weird trick.”

I suspect that there is another important feature of narrative success: establishing the goodness of the ingroup and the badness of the outgroup. The same story may be told in different ways for different audiences, to emphasize this boundary. The category of legends known as “subversion myths” refers to myths that some outgroup is plotting against us, is responsible for our troubles, and possibly eats our babies in Satanic rituals. Today, the ingroups and outgroups evoked are primarily political. Friggeri et al. (2014) found that by far the most common category of rumor shared on Facebook was the political rumor. Stories are constantly being selected to have the “right” villain, the “right” victim, and the “right” structure of events to confirm and inflame the outgroup-hatred of any given ingroup.

False vs. True

Why are false stories so popular? Are false stories more popular than true stories?

Friggeri et al. (2014), studying rumor cascades on Facebook, found that while only 45% of the rumors covered on Snopes.com (the famous urban legend debunking site) are false, 62% of the rumors shared on Facebook were false. 26% of the stories on Snopes are labeled true, while only 9% of the rumors shared on facebook were true. False stories seem to enjoy an advantage at the outset.

Interestingly, however, the few true stories that were shared had longer “rumor cascades” of subsequent shares than false stories (an average of 163 shares per upload for true stories, vs. 108 for false stories). Unfortunately, being “Snoped” (a user commenting on the rumor with a link to Snopes) does not seem to hinder virality much; over half of the shares of false and mixed items occurred after the item was Snoped.

If the keys to success of a story are to evoke the emotions of curiosity, surprise, and suspense, as well as disgust or ingroup-outgroup hatred, and for its parts to fit together into a coherent structure to produce these emotions, then the truth is limited. A true story is heavily constrained: it must have a source in events in reality, and its elements may not change.

False stories, on the other hand, are unconstrained: they may change the order of elements, add and subtract elements, and invent entirely new elements. They may have some or no basis in fact. They may attach indications of credibility to themselves (using named entities, references to particular times and places, etc.) and claim trustworthy sources. The space of false stories is larger and more varied than the space of true stories. The best stories, then, are likely to be false – contrary to the maxim that truth is stranger than fiction.

In the criminological study of deception, one result is that impromptu lies (as from a suspect being questioned) lack details and do not form a coherent story. Ordinary truths have detail and form a coherent story, but usually do not produce much emotion or surprise. Carefully-crafted (or -evolved) lies, however, can provide a supernormal stimulus of truth: their parts are so well-selected and fit together so well that they produce emotion better than the truth.

If all the parts of a story work together perfectly, with nothing extraneous, and if the story produces strong emotion, we should be extra careful to check its veracity. The maxim “too good to be true” applies.

Horizontal and Vertical Transmission

In biological science, vertical transmission of a parasite (or symbiote) is transmission from one generation to the next, as from parent to child. Horizontal transmission is transmission between organisms of similar ages. When parasites evolve under vertical transmission, they tend to be gentler on their hosts: less contagious, and less virulent, even beneficial (Stewart et al., 2005). But when parasites evolve under horizontal transmission, they can be more virulent and contagious at the expense of their hosts, whose fitness is now not so relevant to the parasite’s survival.

Some stories and practices are transmitted vertically; these probably have the most fitness benefits, and the least cost. Horizontally transmitted stories and practices can afford to be more harmful to us.

Olivier (2015) suggests that children’s culture is horizontally transmitted: from child to child, rather than from parent to child. In my previous essay on children’s dares, I noted that dares exact a major fitness cost. Risky practices culturally transmitted between children may survive in spite of this cost specifically because they are horizontally transmitted.

Most stories in the age of mass media and the internet are horizontally transmitted. Few stories hurt us. But to the extent that stories can harm us, we would expect “viral” horizontally-transmitted stories to be more harmful than stories passed between generations.

Science and Narrative Selection

I have cited many scientific papers here. Most of them are probably false.

Smaldino et al. (2016), in “The Natural Selection of Bad Science,” analyzed 44 review papers describing published papers in the behavioral sciences over the past sixty years. They found that the statistical power of the studies to detect small effects averaged only about .24 – that is, if the researchers picked correct hypotheses 100% of the time, they should fail to get a positive result three out of four times. The problem of underpowered studies has long been noted in psychology, but Smaldino et al. found that the power of studies did not change over time: science got no better. (Of course, positive results remain much more common than 25%.)

The authors hypothesize that since positive results are so important for career success, science labs that produce positive results – even false ones – will be more successful than labs that are more rigorous and produce fewer positive results. In turn, bad (but successful) methods will be reproduced by the next “generation” of labs.

Science is not immune to narrative selection. Positive results are surprising and make a good story. Counterintuitive results are ideal. Replications are rare, and failed replications (and even revelation of actual fraud) often have little effect on a theory’s memetic success.

An Acquired Memetic Immune System?

How can we protect ourselves from false stories? How can we tell the difference between true and false stories?

Friggeri et al. (2014) examined the role of Snopes.com, a website dedicated to cataloging and establishing the truth or falsity of rumors and legends, in memetic immunity. It seems the effectiveness was limited. Shall we teach “critical thinking” and awareness of sources in order to immunize ourselves against falling for false stories?

An acquired immune system might not do much good in the presence of constantly-evolving antagonists. Hedrick (2004) suggested that invertebrates, which don’t have an acquired immune system but only an innate immune system, experience no more burden from disease than vertebrates. The acquired immune system of vertebrates has functioned like antibiotics, selecting new strains specifically adapted to undermine it – often using it against itself.

We do have something like an acquired memetic immune system. We are suspicious of certain kinds of stories and sources based on past experience; certain features trigger skepticism. But stories are constantly being adapted to get around our defenses. Those “mythical myths” mentioned above specifically hijack our memetic immune system, sneaking in false stories under the guise of feeling less gullible than people in the past.

The best we can do is to hold our beliefs lightly, realizing that it is difficult to tell truth from fiction. Preventing harm from beliefs is more important than preventing false beliefs as such. We should enjoy and study stories, and science, without expecting them to be true a majority of the time. Epistemic caution is important. But so is fun.


Works Cited

Brewer, William F., and Edward H. Lichtenstein (1980). “Event schemas, story schemas, and story grammars.” Center for the Study of Reading Technical Report; no. 197.

Davis, Murray S. (1971). “That’s interesting: Towards a phenomenology of sociology and a sociology of phenomenology.” Philosophy of the social sciences 1:4, 309.

Friggeri, Adrien, Lada A. Adamic, Dean Eckles, and Justin Cheng (2014). “Rumor Cascades.” ICWSM.

Heath, Chip, Chris Bell, and Emily Sternberg (2001). Emotional selection in memes: The case of urban legends. Journal of Personality and Social Psychology 81:6, 1028-1041.

Hedrick, Stephen M. (2004). “The acquired immune system: a vantage from beneath.” Immunity 21:5, 607-615. h/t to Adam Sandberg for finding this paper and suggesting that costly ritual is a memetic immune system.

Hoeken, Hans, and Mario van Vliet (2000). “Suspense, curiosity, and surprise: How discourse structure influences the affective and cognitive processing of a story.” Poetics 27:4, 277-286

Moretti, Franco (2000). The Slaughterhouse of Literature. Modern Language Quarterly 61:1, 207-227.

Morin, Olivier (2015). How Traditions Live and Die. Oxford University Press.

Mott, Lawrence V. (1991). The Development of the Rudder, A.D. 100-1600: A Technological Tale (Master’s Thesis).

Smaldino, Paul E., and Richard McElreath (2016). The Natural Selection of Bad Science. (Under review.) arXiv.

Stewart, Andrew D., John M. Logsdon, and Steven E. Kelley (2005). “An empirical study of the evolution of virulence under both horizontal and vertical transmission.” Evolution 59:4, 730-739.

Stubbersfield, Joseph, and, Jamshid Tehrani (2013). Expect the Unexpected? Testing for Minimally Counterintuitive (MCI) Bias in the Transmission of Contemporary Legends: A Computational Phylogenetic Approach. Social Science Computer Review 31: 90–102.

Upal, M. Afzal (2011). “Memory, Mystery and Coherence: Does the Presence of 23 Counterintuitive Concepts Predict Cultural Success of a Narrative?” Journal of Cognition and Culture 11:1, 23-48.

About Sarah Perry

Sarah Perry is a ribbonfarm contributing editor and the author of Every Cradle is a Grave. She also blogs at The View from Hell.
Her primary interests are in the area of ritual and social behavior. Follow her on Twitter

Comments

  1. Sarah

    Great great post – your best so far

    One area you didn’t tackle is WHY are untrue stories more viral – what facts are embellished and why do they take hold

    Watching the increasing partisan debates both sides of the Atlantic – it’s clear that tribes are forming now with their own “creation myths” that explain the world as it is today, reinforces their demons and offers simplistic solutions to the worlds ills

    Trying to create a counter culture around logic and reason I think unfortunately is doomed to fail . I think history has taught us that we need strong counter-demagogues to succeed. Who use the same tools but to different and more tolerant aims

    Given that is the way of the world- how do we embrace the stories and live within them- enhancing the narrative of our own lives, giving us conviction and confidence enabling us to achieve things that no one believed was possible ?

  2. The vertical vs horizontal transmission thing is interesting. However, some religious stories seem to me to be both among the most harmful (in terms of well-being) and most vertical stories we can entertain (prima facie contrary to hypothesis). I suppose the question to ask is how we measure “harmfulness”. Is it in terms of well-being? Genetic fitness? Something else?

    Thought provoking as always.

    • It’s difficult to answer without knowing what religious stories you have in mind.

      >most harmful

      I’m not especially confident in this; for vertical stories our unit of analysis is genetic fitness, not well-being. At an extreme, a religion could force people to torture themselves and each other 24/7 and artificially impregnate its female followers as often as physically possible and would actually outcompete everyone else, centribus paribus. Of course, this hasn’t happened because it’s utterly implausible and impractical, but it serves as an illustration: a (vertical) cultural construct relies on the reproduction of its adherents and its adherents not de-converting easily. Religion has both in spades.

      >most vertical

      Not sure about this. Religion frequently has individuals converting between them. Cults, for instance, seem to be a species of majorly horizontal religion.

  3. “A mouse that talks, is 500 feet high, and can control the weather”

    Depends on context right? God-mouse story…? ‘Normal’ is different for a fantastical story.

    Horizontal v vertical got me thinking, “Darwin Award, junior edition”

  4. I love the problem statement here. I’ll be thinking about “narrative selection” for months!

    I’m not sure I like the graph. I don’t see narrative truthiness as mutliple-valued, as would be implied by the function of truthiness vs. compellingness. For me at least, the truthier the narrative, the more compelling. This isn’t to say that a “truthier” narrative is also always more compelling. And “truthy” also doesn’t mean true. Unlike fiction, reality doesn’t have to be plausible. But plausibility does seem to determine, in part, how compelling whereas (as you’ve ably demonstrated) actual truth does not.

    So maybe you’ve got the axes reversed and by likelihood of truth you mean truthiness? I’m not sure you’d disagree with my impression of what you’re saying.

  5. Sarah,

    Have you heard of a book by Jesse Walker called The United States of Paranoia? It examines the role of conspiracy theories in US history. If I remember it correctly, the main point was that it didn’t matter if the conspiracy theory was true or not. The mere fact that it took hold and was believed provided information about the society of the time – the fears, biases, and beliefs. He also separates conspiracy theories into several different categories based on whether they’re inward or outward focused – fear of an enemy within(they’re among us) versus creating a common external enemy.

    “The best stories, then, are likely to be false – contrary to the maxim that truth is stranger than fiction.”

    When I read that part of your essay, I was thinking exactly the opposite. I’ve always read that maxim as implying that false stories would be better precisely because they are less strange. Truth(reality) is under no obligation to explain itself while fiction must make sense and be understood. Fiction may be more flexible, but must be coherent. Maybe this ties back into Venkat’s essay on being lost. Most people are uncomfortable when they can’t make sense of things. Fiction could give those uncomfortable people a lens to see the world that makes it digestible. The narrative fallacy is probably involved in there somewhere too, but I need to get back to work…

    Great essay! Really enjoyed the read!

    -James

  6. This explains how I feel about superhero cartoons. Even as a child I would watch Spider Man and be frustrated by the violations of everyday physics. Not the super-powers, those I’m OK with. It’s when he swings over the rooftops, I wanted to know what the webs were connected to.

    Or how Batman always had exactly the right gadget in his utility belt. Just how many things does he keep in there?

    I can suspend my disbelief for the core premise of a story, but tell me the guy from Philly doesn’t know what a cheesesteak is and I’m going to know it’s not true.

  7. Fantastic subject! Wow!! Thanks. That was thought provoking.

    One perspective I think you missed: I would be careful putting vertical and horizontal transmission storytelling on the same level of importance. I think vertical stories are higher in the heirarchy, and form the backbone of how we judge the truthfulness of the horizontal, sort of like a cultural DNA, and not a transmisable transgenerational virus. I would venture that we are born culturally through the vertical stories we are told: religious parables, family histories and especially nursery rhymes and fairy tales. These constitute the basis of our truth detection “education”.

    We learn over time that fairy tales are not “true” but there is indeed something in their essence that resonates and forms a metric of metaphorical truthfulness. I believe we constantly use this meterstick to evaluate “interesting” material that might hold some degree of truth or logic that could be actionable somehow in life.

    We eagerly transmit these vertical stories to our own children. A lot of what you are talking about is paralleled in studies of the transmission of fairy tales over the centuries and is just as fascinating. You only have to think back to the day you first doubted the veracity of Santa Claus to realize a great deal of tradition based family education is all about learning how to figure out the “truth” on your own.

    Fairy tales act sort of like koans, teaching us how to measure truth through the lense of human imagination and sheer cheekiness. This is like level one to what being a human being is on a cultural level. As for the family histories, doubt creeps in slowly from one family reunion to the next. Trying to figure out why Aunt Thelma really left Uncle Bob all those years back brings family reunions to the level of live action detective stories. As for religious parables and stories, often shrouded in ritual and authority when they are told, they are the hardest for our minds to challenge, and in some vertical transmission systems are not even questionable. But thank God for fairy tales. They are in my opinion our cases of jurisprudence for prosecuting what we read on the Internet.

    I wonder if when we are reading viral web stories, we are not hoping more to find a valid modern-day fairy tale rather than an absolute truth. It’s an excellent laboratory. New novel ideas require a good dose of imagination and improbable “truthfulness” before they take off as a new tale to inspire humanity.

    A final case in point are the Brother Grimm stories of which a couple of dozen are still “known” today, though at the time they transcribed hundreds. Why certain of those stories survive, and, just ask Disney, prosper is that they still resonate a certain truthfulness that both parents, and children find vital for coping with the complexities of the world of infinite true and false information. With the most recent Frozen, we see how the base routine is rebooting and giving women a more interesting and active role. I would argue that this has been happening for centuries on a cultural level, at a much slower and controlled rate than horizontal “gossip” that just blatantly disregards “truth”. Sensational stories are a natural phenomenon looking for resonance in today’s social psyche. It doesn’t matter if they are true… what we are looking for collectively is if they “could be” true. If they “could be” that’s even more important as a warning for society than whether they actually happened “yet” or not.

    Some books that I highly recommend on fairy tales and their evolution are from Marina Warner (From the Beast to the Blonde, No Go the Bogeyman) and Marie-Louise von Franz (The Feminine in Fairy Tales). There is a lot more out there.

    Thanks so much for helping me make a connection in my mind between detective stories and fairy tales. I’m forever grateful.

  8. David Stuart says:

    I think you might find Herbert Gans book “Deciding What’s News” of value to your research. I don’t see it cited. He sat in the news rooms of CBS, NBC and ABC to observe the process by which news was manufactured. Several of the categories you discuss relate directly to values that he hypothesizes determine the outcome of news decisions. I think you would find the work relavent.