On attunement
(This essay is part of a series that I’m calling “Otherness and control in the age of AGI.” I’m hoping that the individual essay can be read fairly well on their own, but see here for brief summaries of all the essays, and here for a PDF of the full series.)
You, moon, You, Aleksander, fire of cedar logs.
Czeslaw Milosz, “Winter“
Waters close over us, a name lasts but an instant.
Not important whether the generations hold us in memory.
Great was that chase with the hounds for the unattainable meaning of the world.
My last essay examined a philosophical vibe that I (following others) call “green.” Green is one of the five colors on the Magic the Gathering Color Wheel, which I’ve found (despite not playing Magic myself) an interesting way of classifying the sort of the energies that tend to animate people.1 The colors, and their corresponding shticks-according-to-Joe, are:
- White: Morality.
- Blue: Knowledge.
- Black: Power.
- Red: Passion.
- Green: …
I haven’t found a single word that I think captures green. Associations include: environmentalism, tradition, family, spirituality, hippies, stereotypes of Native Americans, Yoda, humility, wholesomeness, health, and yin. My last essay tried to bring the vibe that underlies these associations into clearer view, and to point at some ways that attempts by other colors to reconstruct green can miss parts of it. In particular, I focused on the way green cares about respect, in a sense that goes beyond “not trampling on the rights/interests of moral patients” (what I called “green-according-to-white”); and on the way green takes joy in (certain kinds of) yin, in a sense that contrasts with merely “accepting things you’re too weak to change” (what I called “green-according-to-black”).
In this essay, I want to turn to what is perhaps the most common and most compelling-to-me attempt by another color to reconstruct green—namely, “green-according-to-blue.” On this story, green is about making sure that you don’t act out of inadequate knowledge. Thus, for example: maybe you’re upset about wild animal suffering. But green cautions you: if you try to remake that ecosystem to improve the lives of wild animals, you are at serious risk of not knowing-what-you’re-doing. And see, also, the discourse about “Chesterton’s fence,” which attempts to justify deference towards tradition and the status quo via the sort of knowledge they might embody.
I think humility in the face of the limits of our knowledge is, indeed, a big part of what’s going on with green. But I think green cares about having certain kinds of knowledge too. But I think that the type of knowledge green cares about most isn’t quite the same as the sort of knowledge most paradigmatically associated with blue. Let me say more about what I mean.
How do you know what matters?
I went out to see what I could see…
Annie Dillard, “Pilgrim at Tinker Creek”
Blue, to me, most directly connotes knowledge in the sense of: science, “rationality,” and making accurate predictions about the world. And there is a grand tradition of contrasting this sort of knowledge with various other types that seem less “heady” and “cognitive”—even without a clear sense of what exactly the contrast consists in. People talk, for example, about intuition; about system 1; about knowledge that lives in your gut and your body; about knowing “how” to do things (e.g. ride a bike); about more paradigmatically social/emotional forms of intelligence, and so on.
And here, of course, the rationalists protest at the idea that rationality does not encompass such virtues (see, e.g., the discourse about “Straw Vulcans“). Indeed, if we understand “rationality” as a combination of “making accurate predictions” (e.g. “epistemic” rationality; cf blue) and “achieving your goals” (e.g., “instrumental” rationality; cf black), then an extremely broad variety of failures—e.g., social/emotional clumsiness, indecision, over-thinking, disconnection from your intuition, falling-off-your-bike—can count as failures of rationality. With blue and black accounted for, then, is anything left over?
Well, yes—especially if we’re thinking of rationality as Yudkowsky does, in the context of the sort of meta-ethical anti-realism I discussed in “Deep atheism and AI risk.” In particular: I’ve written, previously, about the sense in which anti-realist rationality stumbles in the realm of ethics and value.
“Give anti-realist rationality a goal, and it will roar into life. Ask it what goals to pursue, and it gets confused. ‘Whatever goal would promote your goals to pursue?’ No, no, that’s not it at all.”
Or put another way: anti-realist rationality has a very rich concept of “instrumental rationality,” but a very impoverished concept of what we might call “terminal rationality”—that is, of how to do the “what matters intrinsically?” thing right. It tells you, at least, to not fail on the blue-and-black thing—to not form terminal goals based on a mistaken or incomplete picture of the world, or of what-will-lead-to-what. But beyond that, it goes silent.
Where, then, do your terminal goals come from? Well, for the most standard form of anti-realist rationality, from red. That is, from your heart, your desire, your passion—Hume’s famous slavemaster. That is, for all its associations with blue (and to a lesser extent, black), rationality (according to Yudkowsky) is actually, ultimately, a project of red. The explanatory structure is really: red (that is, your desires), therefore black (that is, realizing your desires), therefore blue (knowledge being useful for this purpose; knowledge as a form of power). Blue is twice secondary—a tool for black, which is itself a tool for red. (Of course, red can also value blue for its own sake—and perhaps this ultimately a better diagnosis of what’s going on with many rationalists. But from a philosophical perspective, intrinsically valuing knowledge is much more contingent.)
Indeed, in this sense, it’s not just green that anti-realist rationality struggles to capture. It’s also white—that is, morality. Anti-realist rationality has a concept of cooperation, in the sense of “getting-to-the-Pareto-frontier,” “making trade agreements,” and so on (with various fancy decision theories potentially playing a role in the process). But as I’ve written about previously, this sort of cooperation is too much a project of power to really capture morality—and in particular, it’s much too willing to kill, lie, defect, etc in interactions with weaker, dumber, and/or unloved-by-the-powerful agents (this is core to why Yudkowsky doesn’t expect the AIs, for all their black-and-blue, to be nice to humans).2
And beyond this type of cooperation, what sort of white is left for anti-realist rationality? Just: whatever sort of white you happen to be red about. That is: morality is just one possible thing-your-heart-could-care-about, among many others. It’s another brand of paperclips. Should we have a color for paperclips as well? And for staples? And for staples-of-a-slightly-different-shape? And morality, too, comes in many different shapes. Which morality do we mean?
Indeed, for all the social connections between the Yudkowskian rationalists and the effective altruists, the philosophical connection, here, starts to break down. Effective altruism, as a philosophical project, tends to assume that there is this thing, “goodness,” which EAs try to maximize; or this thing, “altruism,” which EAs try to do effectively.3 But Yudkowskian rationalism doesn’t, actually, have a privileged concept of “goodness,” or of “altruism” (see my essay “In search of benevolence” for more on this). Rather, there are a zillion concepts in the broad vicinity, which different hearts can latch onto differently—and it’s not clear what distinguishes them, deeply, from other sorts of goals or hobbies.
No wonder, then, that many of the philosophical founders of effective altruism (e.g. Singer, Parfit, Ord, MacAskill) tend towards moral realism. Effective Altruism is a lot about Morality with a capital M. Maybe it presents itself, in various contexts, as just-another-hobby. And sure, hobbyists are welcome. But various strands of philosophical EA want, underneath, to act with the righteousness of a True Church—to be doing, you know, the Good Thing, the Right Thing; and to be doing it the best way; the way you, like, should. Maybe you’re not obligated to do this (rather, it’s “supererogatory.”) And sure, you’re too weak to do it fully. But God smiles brighter as you do it more.
And this self-conception fits uncomfortably with treating white as ultimately grounded in red; morality as ultimately grounded in passion or sentiment. White wants God’s heart to smile on it; its own heart is beside the point, and lacks the authority white seeks.4 That kind of authority, thinks paradigmatic white, needs to be more objective. It needs to speak with the world’s voice—a voice that says to the reflectively-coherent suffering-maximizers “you are wrong” and not just “you and I want different things, and I’m ready to fight about it.” And where does one go to call other people wrong? Standardly: to blue. That is, paradigmatic capital-M Morality wants its shtick to follow from (and be a form of) knowledge. Blue-therefore-white.5 But anti-realism about meta-ethics denies morality this objectivity. Morality seeks grounding in blue; but red is the best it can get.
Right? Well, at some level: yes, probably. But I worry about telling the story too crudely, and in the wrong order. In particular: I worry that trying to ground ethics in either paradigmatically blue-style knowledge, or paradigmatically red-style passion, or in some combination, misses some other, more elusive dimension of normative epistemology—something neither paradigmatically red nor blue (even if, ultimately, it can be built out of red-and-blue); and something closely associated with wisdom. I’ll call this dimension “attunement.”
Gestures at attunement
Don’t look upon the light in your eyes, look upon the sky.
Katja Grace, “As you know yourself“
And don’t feel the pain in your side, feel the wound there…
Don’t hear my words, hear the roughness and warmth of my mind.
Meet me here, face to face.
What is attunement? I’m thinking of it, roughly, as a kind of meaning-laden receptivity to the world.6 Something self-related goes quieter, and recedes into the background; something beyond-self comes to the fore. There is a kind of turning outwards, a kind of openness; and also, a kind of presence, a being in the world. And that world, or some part of it, comes forward as it always has been—except, often, strangely new, and shining with meaning.
Here’s a passage from Marilyn Robinson’s “Housekeeping” that evokes attunement for me:7
What was it like. One evening one summer she went out to the garden. The earth in the rows was light and soft as cinders, pale clay yellow, and the trees and plants were ripe, ordinary green and full of comfortable rustlings. And above the pale earth and bright trees the sky was the dark blue of ashes. As she knelt in the rows she heard the hollyhocks thump against the shed wall. She felt the hair lifted from her neck by a swift, watery wind, and she saw the trees fill with wind and heard their trunks creak like masts. She burrowed her hand under a potato plant and felt gingerly for the new potatoes in their dry net of roots, smooth as eggs. She put them in her apron and walked back to the house thinking, What have I seen, what have I seen. The earth and the sky and the garden, not as they always are. And she saw her daughters’ faces not as they always were, or as other people’s were, and she was quiet and aloof and watchful, not to startle the strangeness away.
Zadie Smith writes about another example. For much of her life, she hated the music of Joni Mitchell. It just sounded like noise: “a piercing sound, a sort of wailing.” Then, one day, she was visiting Tintern Abbey with her husband. He had Joni on in the background in the car. Smith hated it as always. They parked.
“I opened a car door onto the vast silence of a valley. I may not have had ears, but I had eyes. I wandered inside, which is outside, which is inside. I stood at the east window, feet on the green grass, eyes to the green hills, not contained by a non-building that has lost all its carved defenses… And then what? As I remember it, sun flooded the area; my husband quoted a line from one of the Lucy poems; I began humming a strange piece of music. Something had happened to me…”
Exactly what happened isn’t clear. But Smith’s experience of Joni Mitchell changes dramatically:
How is it possible to hate something so completely and then suddenly love it so unreasonably? How does such a change occur? … This is the effect that listening to Joni Mitchell has on me these days: uncontrollable tears. An emotional overcoming, disconcertingly distant from happiness, more like joy—if joy is the recognition of an almost intolerable beauty. It’s not a very civilized emotion.
Smith’s essay emphasizes the yin at stake in the attunement8—the listening, the letting-in—and also, the sense of recognizing something intensely (intolerably?) important, to which it is possible to be blind, or inadequately sensitive.9 I’ve written about this before: “seeing more deeply,” “the doorway to real life.” I think experiences of beauty, spirituality, morality, and meaning all often involve a sense of attunement in this sense. And I think green cares a lot about that.
Indeed, what is Ogion trying to teach Ged, in silence, in the eyes of animals, and the flights of birds? The Wizard of Earthsea talks a lot about “true names”—but how do you learn them? Foster, in My Octopus Teacher, is trying to learn. And I think green-like figures of wisdom—Yoda, the Buddha, the archetype of an “elder”—often have very strong attunement vibes.
Admittedly, I’m painting in fairly broad strokes here. But hopefully, for present purposes, it’s enough of a gesture.
Attunement and your true heart
You, music of my late years, I am called
Czeslaw Milosz, “Winter”
By a sound and a color which are more and more perfect.
Do not die out, fire. Enter my dreams, love.
Be young forever, seasons of the earth.
Now: when I wrote about attunement previously, under the heading of “seeing more deeply,” I said that it tends to pull me towards realism about value. This is centrally because it seems like it discloses something simultaneously beyond-myself and valuable/important. That is, it has all the yin of blue—of knowledge, of receiving. But the thing-received, the thing-known, is something normative and meaningful.
Indeed, experiences of attunement are core to my own moral epistemology, and to my spirituality more generally. Philosophy, sure. But ultimately, for so many of us, it’s our deepest experiences that lead us onward. Some vision, some seeing, that says “this, this; don’t forget.” And said in some distinctive way; not as just-another-emotion, but with, it seems, some different depth—some particular harmony and clarity. For me, at least, this sort of depth is core to the weight and mystery and authority of that strange word, “goodness.” It’s related, I think, to the way sincerity feels like coming home; like something falling into its proper place. Chögyam Trungpa talks about “basic sanity.”
Does meta-ethical anti-realism preclude blue from receiving words like “goodness”? Blue alone: yes. And indeed, I expect that attunement will ultimately be a matter of both blue and red: of knowledge and love, your eyes and your heart, intermixed. But how do you see with your true heart’s eyes? Blue’s most paradigmatic answer is: “learn the facts; get ‘full information.'” But that doesn’t seem like it captures what’s going on with attunement very directly. In particular: experiences of attunement often feel much more like “realization