What Is Sonification? Toward a Philosophy of Sonification
This paper proposes a philosophical framework grounded in Gustavo Bueno's materialist gnoseology and Gilbert Simondon's philosophy of individuation to define sonification as a coherent, transcategorical practice distinguished by its technical data-to-sound relationships, thereby clarifying its identity and relationship to music and aesthetics across diverse scientific, artistic, and design contexts.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Imagine you have a superpower: the ability to hear data. Not just numbers on a spreadsheet, but the hidden stories inside them. This is the world of sonification, a field where scientists, artists, and designers turn information into sound. Think of it like translating a foreign language; instead of turning a French novel into English text, you turn a weather map or a stock market chart into a melody or a rhythm. But here's the tricky part: if you turn data into a song, is it science? Is it art? Or is it something else entirely? For years, people have argued about whether sonification is just "science with a beat" or "music with a purpose," often getting stuck in a loop of definitions. To solve this, we need to look at two big ideas. First, imagine a recipe: the recipe itself (the rules for mixing ingredients) is the same whether you bake a cake for a birthday or a science fair. Second, imagine a seed: a seed has a fixed genetic code, but it grows into different shapes depending on the soil and sunlight it finds. This paper uses these ideas to offer a conceptual framework for figuring out what sonification really is, suggesting that it can be both a strict technical tool and a flexible creative practice without losing its core identity.
The Sound of Data: What Is Sonification Really?
So, you've got a pile of data. Maybe it's the temperature of a star, the movement of a robot, or the heartbeat of a patient. You want to listen to it. You build a system that turns those numbers into sounds. But then, a question pops up: "Is this music?" If the sound is pretty, is it art? If the sound helps a scientist spot an error, is it science?
This paper, presented at the 31st International Conference on Auditory Display, tackles this exact confusion. The author, Rubén García-Benito, argues that we've been asking the wrong question. We've been trying to fit sonification into a box labeled "Music" or a box labeled "Science," but it doesn't fit in either. Instead, he suggests sonification is a transcategorical practice. That's a fancy way of saying it's a technical tool that can travel anywhere—into a concert hall, a lab, or a classroom—without changing its core identity.
To explain this, the paper uses two philosophical tools, which we can think of as a Blueprint and a Growth Chart.
The Blueprint: The Unchanging Rules
First, let's look at the "Blueprint." The paper uses a philosophy called Materialist Gnoseology (think of it as the study of how we build knowledge through physical actions). The author breaks down sonification into three layers:
- The Physical Stuff (M1): The actual wires, speakers, and light sensors.
- The Human Experience (M2): How you feel, what you hear, and whether the sound is pretty or annoying.
- The Rules (M3): The invisible, mathematical logic that says, "If the data goes up, the pitch goes up."
The paper argues that the identity of sonification lives primarily in the Rules (M3). It's the recipe. Whether you are using this recipe to help a blind person navigate a room, to analyze a galaxy, or to write a symphony, the rule connecting the data to the sound stays the same.
Here is the big finding: Sonification is defined by its rules, not its audience.
The paper suggests that sonification does not become "music" simply because it sounds good or is played in a concert, nor does it lose its identity when used in a lab. The author proposes that if you change the rules to make the sound "prettier" without regard for the data, you risk displacing the technical identity of the practice. In other words, if musical preference overrides the data-to-sound logic, the practice may cease to function as sonification, even if the sound remains. But if you keep the strict data-to-sound rules, it remains sonification, even if the audience evaluates it as a beautiful piece of art.
The Growth Chart: How It Changes Shape
Next, the paper uses a second tool from philosopher Gilbert Simondon, which is like a Growth Chart. This helps explain how sonification can look so different in different places without breaking.
Imagine a seed. The seed has a specific genetic code (the M3 rules). But when you plant it in a desert, it grows one way. When you plant it in a rainforest, it grows another way. The seed is still the same seed, but its shape changes to fit the environment.
The paper suggests that sonification is a metastable system. This means it's not a finished, rigid object. It's a system full of potential that adapts to its surroundings.
- In a scientific lab, the "soil" is strict testing and accuracy. The sonification grows to be precise and clear.
- In an art gallery, the "soil" is emotion and expression. The sonification grows to be engaging and evocative.
- In a classroom, the "soil" is learning. The sonification grows to be educational.
The paper argues that this adaptability isn't a weakness. It's a strength. The "seed" (the technical rule) stays the same, but the "plant" (the final sound experience) changes to fit the situation. This explains why the same sonification technique can be used for a serious medical diagnosis and a fun video game without the technique itself losing its identity.
Why This Matters
Why should a curious teenager care about this? Because it clears up the confusion that often stops people from taking sonification seriously.
- For Scientists: It means you don't have to apologize if your data-sound is musical. As long as the rules are strict, it's valid science.
- For Artists: It means you don't have to pretend your art is "just data" to be taken seriously. You can use the rules of sonification to create art without losing the technical integrity, provided the data-to-sound logic remains the driver.
- For Everyone: It helps us understand that just because two things use the same material (sound), they aren't the same thing. A hammer is still a hammer whether you use it to build a house or to tap a rhythm in a song. The tool is the same; the use is different.
The paper doesn't claim to have solved every mystery of sound and data. It doesn't give a new formula for making better sonifications. Instead, it offers a new way of thinking about them. It suggests that we stop asking "Is this music or science?" and start asking "What are the rules, and how are they being used?"
By separating the unchanging rules (the technical identity) from the changing experience (the artistic or scientific context), the paper gives us a map to navigate the messy, exciting world of turning data into sound. It suggests that sonification is a unique, powerful practice that can bridge the gap between the cold hard facts of science and the warm, emotional world of art, all while keeping its own distinct identity intact.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.