Intersemiotic Translation Across Digital Markets: Multimodal Adaptation of Chinese and US E-commerce Product Pages
This study analyzes a corpus of 300 paired Chinese and US e-commerce product pages to reveal that cross-border intersemiotic translation employs a "cross-modal split configuration," where linguistic foreignization co-occurs with visual decontextualization and structural stabilization to negotiate cultural differences across markets.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
In the vast, invisible marketplace of the internet, a product page is more than just a digital shelf; it is a complex conversation between a seller and a potential buyer. When that conversation crosses a border, moving from one culture to another, the seller must decide how much of their own world to keep and how much to change. This process is a form of translation, but not just of words. It involves images, colors, backgrounds, and the way text and pictures work together. Scholars call this "intersemiotic translation," a term that simply means translating meaning from one type of sign, like a word, into another, like a picture, or reshaping both to fit a new audience. For decades, researchers have studied how professional translators adapt books or movies, often focusing on whether they keep the original culture's flavor or smooth it out to make it familiar. However, the everyday reality of online commerce, where millions of small business owners adapt their own listings without formal training, has remained largely a mystery. Understanding how these sellers navigate cultural differences is crucial, not just for business, but for understanding how human communication works in a digital, globalized world.
A researcher set out to uncover these hidden rules by looking at the product pages of sellers based in Yiwu, a massive trading hub in China known for its small commodities. They gathered 300 pairs of product listings: one version designed for Chinese shoppers on a domestic website, and the exact same product listed for American shoppers on an international site. They examined everything from the titles and descriptions to the background of the product photos and the cultural symbols used. Their goal was to see if these sellers followed a single strategy, like making everything sound and look American, or if they used a more complex mix of approaches. What they found was a surprising pattern of split decisions, where different parts of the page were treated in completely opposite ways.
The most striking discovery was that sellers did not treat the text and the images as a single unit. Instead, they applied different logic to each. When it came to the words used in the product titles, the sellers overwhelmingly chose to keep the Chinese cultural flavor. For items like hair accessories, festive decorations, and jewelry, they retained specific cultural terms, such as "Chinese" or references to traditional styles, rather than replacing them with generic English words. This approach, known as foreignization, turned the cultural origin of the product into a selling point. The data showed that for hair accessories, nearly 76 percent of the listings kept these cultural markers, while for everyday items like kitchen sponges, the sellers simply used neutral terms because there was no cultural element to preserve. The researcher concluded that for these sellers, keeping the "foreign" label was a smart business move to signal authenticity and uniqueness to American buyers.
However, the visual side of the story told a different tale. While the words shouted "Chinese," the pictures quietly removed the Chinese context. In the domestic listings, products were often shown in rich, traditional settings: a red lantern hanging in a room with wooden beams and calligraphy, or a hair clip worn by a model in a Chinese garden. In the American versions of these exact same products, the sellers stripped away the background. The lantern and the hair clip were moved to a plain, white, or neutral studio background. The cultural symbols themselves, like the lantern or the intricate design of the clip, were kept intact, but they were lifted out of their original environment. This strategy, which the researcher calls visual decontextualization, allowed the product to remain recognizable as culturally distinct without forcing the American buyer to navigate a complex foreign setting. It was a practical solution: keep the exotic object, but remove the potentially confusing or unfamiliar surroundings.
Perhaps the most subtle finding was that the relationship between the words and the pictures remained exactly the same, regardless of the market. In both the Chinese and American versions, the image and the text worked together in a consistent way: the picture showed what the object looked like, while the text explained what it was made of, how big it was, or how to use it. This structural pattern did not change. The researcher found that this deep architecture of the product page was stable and resistant to cultural adaptation. It suggests that while sellers actively decide what words to use and what background to photograph, they do not consciously change the fundamental way information is organized on the page. This stability appears to be driven by the universal needs of online shopping rather than by cultural differences.
The study reveals that cross-border e-commerce adaptation is not a simple choice between being foreign or being local. Instead, it is a sophisticated, multi-layered process where sellers keep the cultural label in the text, remove the cultural setting in the image, and leave the structural relationship between them unchanged. This "cross-modal split" shows that different parts of a message follow different rules. For the sellers in Yiwu, this approach allows them to highlight the unique value of their products while making them easy to understand for a global audience. It challenges the old idea that translation is a single, uniform act, showing instead that in the digital marketplace, meaning is negotiated separately across words, images, and structure. This insight offers a new way to understand how people communicate across cultures today, proving that even in the fast-paced world of online sales, the way we present a product is a carefully balanced act of translation.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.