Response styles and value internalisation in entrepreneurship education evaluation: a survey of 16,075 Chinese students
This study of 16,075 Chinese students reveals that self-reported entrepreneurship education evaluations are significantly compromised by response biases and that while elite institutions foster better climates, substantive course provision is a more robust and verifiable pathway to genuine value internalisation than climate-building alone.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
In the world of higher education, universities are under pressure to prove that their entrepreneurship courses are working. The goal is not just to teach students how to start a business, but to instill a specific set of values: honesty, social responsibility, and a genuine belief in the power of innovation. To measure whether these deep values have taken root, schools rely on a simple tool: asking students to fill out surveys. They ask, "How satisfied are you with the program?" and "Do you agree with these positive statements about entrepreneurship?" The underlying assumption has long been that if a student gives high scores on these surveys, they have truly internalized these values. It is a logical shortcut, but it rests on a fragile premise: that a high score always means a deep belief, and that a student who says "yes" to everything is genuinely convinced, rather than just going along with the flow.
A massive study involving over 16,000 university students in China has challenged this assumption. The researchers, led by Liping Jiang, looked closely at how students answered these questions, not just to see what they said, but to understand how they said it. They were particularly interested in a phenomenon known as "response style," which is essentially a habit of answering questions in a certain way regardless of the content. In many cultures, including China, there is a strong tendency to agree with statements to be polite or to avoid conflict. When a survey asks only positive questions, a student might simply click "strongly agree" for every single item, not because they hold every single belief with equal intensity, but because it is the easiest path. The study asked a critical question: are the high scores we see in elite universities a sign of superior education, or are they largely an illusion created by this habit of agreeing with everything?
The researchers began by examining the structure of the survey itself. They found that the questions were dominated by a single, overwhelming factor: a general tendency to give positive answers. While the survey was designed to measure two different things—genuine value beliefs and practical, self-interested motivations—the data showed that the "value" scores were heavily contaminated by this general habit of agreement. In fact, nearly two-thirds of the shared information in the survey responses came from this general tendency rather than from specific beliefs. This meant that a high score on the value scale was often just a reflection of a student's willingness to say "yes" to everything, rather than a true measure of their internal values.
To get a clearer picture, the team grouped the students into different profiles based on how they answered. They discovered six distinct types of students. The most striking group was a small but significant cluster, representing about 6.4% of all students, who gave the highest possible rating to every single question. These were the "full-endorsers." They did not just agree with the positive values; they also agreed with the practical, self-interested statements with the same maximum enthusiasm. This group was not evenly distributed. Students at elite, top-tier universities were nearly twice as likely to belong to this group compared to students at ordinary universities. In these elite schools, the "full-endorsing" group made up more than 12% of the student body.
This finding created a paradox. Students at elite universities reported being more satisfied with their programs and perceived a much stronger entrepreneurial climate than their peers at other schools. By all traditional measures, these elite institutions should be producing students with the highest levels of value internalization. Yet, when the researchers looked past the surface-level high scores and examined the actual composition of the answers, they found the opposite. The elite students actually reported lower levels of genuine value orientation and higher levels of instrumental, self-interested thinking. The high scores that made the elite schools look successful were largely driven by the students who were simply ticking every box with a "strongly agree." However, even after the researchers removed these "full-endorsers" from the data, the direct link between satisfaction and value orientation remained stronger in elite institutions than in ordinary ones. The advantage did not vanish; rather, the study revealed that the mechanism behind the scores differed, with elite schools showing a stronger direct connection that was less dependent on the perceived climate pathway.
The study also looked at what actually seemed to work. While the general atmosphere of a school and the students' satisfaction with it were often distorted by these response habits, one factor remained consistent and reliable: the number of courses a student actually took. There was a clear, step-by-step relationship between taking more entrepreneurship courses and having stronger, more genuine value beliefs. This relationship held true even after the researchers removed the students who were just agreeing with everything. Furthermore, taking more courses was linked to a decrease in purely self-interested, opportunistic thinking. This suggests that the substance of the education—the actual time spent learning the material—was a much more reliable path to changing values than simply building a positive campus climate or hoping for high satisfaction ratings.
The implications of this research are significant for how we judge the success of educational programs. It suggests that relying on student satisfaction surveys to measure value formation is risky, especially in high-performing institutions where the pressure to agree might be strongest. The "high scores" that administrators see might not be a badge of honor, but a statistical artifact of students who are polite, eager to please, or simply taking the path of least resistance. The study proposes a new way of looking at these evaluations: before declaring a program a success based on high survey scores, educators should first check the composition of those scores. They need to ask if the high marks are coming from students who truly believe, or from those who are just saying yes to everything.
Ultimately, the research points to a simple but powerful conclusion. If the goal is to help students internalize values like honesty and social responsibility, the most effective tool is not a perfect campus climate or a satisfied student body, but the curriculum itself. The act of engaging with the material, course by course, appears to be the only factor that consistently leads to genuine change, unaffected by the noise of response habits. For universities, this means that the path to true educational effectiveness lies in the depth of the teaching, not just in the brightness of the reputation or the warmth of the feedback. The data shows that while a better environment feels good, it does not necessarily make students better; only the work of learning seems to do that.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.