Grade 4-to-5 Joint Mathematics–Science Benchmark Transitions in Nine Systems: A Descriptive Common-Severity Analysis Using TIMSS 2023 Longitudinal Data
This study utilizes TIMSS 2023 longitudinal data from nine systems to estimate and standardize the joint probability of students transitioning from below to above both mathematics and science benchmarks, revealing significant system-specific variations and demonstrating that while common-severity standardization clarifies target dependence, the results remain descriptive rather than causal.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Every year, millions of students around the world take standardized tests in mathematics and science. For decades, the results of these massive exams have been reported in a way that treats the two subjects as separate worlds. We are told how many children in a country reached a certain level of skill in math, and separately, how many reached that same level in science. But this approach misses a crucial part of the story: how a single child moves through both subjects at the same time. A student might improve in math while falling behind in science, or they might struggle in both before suddenly mastering them together. The official reports, which look at each subject in isolation, cannot show these combined journeys. They are like trying to understand a person's health by looking at their heart rate and their blood pressure on two different pieces of paper, without ever seeing how the two numbers change together for that specific person.
This gap in understanding is what a new study set out to fill. The researchers used data from the 2023 Trends in International Mathematics and Science Study, a massive global assessment that tracked students over time. They focused on a specific group: children who started the study performing below a key benchmark in both math and science. The question was simple but difficult to answer with standard methods: of the students who were struggling in both subjects at the beginning, how many managed to reach a solid level of proficiency in both by the end of the school year? To get this answer, the team had to build a new kind of map. Instead of just counting how many students passed math and how many passed science, they looked at the specific paths students took, tracking the ones who started low and ended high in both areas simultaneously. They also had to account for the fact that students in different countries started with different levels of difficulty; some systems had many students far below the line, while others had students just barely below it. To make fair comparisons, the researchers created a method to imagine what would happen if all the countries had started with the exact same mix of student difficulties, allowing them to see if the schools themselves were doing something different to help students catch up.
The study analyzed data from over 44,000 students in nine different education systems, including Georgia, Italy, Jordan, South Korea, and Sweden. When the researchers looked at the raw numbers, they found a wide range of success. In some systems, only about 5.5 percent of the students who started behind in both subjects managed to reach the target in both by the end of the year. In others, like Slovenia, that number was much higher, reaching 34.1 percent. This raw difference tells us what actually happened in those specific classrooms. However, because the students in the different countries started with different levels of struggle, the researchers adjusted their numbers to see how the systems would compare if they had all started with the same mix of students. After this adjustment, the success rates changed. For example, in Jordan, the rate of students reaching both goals went up significantly when adjusted for the starting difficulty, while in South Korea, it went down. This shift showed that the raw numbers were heavily influenced by how many students were already close to the finish line at the start, rather than just how well the schools helped them move forward.
The researchers were careful to explain that these numbers describe what happened, not why it happened. They did not claim that one country's teaching method was better than another's, nor did they suggest that the differences were caused by the students' backgrounds alone. The study explicitly ruled out the idea that these results could be used to rank countries or to prove that a specific teaching style caused the improvement. Instead, the work serves as a detailed description of student movement. It showed that while many students did improve in one subject, fewer managed to improve in both at the same time. In the systems where the most students succeeded, nearly a third of those who started behind managed to reach the goal in both math and science. In the systems with the lowest success, fewer than one in twenty made that leap. The study also looked at older students in a few countries and found that the pattern of struggling in both subjects and then succeeding in both was much less common for them, suggesting that the window for this kind of double improvement might be narrower as children get older.
One of the most important findings was how sensitive the results were to the definition of "success." The researchers tested what would happen if they changed the score required to pass. When they lowered the bar, the percentage of students who succeeded jumped dramatically, and when they raised it, the percentage dropped. This proved that the numbers are not fixed facts about a country's quality, but rather descriptions of how students moved relative to a specific line. The study also checked for errors, such as missing data or students who dropped out, and found that these issues did not significantly change the main results. The team concluded that while we can now see the joint journey of students in math and science, this new view does not solve the mystery of why some systems help more students than others. It simply provides a clearer picture of the movement itself, showing that the path from struggling in both subjects to mastering both is possible, but it is a steep climb that very few students manage to complete, and the difficulty of that climb depends heavily on where they started and how high the bar is set.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.