Developing and Validating the University Research Management Digital Transformation Assessment Scale (URM-DTAS): A Multidimensional Measure in the Chinese University Context
This study develops and validates the 17-item, five-dimensional University Research Management Digital Transformation Assessment Scale (URM-DTAS) through a mixed-methods approach involving interviews and large-scale surveys, establishing it as a psychometrically robust instrument for measuring digital transformation progress in Chinese university research management.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Universities are vast, complex organizations where knowledge is created, tested, and shared. For decades, the focus of digital change in these institutions has been on the classroom: how teachers use technology to teach and how students learn with it. Yet, universities are also engines of research, where scientists and scholars manage projects, handle funding, and produce new discoveries. This research side of the university relies on a different set of processes, often called research management. It involves organizing grants, tracking progress, ensuring data is secure, and coordinating between different departments. As digital tools have become everywhere, universities have begun to move these research tasks online. But simply putting old paper forms onto a computer screen is not the same as a true transformation. A real transformation changes how the work is done, how decisions are made, and how the organization functions as a whole. The question facing leaders today is not just whether they have bought new software, but whether their entire research management system has genuinely evolved to use these tools effectively.
To answer this question, a team of researchers from Guangzhou University and other institutions set out to build a new way to measure this change. They realized that while there were tools to measure digital progress in schools and teaching, there was no reliable instrument designed specifically for the unique world of university research. Without a clear way to measure it, it is difficult to know if a university is actually improving or just buying new equipment. The researchers, led by Xiaonan Zhou, developed a new assessment tool called the University Research Management Digital Transformation Assessment Scale. Their goal was to create a precise map of what digital transformation looks like in this specific context, moving beyond vague ideas to concrete, measurable realities.
The journey began with listening. The researchers interviewed thirty people deeply involved in university research, including administrators, professors, IT specialists, and policy makers. They asked these individuals to describe their experiences with digital systems: what worked, what was frustrating, and what was missing. From these conversations, the team identified five core areas that define a successful digital transformation in research management. First, there is the foundation: the digital infrastructure, which includes the servers, networks, and basic systems that must be in place. Second, there is the flow of information: how well different systems talk to each other and how easily data moves between them without getting stuck or duplicated. Third, there is the human element: whether the researchers and staff actually use the new systems and if they have received the training to do so. Fourth, there is safety: the measures taken to protect sensitive research data from loss or theft. Finally, there is the result: whether these digital changes have actually made the work more efficient, reduced unnecessary paperwork, and improved how departments work together.
Using these five areas, the researchers drafted a list of seventeen questions. They then tested these questions with two large groups of people from Chinese universities. The first group, consisting of 640 participants, helped the researchers refine the questions and see how they naturally grouped together. The second, much larger group of 1,875 participants, was used to confirm that the structure held up under rigorous testing. The results were clear and consistent. The seventeen questions reliably measured the five distinct areas the researchers had identified. The tool proved to be highly reliable, meaning that if you asked the same people the same questions again, they would give similar answers. It also showed that the five areas are deeply connected; a university that is strong in one area, like having good infrastructure, tends to be stronger in others, like data security. However, the researchers found that these areas are not all the same thing. A university could have excellent technology but still struggle with how staff adapt to it, or have great safety measures but inefficient workflows. This means the tool can act as a diagnostic device, pinpointing exactly where a university is strong and where it needs help.
The researchers also checked if the tool worked the same way for different groups of people. They found that men and women interpreted the questions in the same way, allowing for fair comparisons between genders. Furthermore, when they compared their new tool to a general measure of digital transformation used in education, they found a moderate link. This confirmed that their new scale was related to the broader concept of digital change but was specific enough to capture the unique details of research management. It is not just a copy of a general test; it sees the specific challenges of research, such as the need to track funding and protect complex data sets.
The study concludes that digital transformation in university research is not a single switch that gets flipped. It is a complex, multi-layered process that involves technology, people, safety, and efficiency all working together. The new scale provides a way to see the whole picture. It allows university leaders to move past the simple question of "do we have a system?" to the more important question of "is our system transforming how we work?" By offering a clear, validated way to measure these changes, the research gives universities a practical tool to understand their own progress, identify their weaknesses, and build a research environment that is truly ready for the digital age.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.