Gap Between Self-Perception and Actual Performance in the Digital Competence of University Faculty
This study of 168 university faculty members in Colombia reveals a significant and uniform gap between high self-perceived digital teaching competence and low actual performance, demonstrating that self-report surveys are unreliable for identifying training needs and highlighting the urgent need for performance-based assessments.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
In the modern university classroom, technology is no longer a luxury; it is the air the institution breathes. Virtual platforms, digital resources, and artificial intelligence tools have woven themselves into the daily fabric of teaching. Yet, the presence of these tools does not guarantee their effective use. The true engine of innovation in education is not the software itself, but the Digital Teaching Competence of the professors who wield it. This concept refers to the specific ability to blend technology with teaching methods to create meaningful learning experiences, a skill that goes far beyond simply knowing how to send an email or open a spreadsheet. For years, universities have tried to measure this skill by asking professors to rate their own abilities. However, a persistent problem has emerged: people are often poor judges of their own expertise. They may believe they are masters of a subject simply because they use the tools frequently, confusing routine familiarity with deep, pedagogical mastery. This gap between what instructors think they know and what they can actually do creates a blind spot, leading institutions to design training programs that miss the mark entirely.
A team of researchers from Colombia set out to expose this blind spot with a direct, unvarnished look at reality. Working with every single professor at the Maicao campus of the Universidad de La Guajira, they conducted a comprehensive census of 168 faculty members. Instead of relying on a simple survey, they employed a dual approach that separated opinion from action. First, they asked the professors to complete a questionnaire where they rated their own digital skills on a scale from zero to five. Then, to see what these professors could actually do, the researchers gave them a practical test. In this task, the professors had to design a real digital lesson plan, select appropriate resources, and structure an assessment activity, all of which were scored by experts using a strict, objective rubric on an equivalent zero to five scale. The goal was to see if the confidence expressed in the questionnaire matched the performance shown in the classroom simulation.
The results revealed a stark and statistically significant divide between perception and reality. On average, the professors rated their own theoretical knowledge at 3.92 out of 5, placing them in an intermediate-to-high range of confidence. They believed they were quite capable. However, when faced with the practical test, the average score plummeted to just 1.54 out of 5, a level that corresponds to the very beginning of the learning curve. The difference between what they claimed to know and what they demonstrated was not a small error; it was a massive gap of nearly 2.4 points on the scale. This finding suggests that the self-assessment method, which many institutions rely on, is effectively hiding the true extent of the training needs. The professors were not merely overestimating their skills by a little; they were operating under a fundamental misapprehension of their own capabilities.
The researchers then investigated whether this overconfidence was limited to specific groups. They wondered if professors in technical fields, such as engineering, might be more accurate in their self-assessments than those in the social sciences or education. They also questioned if higher academic degrees, like a master's or a doctorate, might protect against this gap. Finally, they checked if gender played a role. The data showed that the gap was remarkably consistent across the board. Whether a professor taught systems engineering, business, or early childhood education, the discrepancy between their self-rating and their actual performance remained the same. Similarly, holding a postgraduate degree did not reduce the gap; professors with advanced degrees were just as likely to overestimate their practical skills as those with only a bachelor's degree. Gender, too, made no difference, with male and female faculty showing identical patterns of overestimation.
This study concludes that the ability to teach with technology is a specific skill set that does not automatically come from being an expert in a subject or from holding a high degree. A professor might be a brilliant engineer or a seasoned historian, but that expertise does not translate into the ability to design a digital lesson. The findings challenge the common assumption that technical fields produce naturally superior digital teachers. Instead, the evidence points to a universal need for a shift in how universities assess their staff. Relying on self-reports creates a false sense of security, leading to training that addresses the wrong problems. To truly improve education, institutions must move away from asking professors what they think they can do and start observing what they can actually do. By grounding professional development in objective, performance-based assessments, universities can finally identify the real gaps in their faculty's skills and provide the targeted support necessary to bridge them.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.