💻 computer science

The Illusion of Competence: Self-Perceived Digital Literacy and AI Readiness Among European Secondary Students

This study of 243 European secondary students reveals a significant "Confidence-Competence Divide" where high self-perceived digital literacy masks a lack of actual technical and AI skills, a gap exacerbated by stereotype threats in STEM classrooms and a false sense of invulnerability to misinformation, ultimately calling for a shift from passive theory to active, hands-on technological education.

Original authors: Nicolas Rodriguez-Alvarez (Instituto de Educacion Secundaria Parquesol), Alan Martin Blanch-Marsolini (Instituto de Educacion Secundaria Parquesol), Samuel Vara-Gutierrez (Moate Community School), Hug

Published 2026-05-26

📖 4 min read☕ Coffee break read

CC BY 4.0

Original authors: Nicolas Rodriguez-Alvarez (Instituto de Educacion Secundaria Parquesol), Alan Martin Blanch-Marsolini (Instituto de Educacion Secundaria Parquesol), Samuel Vara-Gutierrez (Moate Community School), Hugo Gil-Garcia (Instituto de Educacion Secundaria Jose Jimenez Lozano), Javier Calzon-Dueñas (Instituto de Educacion Secundaria Parquesol), Fernando Rodriguez-Merino (Universidad de Valladolid)

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). ✨ This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine a group of young people who have grown up with smartphones and tablets in their hands since they were toddlers. Because they use these devices so much, we often assume they are "tech wizards" who understand how the technology works inside and out. This paper is like a reality check that says, "Not so fast."

The researchers surveyed 243 high school students in Spain and Ireland to see if these "Digital Natives" actually know what they think they know. Here is what they found, broken down into simple stories and analogies:

1. The "Tourist vs. Architect" Illusion

The study found a huge gap between what students think they can do and what they can actually do.

The Tourist: Students feel like experts at being "tourists" in the digital world. They are very confident at passive tasks, like turning on a computer, scrolling through social media, or adjusting privacy settings. They feel like they are masters of the device.
The Architect: However, when asked to be "architects"—to build something new, write code, or understand the logic behind how a program works—their confidence crashes.
The Analogy: It's like someone who has ridden a bicycle every day for years feeling like a pro. They think they could build a bike from scratch or fix a broken chain. But if you actually handed them a toolbox and asked them to assemble a bike, they would have no idea where to start. They are great users, but not great creators.

2. The "Confidence Trap" (The Dunning-Kruger Effect)

The paper describes this situation as a "Confidence-Competence Divide." The students suffer from a collective "Dunning-Kruger effect."

The Metaphor: Imagine a person who has watched a few cooking shows. They feel like a master chef because they know what a knife looks like. But the moment they have to actually chop an onion or season a dish, they realize they have no idea what they are doing. The students overestimate their skills because they are so familiar with the surface of technology, but they are functionally unequipped to handle the engine underneath.

3. The "STEM Classroom" Gender Gap

The researchers looked at whether boys and girls felt differently about their tech skills.

The General Rule: Overall, boys tended to be more confident than girls.
The Twist: This gap wasn't everywhere. In Art and Science classes, boys and girls felt about the same. But in Technology classes (the ones specifically focused on engineering and coding), the gap suddenly appeared.
The Analogy: Think of a sports team. In a general gym class, everyone feels equally capable. But in the "Elite Soccer Academy," the girls suddenly start doubting their ability to play, even though they are on the same team and getting the same coaching. The paper suggests this is because the "culture" of tech classes makes girls feel like they don't belong, a phenomenon known as "stereotype threat."

4. The "AI Paradox"

The study also looked at Artificial Intelligence (AI).

The Situation: Students were asked two things: "How good are you at using AI tools?" and "How good are you at spotting AI tricks, like fake videos (deepfakes) or biased algorithms?"
The Surprise: Students rated themselves as more confident in spotting fake AI content than they were in actually using AI tools.
The Metaphor: It's like a person who thinks they are an expert at spotting a magic trick because they've seen a few on TV, but they have no idea how the magician actually does the trick. They feel "invincible" against misinformation because they think they can spot a lie, but they are actually just as vulnerable as anyone else because they don't understand how the "magic" (the algorithm) works.

5. What the Students Want

Finally, the students spoke up about their education.

The Verdict: While they felt their current classes were okay, 76.5% of them said they wanted to stop just listening to lectures and reading about computers. They want to get their hands dirty.
The Request: They are begging for "hands-on" learning. They want to build, break, and fix things, rather than just being told how things work.

The Bottom Line

The paper concludes that just because a generation grew up with technology doesn't mean they understand it. They are confident "consumers" but insecure "creators." To fix this, schools need to stop treating technology like a subject you read about and start treating it like a skill you practice by doing. If we want these students to be ready for the future, we need to move them from the passenger seat to the driver's seat.

Technical Summary: The Illusion of Competence in European Secondary Students

Problem Statement
The study challenges the pervasive "Digital Native" paradigm, which assumes that contemporary youth possess inherent technological proficiency due to ubiquitous device exposure. Drawing on prior research (e.g., Kirschner and De Bruyckere; Hargittai), the authors posit that familiarity with consumer interfaces (touchscreens, social media) does not equate to deep digital literacy, algorithmic thinking, or technical readiness. Specifically, the research addresses a potential "Confidence-Competence Divide," investigating whether students overestimate their abilities in passive consumption while lacking the skills for active creation and logical troubleshooting. Furthermore, the study examines how this divide interacts with gender and academic pathways, and whether a similar illusion exists regarding Artificial Intelligence (AI) readiness, particularly concerning the detection of deepfakes and algorithmic biases.

Methodology
The research employed a cross-sectional, multicenter design involving 243 secondary students (aged 12–16) from three institutions: two in Spain (Valladolid and Zamora) and one in Ireland (County Westmeath).

Instrument: Data was collected via a structured, self-administered questionnaire using a 5-point Likert scale. The instrument assessed self-perceived competence across six dimensions: (1) passive consumption/navigation, (2) privacy/security, (3) logical troubleshooting, (4) active creation (programming, CAD), (5) AI readiness, and (6) curriculum evaluation.
Procedure: To mitigate social desirability bias, data collection was coordinated by administrative heads and administered by homeroom teachers, ensuring a double-blind process where student-authors were detached from the survey.
Analysis: Anonymized data were processed using Python (Pandas, SciPy). Descriptive statistics established baselines, while inferential analyses included Independent Samples t-tests (with Welch's correction for unequal variances) to examine gender and pathway disparities, and Paired-samples t-tests to compare operational AI usage against critical awareness.
Demographics: The study adhered to SAGER guidelines, focusing on self-reported gender. Non-binary responses ( $n=2$ ) were excluded from comparative analysis to ensure GDPR compliance and participant anonymity, leaving a robust cohort of 241 male and female students.

Key Results
The study identified four primary findings:

The Confidence-Competence Divide: Students reported near-maximum confidence in passive tasks (e.g., turning on a computer, $M=4.88$ ; managing privacy, $M=4.81$ ). However, confidence dropped precipitously for active creation and algorithmic tasks (e.g., CAD, $M=2.86$ ; programming, $M=2.96$ ). This distribution suggests a collective Dunning-Kruger effect, where proficiency as consumers masks an inability to engage in technical creation.
Contextual Gender Gap: While male students generally reported higher digital confidence ( $M=4.05$ ) than females ( $M=3.89$ , $p=0.001$ ), this gap is not uniform. Intra-pathway analysis revealed that the gender gap is statistically significant only within Technology-oriented classrooms ( $p=0.046$ ). In Arts/Humanities and Sciences pathways, no significant gender differences in active creation confidence were found. This suggests that "stereotype threat" is amplified specifically within formal STEM environments.
The AI Paradox: A disconnect exists between operational AI skills and critical awareness. Students reported significantly higher confidence in their ability to critically evaluate AI (e.g., detecting deepfakes, understanding biases, $M=4.28$ ) than in their operational ability to use AI tools effectively ( $M=4.15$ , $p=0.015$ ). This indicates a "false sense of invulnerability" regarding misinformation.
Pedagogical Demand: Despite 74.5% of students feeling their current classes prepare them for other subjects, 76.5% explicitly demanded a shift from theoretical instruction to hands-on, practical computer activities.

Key Contributions

Empirical Refutation of the Digital Native Myth: The study provides quantitative evidence that self-perceived fluency in consumer technology does not translate to technical readiness for creation or algorithmic logic.
Nuanced Gender Analysis: By isolating academic pathways, the research demonstrates that the technological gender gap is not a universal trait of adolescence but a contextual phenomenon exacerbated by the "masculine culture" of Technology-oriented classrooms.
Identification of the AI Paradox: The paper highlights a specific vulnerability where students overestimate their critical defenses against AI-generated misinformation, potentially leaving them more susceptible to deepfakes than they realize.
Student-Led Reform Mandate: The research captures a direct, overwhelming demand from the student body for a pedagogical shift toward active, creation-based learning.

Significance and Claims
The authors conclude that the "illusion of competence" poses a critical barrier to digital resilience. The study argues that dismantling this illusion requires abandoning passive theoretical instruction in favor of hands-on, active technological creation. The significance of the work lies in its call to educational policymakers to restructure IT curricula to focus on algorithmic trial-and-error, logical troubleshooting, and active problem-solving. The authors assert that only through specialized, practical instruction can students transition from being passive consumers to resilient, critical creators capable of navigating an increasingly automated world. The paper modestly notes that its findings are based on a convenience sample and calls for future replication across broader, randomized demographics to confirm generalizability.