STEAM Pedagogy and Student Competency Development: A Comparative Mixed-Methods Study of Institutional Contexts in Pakistan and Japan

Technical Summary: STEAM Pedagogy and Student Competency Development in Pakistan and Japan

Problem Statement and Research Gap
While STEAM (Science, Technology, Engineering, Arts, and Mathematics) education is widely recognized as a vehicle for developing 21st-century competencies such as critical thinking, creativity, and collaboration, its implementation in higher education remains uneven. Existing literature is predominantly country-specific or institution-specific, often focusing on either student achievement or teacher readiness in isolation, rather than examining the interplay between both. Furthermore, there is a scarcity of comparative research that links pedagogical frameworks (such as TPACK) to student competency development across diverse national contexts. Specifically, the influence of institutional culture, resource constraints, and assessment systems on the translation of STEAM pedagogy into learning outcomes in contrasting environments—such as the technologically advanced system of Japan versus the resource-constrained, exam-oriented system of Pakistan—remains under-researched. This study addresses these gaps by investigating how STEAM pedagogical practices influence student competency development and how contextual factors mediate this relationship in these two distinct national settings.

Methodology
The study employed a comparative concurrent mixed-methods design (convergent parallel design) grounded in a pragmatic research paradigm. Data collection occurred simultaneously for both quantitative and qualitative strands:

• Quantitative Strand: A survey questionnaire, adapted from established STEAM and TPACK frameworks, was administered to 293 higher education students (151 from Pakistan, 142 from Japan). The instrument measured perceptions of STEAM pedagogical practices (e.g., inquiry-based learning, interdisciplinary integration) and self-reported STEAM competencies (e.g., problem-solving, digital literacy). Data analysis included descriptive statistics, non-parametric tests (Mann-Whitney U) to compare perceptions across countries, and hierarchical multiple regression to assess the predictive power of STEAM practices on competencies and the moderating role of the national context.
• Qualitative Strand: Semi-structured interviews were conducted with 16 participants (10 students and 6 faculty members; 5 students and 3 teachers from each country). These interviews explored institutional and contextual factors influencing STEAM implementation. Data were analyzed using thematic analysis (inductive coding) to identify recurring patterns regarding challenges and enablers.
• Integration: Quantitative and qualitative findings were integrated through a joint display to provide a comprehensive meta-inference, explaining statistical trends through contextual insights.

Key Results

• Predictive Relationship: Hierarchical regression analysis revealed that STEAM pedagogical practices are a strong, significant predictor of student competency development ($R^2 = .607$, $p < .001$). This relationship held true across both national contexts.
• National Context as a Moderator: The interaction term between STEAM practices and country was non-significant ($\Delta R^2 = .002$, $p = .558$), indicating that the core mechanism linking pedagogy to competency is stable regardless of whether the institution is in Pakistan or Japan.
• Perceptual Differences: Despite the stable predictive relationship, Mann-Whitney U tests indicated statistically significant differences in mean ranks. Pakistani students reported significantly higher perceptions of both STEAM pedagogical practices and competency development compared to Japanese students.
• Qualitative Themes: Five overarching themes emerged regarding contextual challenges:
  1. Institutionalization: In Pakistan, STEAM implementation is often driven by individual teacher initiative due to a lack of formal institutional frameworks. In Japan, STEAM is formally embedded in the curriculum but can be perceived as rigid, limiting pedagogical flexibility.
  2. Resources vs. Time: Pakistani participants cited a lack of physical infrastructure (labs, equipment) as a primary barrier. Japanese participants acknowledged adequate infrastructure but identified time constraints and heavy workloads as limiting factors for effective STEAM delivery.
  3. Faculty Preparedness: Both contexts reported gaps in professional development. Pakistani faculty lacked training in interdisciplinary instruction, while Japanese faculty noted a lack of continuous, sustained professional learning opportunities despite initial training.
  4. Assessment Culture: In Pakistan, an exam-oriented culture prioritizing rote memorization conflicts with STEAM's competency-based goals. In Japan, while project-based assessment is encouraged, the difficulty of grading interdisciplinary work in large classes poses challenges.
  5. Cultural Norms: Hierarchical classroom norms in Pakistan can restrict student autonomy, while Japanese collaborative norms sometimes inhibit students from challenging ideas openly, potentially limiting creative divergence.

Key Contributions

• Cross-National Empirical Evidence: The study provides rare comparative data on STEAM implementation in higher education, contrasting a developing educational system (Pakistan) with a technologically advanced one (Japan).
• Decoupling Infrastructure from Perception: The findings challenge the assumption that superior infrastructure (Japan) automatically leads to higher perceived engagement or competency development. Instead, the study suggests that individual teacher agency in less structured environments (Pakistan) can drive high perceived engagement, whereas curricular rigidity in structured environments (Japan) may dampen student perception of impact.
• Contextual Nuance in Implementation: The research demonstrates that while the pedagogical mechanism (STEAM practices predicting competencies) is universal, the implementation conditions (resources, time, assessment, culture) are highly context-specific.
• Integration of Frameworks: The study empirically links TPACK-based pedagogical practices to competency outcomes in higher education, moving beyond theoretical application to cross-national validation.

Significance and Claims
The paper claims that the effectiveness of STEAM education is not solely a function of pedagogical design or national technological advancement but is deeply mediated by institutional culture, resource availability, and assessment systems.

• For Theory: The findings support a shift toward ecological and systems-based approaches to STEAM implementation, suggesting that competency-based frameworks must account for the specific institutional and cultural constraints of the learning environment.
• For Practice: The study offers evidence-based guidance for educators and policymakers:
  • In contexts like Pakistan, where resources are scarce, investing in faculty capacity building and professional development is critical to leverage individual teacher initiatives.
  • In contexts like Japan, where infrastructure is robust, the focus should shift toward curricular flexibility and reducing administrative burdens to allow for genuine pedagogical innovation.
• Modesty of Claims: The authors explicitly acknowledge limitations, noting that the use of convenience sampling and selected institutions restricts the generalizability of the findings. They do not claim that STEAM is universally superior but rather that its successful translation into competency development is contingent upon context-sensitive adaptation. The study emphasizes that while the relationship between pedagogy and competency is robust, the pathway to achieving it varies significantly based on local institutional realities.