Validating Language Assessment Literacy (LAL) for Secondary EFL Teachers in China: Evidence from Confirmatory Factor Analysis
This study validates a context-specific "3P" (Philosophy, Principle, Practice) framework for Language Assessment Literacy among secondary EFL teachers in China through confirmatory factor analysis, revealing that assessment philosophy shapes practice indirectly by first guiding assessment principles.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
In the world of education, there is a quiet but powerful force that shapes how students learn: the way teachers evaluate them. When a teacher gives a test, grades an essay, or decides whether a student has mastered a concept, they are engaging in assessment. For decades, the focus was often on the final score, but a shift has occurred in how experts view this process. The modern view recognizes that the person doing the grading needs a specific set of skills and knowledge to do it well. This collection of skills is called assessment literacy. It is not just about knowing how to write a test; it involves understanding why we test, what makes a test fair, and how to use the results to help students improve. Without this literacy, even the best teachers can inadvertently harm the learning process, turning assessment into a source of anxiety rather than a tool for growth.
The challenge, however, is that most of what we know about these skills comes from Western educational systems. These systems often operate under different rules, cultures, and pressures than schools in other parts of the world. In China, where English is taught as a foreign language to millions of students, the educational landscape is unique. Teachers there navigate a complex environment of national standards, high-stakes exams, and a massive student population. For a long time, there was no clear map to measure or improve the assessment skills of these specific teachers. Existing tools were either too general or simply did not fit the local reality. This left a gap: educators and policymakers could not accurately see what teachers knew, what they needed to learn, or how their beliefs about testing translated into their actual classroom actions.
To bridge this gap, a researcher at Dali University set out to build a new, tailored framework specifically for secondary school English teachers in China. The goal was to create a tool that could measure assessment literacy not as a single, flat skill, but as a layered system. The researcher proposed that a teacher's ability to assess is built on three distinct but connected layers. The first layer is philosophy, which represents the deep-seated beliefs a teacher holds about the purpose and ethics of testing. The second layer is principle, which consists of the specific rules and guidelines a teacher follows to turn those beliefs into action. The third layer is practice, which is the tangible work of designing tests, grading papers, and giving feedback in the classroom. The central idea was that these layers do not exist in isolation; rather, a teacher's beliefs should guide their rules, and those rules should guide their daily work.
To test whether this three-part structure actually worked, the researcher developed a detailed survey containing eighty-seven questions. This survey was designed to ask teachers about their views on fairness, their methods for creating tests, and how they use data to help students. The study reached out to over a thousand English teachers across sixteen different provinces and municipalities in China. After filtering out incomplete responses, the final group of 1,140 teachers provided a massive and diverse dataset, covering teachers of all ages, experience levels, and school types, from rural villages to major cities. The researcher then split this large group into two equal halves. One half was used to explore the data and see what patterns emerged naturally, while the other half was used to rigorously test if the proposed three-part structure held up under strict statistical scrutiny.
The results confirmed that the three-part model was not just a theoretical idea, but a reality reflected in the data. The analysis showed that the survey successfully measured three distinct areas: the teachers' core beliefs, their guiding principles, and their classroom practices. More importantly, the study revealed a specific chain of cause and effect. It found that a teacher's deep beliefs about assessment did not directly change how they acted in the classroom. Instead, those beliefs first had to shape the specific principles and rules the teacher adopted. It was these principles that then directly influenced the daily practices of testing and grading. In other words, a teacher's philosophy acts as a foundation, but it must be translated into clear guidelines before it can change what happens in the classroom. The study also found that while teachers were quite strong in their philosophical beliefs, there was much more variation in how they actually practiced assessment, suggesting that many teachers struggle to turn their good intentions into consistent, high-quality actions.
This discovery offers a clear path forward for improving teacher training. The findings suggest that simply telling teachers about the importance of fair testing or showing them abstract theories is not enough to change their behavior. To truly improve assessment literacy, professional development programs need to focus on the middle layer: the principles. Teachers need help in codifying their beliefs into concrete, actionable rules and standards. Once these rules are clear and internalized, the actual classroom practices will naturally follow. The study provides a validated, reliable tool that can now be used to diagnose where individual teachers or entire school systems stand, identifying whether the gap lies in their beliefs, their rules, or their execution. By understanding this specific chain of influence, educators can design better training programs that move beyond theory and directly support the practical, day-to-day work of assessing students in a way that truly helps them learn.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.