ScienceMeter: Tracking Scientific Knowledge Updates in Language Models
This paper introduces ScienceMeter, a framework for evaluating scientific knowledge updates in Large Language Models through three metrics—preservation, acquisition, and projection—revealing that current update methods struggle to maintain existing knowledge while effectively learning new facts and anticipating future scientific advancements.