Optimizing Protein Tokenization: Reduced Amino Acid Alphabets for Efficient and Accurate Protein Language Models
This study demonstrates that combining reduced amino acid alphabets with Byte Pair Encoding tokenization significantly enhances the computational efficiency of protein language models by shortening input sequences and accelerating training, while maintaining or even improving predictive performance across diverse downstream tasks.