Goal-Aware Adaptive Regulation Across Modalities: Evolutionary Architecture Search for Transformer Language Models on a Consumer AMD GPU
This paper demonstrates that the GaaR evolutionary architecture search framework, originally validated on convolutional networks, successfully transfers to autoregressive transformer language models on a consumer AMD GPU via DirectML, achieving competitive performance and revealing that regulated exploitation outperforms random search on structured landscapes while favoring wide-shallow architectures under fixed step budgets.