/r/LocalLLaMA

Strix Halo users can apply a rejected PR to llama.cpp to achieve up to 31% faster processing for Mixture-of-Experts models, with the biggest gains at low context lengths.