llama.cpp merged pull request #30966 on November 7, adding CPU execution for selected expert cache misses instead of always transferring those experts. The llama.cpp MoE CPU offloading update, contributed by am17an, also introduces a script for tuning the balance on individual machines. Its importance lies in that choice, rather than a guaranteed speed increase. MoE, short for mixture of experts, describes models that activate selected neural network components for each token
