Wasn't it just bad programming? Isn't it possible to just load in the new caches when someone pans? Does it really have to reload all of them every time?
This was my main source when selecting what caches to do, it really sucks that it's been disabled.