I don't know of any way to turn the cache on/off on the AdSpeed accelerator. However, the AdSpeed does have a fast ROM option. It's in the owner's manual.
I never acquired the correct higher speed TOS ROMs to try this and now that I'm using TOS v2.06 with a Cloudy board, I guess it's not an option for me anymore.
Using the Cloudy/Lightning ST setup, I pulled the original TOS v1.4 ROMs from my Mega ST's motherboard to avoid conflicts.
I would have liked to have seen if it improved the scores but...oh well.