stop dreaming, the Jag is not a PC hardware, first the current 68000 in the Jag is exactly the frequency of the GPU/DSP divided by 2, 27Mhz -> 13.5Mhz
so it's faster than the 12Mhz you want to put
and a 3D game like that don't use the 68k, because the 68k is slowing everything on the jaguar, it use the GPU and blitter, that are very fast !
the problem is, you can't overclock the frequency of the GPU because it will depend of the DSP frequency and 68k frequency (there is only one crystal for everything If I remmember, for cost reason)
and GPU/DSP timming are not known, so I think it's impossible. replacing the RAM is also impossible because those chip are obsolete and not produced anymore ....