I would do what continuum suggests. Start disabling non-windows services and test. Also I would look to reducing the hardware footprint of the VM by removing hardware that is not required, e.g., serial ports, USB, etc...
Btw, make sure you snapshot before each change as you go along and deleting unwanted snapshots accordingly.