My server experiences high loads between about 6-9pm every day. This may have just been an extra heavy day, and therefore the slow load times.
Hopefully these problems don't persist, but if they do please let me know and I will dig deeper. Thanks guys.