Just a question about server speed etc.

Hi, CanadianBoy here, love the site, come here daily to check it out since I found it.

Something I noticed last month is becoming more blatant lately. In the daytime/evening, when I usually came here then, I attributed the rather painfully slow access to high traffic.
Now that I work late evenings and get off at midnight (I'm posting this at 3:30am my time), I find that the service is even slower. Like, half a minute to access what are basically just text pages with a bit of background color.
Is it a referrer/programming issue? Like, perhaps, the text all loads fast but the logo is stored on photobucket?
Or is it strictly server speed?
The former I probably can't help with, I'm really not much of a programmer. But can you perhaps make public what the cost would be to buy you a server that would allow the kind of speed that simple text (with minimal graphics) should allow?

I want to contribute to the fund that you do have listed on the main page. But if it would only go to server/rack-space use and bit transfer, nothing will ever get faster.
Can you put a spot where a guy could give money towards a nice blistering-fast server?
Thanks!