This happens to me, too, but usually only after a couple chapters. I.e. I'll come onto the site for the first time that night, read 1-2 chapters of something with perfectly fine loading times, and then the 3rd chapter I read (usually not the same manga; I switch around a lot), the loading times...