What kind of rate limiting should my RSS parser use for Mangadex's feeds?

Group Leader
Joined
Jan 22, 2018
Messages
27
Hi there!

I've made my own RSS parser to keep track of the 100+ manga I'm following. However, my app has been getting a lot of 503 responses lately after I improved it's concurrency. So my question is: how many concurrent RSS feed requests per second do you allow?
I currently fetch the feeds every 10 minutes and parse five feeds at a time with a one-second wait in between each batch of five.

Also should I use a specific User-Agent so you can recognize my RSS parser?
 
Miku best girl
VIP
Joined
May 29, 2012
Messages
1,442
Reduce it to 3 concurrent hits, and you should be ok.
 

Users who are viewing this thread

Top