Yahoo Feed Reader banned

Just an FYI, I've blocked the IPs of Yahoo's feed reader (using the user agent YahooFeedSeeker). It's been abusively requesting the same URLs thousands of times a day, sometimes more then once a second. I tried adding them to robots.txt but despite downloading it hundreds of times a day, they're still ignoring it. As such, I've had no choice but to drop all traffic from their IPs. I should add, I would complain to them, but the site they point you at, http://publisher.yahoo.com/rssguide, doesn't have any feedback mechanism. Effected addresses are:

209.131.41.48, 209.131.41.49, 216.39.58.17, 216.39.58.18, 216.39.58.78

If you'd like to use Yahoo Feed Reader with the site, please post here and I'll reconsider my decision.

I should also add that this won't have any impact on the regular yahoo spider, "Yahoo! Slurp," as it comes from different addresses.

Edited on 07/28/2008 02:09 AM.

I wonder why it would hammer the site so hard for.

RSS feeds attempt to be up to date in order to be useful for their consumers. Let's say, a RSS feed is presenting data no older than 5 minutes then it has to request these data from the original source every 5 minutes at least, i. e. 24 * 12 = 288 times every day.

The problem is that Yahoo does not know whether the content has changed on CAR so it has to ask over and over again whereas Rebecca's own (locally computed) RSS feeds can deliver already customized, cached information that is only computed when a change of the CAR server's content has happened (which is probably not several hundred times a day...).

What kind of HTTP request does this reader send? Might it be satisfied with a HTTP-304 "not modified" response instead of running the computation on the CAR server? Rebecca might know quite well whether any change has been done and might be able to simply check some last modification date in order to satisfy the RSS feed's need.

Edited on 07/28/2008 11:21 AM.

Actually, the URLs they're requesting are 403 forbidden, by and large. They're broken, there's no getting around it.

aaa iam here to exchange views regarding cardcaptor sakura

can i get some revievs regarding cardcaptor sakura

I think this is the page you want: Cardcaptor Sakura.

You could either go to By Title, then look it up in alphabetical order, or type it into the "Search Titles" box, push enter, and go from there.