-
Make use of HTTP cache. Send
Etag
andLastModified
headers. Recognize304 Not modified
response. This way you can save a lot of bandwidth. Additionally some scripts recognize theLastModified
header and return only partial contents (ie. only the two or three newest items instead of all 30 or so). -
Don’t poll RSS from services that supports RPC Ping (or other PUSH service, such as PubSubHubbub). I.e. if you’re receiving PUSH notifications from a service, you don’t have to poll the data in the standard interval — do it once a day to check if the mechanism still works or not (ping can be disabled, reconfigured, damaged, etc). This way you can fetch RSS only on receiving notification, not every hour or so.
-
Check the TTL (in RSS) or cache control headers (
Expires
in ATOM), and don’t fetch until resource expires. -
Try to adapt to frequency of new items in each single RSS feed. If in the past week there were only two updates in particular feed, don’t fetch it more than once a day. AFAIR Google Reader does that.
-
Lower the rate at night hours or other time when the traffic on your site is low.
-
At last, do it once a hour. 😉