Koozali.org: home of the SME Server

Contribs.org Forums => General Discussion => Topic started by: kevinb on February 13, 2008, 05:49:50 AM

Title: Forums and Wiki - Service Temporarily Unavailable
Post by: kevinb on February 13, 2008, 05:49:50 AM
I really appreciate all the effort that is put into keeping the forums and wiki running smoothly.

One thing that I have found very frustrating is the rather low limit (for me anyway) of hits I can make before I get:

Quote
Service Temporarily Unavailable
The bwshare module will refuse your requests for the next 44 seconds.
You have made too many requests per second.

I understand why this is neccessary but can we get the threashold bumped up a bit. I can never get through the daily unread messages before I get punished.

Thank you,


Kevin
Title: Re: Forums and Wiki - Service Temporarily Unavailable
Post by: william_syd on February 13, 2008, 07:03:33 AM


Wouldn't the limit be the same for everyone.

I've never received that message.

Title: Re: Forums and Wiki - Service Temporarily Unavailable
Post by: pfloor on February 13, 2008, 07:25:43 AM
Kevinb must be a speed reader :-)

I have never encountered this either.

I'll look into it.
Title: Re: Forums and Wiki - Service Temporarily Unavailable
Post by: imcintyre on February 13, 2008, 12:52:35 PM
I have never seen this message but I have had pages partially load and have to hit the refresh button several times before the complete page is loaded. I was using IE when this happened.
Title: Re: Forums and Wiki - Service Temporarily Unavailable
Post by: Normando on February 13, 2008, 01:06:40 PM
I was receive this message, but only when use a web-developers toolbar in FF and edit CSS online. Maybe a lot of request from this toolbar was made.
Title: Re: Forums and Wiki - Service Temporarily Unavailable
Post by: slords on February 13, 2008, 04:11:07 PM
I understand why this is neccessary but can we get the threashold bumped up a bit. I can never get through the daily unread messages before I get punished.

I've played with and tuned the thresholds to be as tolerant as I can to achieve a fine balance between stopping those that wish to abuse the bandwidth of contribs.org and not blocking those that are here to just view the site.

Just to give you some numbers for the last week:

4,265,842 hits
   22,674 blocks (0.5% of all hits)
   10,760 blocks to non-abusers (0.25% of all hits)

That would mean that you are in  the very small minority.  Looking through the logs you seem to be requesting a new page about every 2-3 seconds for 2-3 minutes straight.  That is some extremely fast reading on your part.  :shock:

The limiting/blocking measures have cut the total bandwidth drain on contribs to about 1/10 what it was a year ago.  Most of that bandwidth drain was people trying to mirror/suck/scrape the entire site.  We had 20+ individuals attempting to do this; some as often as every 6 hours.  That was slowing down the site and eating up all the bandwidth for people that were legitimately trying to browse the site.

Contribs.org now contains over 5GB of data.  Even if those 20 individuals only tried once a week to download the entire site that would account for over 500GB/month.  Asuming that contribs is hosted on a dedicated T1 (150KB/s) it would take 41 days to achieve that 500GB.

So basically without any measures in place the abusers were taking/fighting for all available bandwitdh they could have all month long.  Measures have been put in place to stop that and the very small (0.25%) of requests that get blocked are more then worth the benefit that is gained for the rest of the community.

If you feel otherwise please speak up.
Title: Re: Forums and Wiki - Service Temporarily Unavailable
Post by: cactus on February 13, 2008, 04:23:57 PM
I understand why this is neccessary but can we get the threashold bumped up a bit. I can never get through the daily unread messages before I get punished.
Do you have something like fasterfox or other caching plugins enbaled? Perhaps they try to pre-load/pre-fetch a lot of pages linked from the page you are watching and that might cause the issues being locked out for a while.

I have more than enough time to read all messages for a day and was once blocked as I was upgrading an old SME 7 server alongside a test upgrade of SME 7 to SME 8 and reading and modifying the wiki, while having multiple forum pages open.

To cut things short as slords already stated, you will have to do a lot to reach to be locked out for a while and it almost certainly will not be done by browsing the forums in a normal way.
Title: Re: Forums and Wiki - Service Temporarily Unavailable
Post by: kevinb on February 13, 2008, 04:38:55 PM
My issue maybe with the way I open the posts. I browse my unread posts and open in another tab the ones I am interested in. After I have completed this then I go read the ones I  opened. Hence I would have rapidly opened several posts.

I guess I have to change my ways. Even though it would be much easier for the rest of the world to change!  ;-)

Kevin