collapse

* User Info

 
 
Welcome, Guest. Please login or register.
Did you miss your activation email?

* Random Image

agbv154

agbv154

* Search


* Recent Topics

* Shoutbox

Refresh History
  • Biollante: play*
    Today at 09:53:53 AM
  • Biollante: oops looks like 59 percent of african americans support gay marriage, great job conservo-think tanks, your attempt to paly minorities against eachother fell flat on its face
    Today at 09:53:30 AM
  • Steveinthecity: You should have seen the commotion caused years ago when Susan Richards was drawn with a new hairstyle.
    Today at 02:19:44 AM
  • PTF: Thor's hammer has fan club? :)
    Yesterday at 05:55:58 PM
  • Banshee: Because we fans take our favorite stuff seriously, that is why.
    Yesterday at 01:38:07 PM
  • PTF: It's a magic hammer. It doesn't have to make sense. :)
    Yesterday at 11:54:00 AM
  • Steveinthecity: I wonder why it's always readers that catch mistakes with art, powers, plots, continuity, uniforms, etc. and not the creators and editors?  I hope they're not secretly laughing at us. ;)
    Yesterday at 05:09:43 AM
  • Steveinthecity: When Thor pulls the hammer back to throw, his momentum stops. He has always been able to float or hover once airborne, and he'll remain until the hammer comes back to him.  I guess the winds keep him aloft.
    Yesterday at 05:05:34 AM
  • Biollante: ok so shouldn't Joe Quesada know that? lol  It made him look a bit stupid imo.
    May 21, 2012, 07:57:37 AM
  • Jabroniville: Yeah, that's odd- Thor usually has the Hammer out in front. Though I don't think it's ever explained how he can throw it while in mid-flight and not just plummet like a goof. I wish artists would stop having him do things like that :)
    May 21, 2012, 07:23:13 AM
  • Steveinthecity: @Biolante:  Thor uses the hammer to fly. He can throw his hammer during flight and float in one spot until the hammer returns to him. Don't know what Joe Q. was thinking there. I've never seen Thor fly on his own.
    May 21, 2012, 12:59:03 AM
  • NineZero09: How the world can be...and the universe can be.
    May 21, 2012, 12:32:36 AM
  • NineZero09: I watched the annular solar eclipse, but partial at where I live.
    May 21, 2012, 12:32:21 AM
  • NineZero09: Sad to read about Donna Summer and Robin Gibb passed away.
    May 21, 2012, 12:32:05 AM
  • comicsrod: As You may know Tonight of some Sad News the Robin Gibb 1/3 members of the fame Disco Group The Bee Gees has Passed Away at the age of 62 our Hearts go out to the only Survivor Bee Gees member Barry Gibb & His Family and his Music and Hollywood Friends as we Remember the Music Superstar he will be miss very much   ROBIN GIBB 1949-2012
    May 20, 2012, 10:20:12 PM
  • Biollante: Joe Quesada was drawing Thor on some Disney promo, and he drew him flying with his hammer on his side, now I'm not a Thor junkie, but isn't that actualy inaccurate, doesn't he fly by being dragged by his hammer???
    May 20, 2012, 08:54:59 PM
  • Tuxedo Mark: R.I.P., Robin Gibb. :(
    May 20, 2012, 08:19:21 PM
  • Biollante: I'm just glad he's giving back to his fans by revisiting Blade Runner and Alien with Prometheus, I'm sure he's going to deliver too, his legacy as a film maker is on the line since those are his more iconic films
    May 20, 2012, 11:38:08 AM
  • Biollante: aesthetics*
    May 20, 2012, 10:58:08 AM
  • Biollante: gonna be hard for anyting to catch up, Ridley Scott is pretty much the top of dark visual design imo, and he drew a lot from Moebius for that film, most fillm makers are not really connected to aestheticas of good fantasy film making in the same way
    May 20, 2012, 10:55:18 AM

« previous next »
Pages: [1]   Go Down

Author Topic: The Cause of Slowness/Downtime on the Site  (Read 941 times)

0 Members and 1 Guest are viewing this topic.

Offline Biollante

The Cause of Slowness/Downtime on the Site
« on: October 11, 2011, 08:41:27 PM »
Noticed the site is sometimes slow to repsond.  Other times it goes down entirely for a little while.  I think the cause is pretty obvious.  It's all those Chinese search engine spiders, most of which appear to be identified as Baidu spiders.  I've had similar problems at a forum I run.  Blocking the Chinese spider IPs with wild cards (*) always did the trick.  These spiders are known for indexing everything on a website thousands of times over and over again.  This can eat up server resources and cause the host to respond with pre-programmed downtimes.
Report to moderator   Logged

Online aamrun

Re: The Cause of Slowness/Downtime on the Site
« Reply #1 on: October 12, 2011, 01:56:57 AM »
Quote from: Ghidra on October 11, 2011, 08:41:27 PM
Noticed the site is sometimes slow to repsond.  Other times it goes down entirely for a little while.  I think the cause is pretty obvious.  It's all those Chinese search engine spiders, most of which appear to be identified as Baidu spiders.  I've had similar problems at a forum I run.  Blocking the Chinese spider IPs with wild cards (*) always did the trick.  These spiders are known for indexing everything on a website thousands of times over and over again.  This can eat up server resources and cause the host to respond with pre-programmed downtimes.

But won't that deprive Chinese net users from this site ? China has a lot of restrictions as it is and Govt. approved sites are their only way to the outside world.

That said, I agree that repeated indexing does need to be checked.
Report to moderator   Logged

Offline Biollante

Re: The Cause of Slowness/Downtime on the Site
« Reply #2 on: October 12, 2011, 02:27:26 AM »
Quote from: aamrun on October 12, 2011, 01:56:57 AM
Quote from: Ghidra on October 11, 2011, 08:41:27 PM
Noticed the site is sometimes slow to repsond.  Other times it goes down entirely for a little while.  I think the cause is pretty obvious.  It's all those Chinese search engine spiders, most of which appear to be identified as Baidu spiders.  I've had similar problems at a forum I run.  Blocking the Chinese spider IPs with wild cards (*) always did the trick.  These spiders are known for indexing everything on a website thousands of times over and over again.  This can eat up server resources and cause the host to respond with pre-programmed downtimes.

But won't that deprive Chinese net users from this site ? China has a lot of restrictions as it is and Govt. approved sites are their only way to the outside world.

That said, I agree that repeated indexing does need to be checked.

I don't think anyone from mainland China is interested in Archie Comics.  Maybe the Philippines, Japan, and some other nations, but not China.  In fact, I think China just banned all American entertainment.  US movies and music are no longer allowed there.

So the trade-off here is the slim chance that someone may use an extremely obscure (as far as English content goes) non-English search engine versus the site running faster and being up more.  I think the choice here is pretty obvious.  Baidu spiders are pretty notorious for being designed maliciously eat up bandwidth.  They operate under rules that Google and Yahoo couldn't get away with.
Report to moderator   Logged

Online aamrun

Re: The Cause of Slowness/Downtime on the Site
« Reply #3 on: October 12, 2011, 05:26:39 AM »
Quote from: Ghidra on October 12, 2011, 02:27:26 AM
Quote from: aamrun on October 12, 2011, 01:56:57 AM
Quote from: Ghidra on October 11, 2011, 08:41:27 PM
Noticed the site is sometimes slow to repsond.  Other times it goes down entirely for a little while.  I think the cause is pretty obvious.  It's all those Chinese search engine spiders, most of which appear to be identified as Baidu spiders.  I've had similar problems at a forum I run.  Blocking the Chinese spider IPs with wild cards (*) always did the trick.  These spiders are known for indexing everything on a website thousands of times over and over again.  This can eat up server resources and cause the host to respond with pre-programmed downtimes.

But won't that deprive Chinese net users from this site ? China has a lot of restrictions as it is and Govt. approved sites are their only way to the outside world.

That said, I agree that repeated indexing does need to be checked.

I don't think anyone from mainland China is interested in Archie Comics.  Maybe the Philippines, Japan, and some other nations, but not China.  In fact, I think China just banned all American entertainment.  US movies and music are no longer allowed there.

So the trade-off here is the slim chance that someone may use an extremely obscure (as far as English content goes) non-English search engine versus the site running faster and being up more.  I think the choice here is pretty obvious.  Baidu spiders are pretty notorious for being designed maliciously eat up bandwidth.  They operate under rules that Google and Yahoo couldn't get away with.

Hmmm, very harsh assessment of China especially when almost all of Archie Comics download links are found on Chinese sites.

Also banning something has the wonderful effect of spiking interest in that particular thing :)
Report to moderator   Logged

Offline Oldiesmann

Re: The Cause of Slowness/Downtime on the Site
« Reply #4 on: October 18, 2011, 11:57:44 AM »
Baidu isn't the only search engine in China, so I don't think blocking it will cause any problems as far as Chinese users being able to find this site. I'm not going to block the entire country of China though. I will do some more research as far as the best way to block Baidu, as there are conflicting reports about whether it actually follows standards for telling search engines what they can or cannot do. I have heard complaints from other forum owners about its aggressiveness as well.
Report to moderator   Logged
Michael "Oldiesmann" Eshom
Webmaster/Site Owner
Archie fan since the 1980s

Check out my other sites!
http://www.oldiesmann.us
http://www.christianindieforums.com

Online aamrun

Re: The Cause of Slowness/Downtime on the Site
« Reply #5 on: October 19, 2011, 01:00:55 AM »
Is it possible to set a limit on the spiders from a particular domain ? I am just bouncing off ideas here. It may be difficult since these spiders can hide behind IPs from all over the world.
Report to moderator   Logged

Offline Oldiesmann

Re: The Cause of Slowness/Downtime on the Site
« Reply #6 on: October 19, 2011, 02:25:16 PM »
I've managed to stop them for now. I completely blocked the entire IP range that they were using here. There is no way to limit how often they visit your site to my knowledge.
Report to moderator   Logged
Michael "Oldiesmann" Eshom
Webmaster/Site Owner
Archie fan since the 1980s

Check out my other sites!
http://www.oldiesmann.us
http://www.christianindieforums.com

Offline Biollante

Re: The Cause of Slowness/Downtime on the Site
« Reply #7 on: October 19, 2011, 03:42:15 PM »
Quote from: Oldiesmann on October 19, 2011, 02:25:16 PM
I've managed to stop them for now. I completely blocked the entire IP range that they were using here. There is no way to limit how often they visit your site to my knowledge.

Blocking their IPs like that should do it.  That is until they start using completely new IPs, but it should work for a long while at least from my experience.  Good work, Oldiesman!
Report to moderator   Logged

Online aamrun

Re: The Cause of Slowness/Downtime on the Site
« Reply #8 on: October 20, 2011, 01:21:30 AM »
I still see one Baidu, though it's a big drop from the previous numbers.
Report to moderator   Logged

Offline Oldiesmann

Re: The Cause of Slowness/Downtime on the Site
« Reply #9 on: October 20, 2011, 03:06:53 AM »
I don't see any right now, but if it shows up again, I'll block that one as well.
Report to moderator   Logged
Michael "Oldiesmann" Eshom
Webmaster/Site Owner
Archie fan since the 1980s

Check out my other sites!
http://www.oldiesmann.us
http://www.christianindieforums.com
Pages: [1]   Go Up
« previous next »
 

Related Topics

  Subject / Started by Replies Last post
14 Replies
3520 Views 		Last post April 16, 2008, 11:54:56 PM
by IM WITH JUGHEAD
0 Replies
850 Views 		Last post October 22, 2010, 03:49:59 PM
by Oldiesmann
9 Replies
425 Views 		Last post March 26, 2012, 01:02:04 AM
by Oldiesmann


The Archie character names and likenesses are covered by the registered trademarks/copyrights of Archie Comic Publications, Inc. and are used with permission by this site. The Official Archie Comics website can be visited at www.archiecomics.com.