Hmm... this really sucks

DainDain
in NintendoAge News
So if you haven't noticed yet, we've down a chunk of today and last night. In response to this, I updated the site with code that I felt 99% sure would resolve the memory issues we're having. After only 2 hours of this, it's apparent that my assumption was incorrect. The culprit is Google, but there's no reason why the site shouldn't handle their crawlers just fine -- they've been crawling us now for months without any problems. Now, however, they've literally got 10-30 crawlers running almost non-stop, and it's as if they've completely ignored my crawl delay directives in Robots.txt.

I thought the main issue was the creation of "ghost" sessions by these bots. It appears now that that's not the case, as we're not even using session management in the traditional sense.

I'll keep ya updated.

-Dain

Comments

  • collectinisgamecollectinisgame
    the MY HOME option isn't working for me.



    didn't know if this was known.



    hope everything is easily worked out.
  • DainDain
    Nothing except for the forums will be functional until I can get this resolved.
  • NOFRIENDO-bannedNOFRIENDO-banned
    Originally posted by: Dain

    Nothing except for the forums will be functional until I can get this resolved.



    As long as the forum is up thats cool.Thanks again for all your hard work Dain!!!
  • collectinisgamecollectinisgame
    cool, yeah thnx dain.



  • bunnyboybunnyboy
    Just let us know how much $$$ you need for another 4GB of ram!
  • DainDain
    Heh, you're not kidding. That's actually the amount I was going to request. I'm not sure what it'll cost, but I'll find out. Oh and by the way, this was posted via NA mobile image
  • KHAN GamesKHAN Games
    Yeah, you should really think about accepting donations to keep this site running. I doubt many people would have any trouble forking over a few bucks each month to keep this site tip top.
  • xARSEFACExxARSEFACEx
    Another forum I post in has a "supporting member" feature. You pay $30 a year and have access to an exclusive subforum and other perks, all while supporting the site. It works really well.
  • NewUser123456789NewUser123456789
    Dain, I would help contribute for both the RAM and site costs..



    I really think donations for the site would take off...
  • arch_8ngelarch_8ngel
    This is probably one of the best sites I visit that doesn't have a "Donate via Paypal" link at the top.

    It really wouldn't be out of place.



    Or "Donate via Google Checkout" or whatever is cheapest.



    You really do provide a great service that deserves at least a little support from the longer standing members like myself.
  • qixmasterqixmaster
    show me the link and you get the money.
  • bongobenbongoben
    I would definitely throw down a bit of money to help you out. I do like the idea of having a private forum exclusively for those who donate. Maybe like a yearly membership but I don't know kind of forum space or content could be exclusive for those who went that route. I don't know if people would be interested in something like a private buy, sell, trade section or something of that sort. Nevermind... image
  • projectingstarsprojectingstars
    I would gladly to donate to NA!
  • DainDain
    Well, after a lot of consideration, I've decided to add a donations area. More info, here:



    http://www.nintendoage.com/index.cfm?FuseAction=Donations.Home
  • qixmasterqixmaster
    DONATE PEOPLE! Let's keep this site growing!
  • xARSEFACExxARSEFACEx
    LOl- Dain did you not have big bills to give bunnyboy for his donation icon and have to give him small bills instead?
  • DainDain
    He he! Well, it was a special request... he asked if he could have all 3 icons! image
  • DainDain
    And in true bunnyboy style, he sent 3 separate donations
  • NationalGameDepotNationalGameDepot
    hmmmm I may have to do the same thing image I loves me icons. I will prob get one for ditka after it gets released so that will be the homebrew one, then I will just have to track down the artist and all the donations ones image hehe

    ~~NGD
  • xARSEFACExxARSEFACEx
    Originally posted by: NationalGameDepot

    hmmmm I may have to do the same thing image
    I loves me icons. I will prob get one for ditka after it gets released
    so that will be the homebrew one, then I will just have to track down
    the artist and all the donations ones image hehe

    ~~NGD


    Send Dain one of those little tests that you see on television where you have to draw the pirate and the turtle. I don't see how he could deny you an artists icon after that.
Sign In or Register to comment.