Router Progress!

September 14, 2005 on 10:24 am | In Updates by nate | 39 Comments

The router is happier, Cisco support is helping.

Ironically, it seems that netflow (a protocol for traffic analysis, which we’ve been using to help figure out what might be going wrong) might be part of the problem.

And I think I mentioned this in a comment on another article, but amidst all the other stuff that went wonky after the power was restored, the router that’s being problematic now lost its active supervisor card (which is basically a router’s CPU) early yesterday. The hot spare supervisor kicked in just like it should have, but just another fun little heartstopper!

More word when we have it!

39 Responses to “Router Progress!”

  1. phil Says:

    Things to be working great exept for mysql taking 4-ever to work. Taking over a minute to get back the info from it. Any idea when that may be up?
    Thanks

    Phil
    http://www.lowdowncustom.com

  2. Brian Roach Says:

    Same problem here. At least our non-DB driven pages are loading now, and I’ve got a big red notice on our online shopping main page that says we appologize for the problems.

    - Roach

  3. Sam Says:

    Unfortunately all my sites use the db and so everything for me is still slow

  4. Ryan Says:

    My website also uses a db and is slower than a dialup connection…

  5. Patrick Says:

    That’s weird because I’m having latency issues to the site, but the DB seems to be acting normal.

    Pinging dreamhost.com [66.33.201.141] with 32 bytes of data:

    Reply from 66.33.201.141: bytes=32 time=88ms TTL=50

    Reply from 66.33.201.141: bytes=32 time=87ms TTL=50

    Reply from 66.33.201.141: bytes=32 time=87ms TTL=50

    Reply from 66.33.201.141: bytes=32 time=88ms TTL=50

    Ping statistics for 66.33.201.141:

    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),

    Approximate round trip times in milli-seconds:

    Minimum = 87ms, Maximum = 88ms, Average = 87ms

  6. Brian Roach Says:

    we’re seeing 40ms of latency and sustained 10% packet loss between our webserver and our database server. Beyond that … database query response time is … horrible, even if you’re on the mysql console. 26 seconds to return a query that would normally take, oh, less than a second.

    - Roach

  7. GD Says:

    Ping from a DH web server to a DH db server:

    PING (66.33.194.154): 56 data bytes
    64 bytes from 66.33.194.154: icmp_seq=0 ttl=63 time=35.1 ms
    64 bytes from 66.33.194.154: icmp_seq=1 ttl=63 time=34.6 ms
    64 bytes from 66.33.194.154: icmp_seq=2 ttl=63 time=38.7 ms
    64 bytes from 66.33.194.154: icmp_seq=3 ttl=63 time=34.9 ms
    64 bytes from 66.33.194.154: icmp_seq=4 ttl=63 time=34.2 ms
    64 bytes from 66.33.194.154: icmp_seq=5 ttl=63 time=34.7 ms
    64 bytes from 66.33.194.154: icmp_seq=6 ttl=63 time=34.3 ms
    64 bytes from 66.33.194.154: icmp_seq=7 ttl=63 time=34.7 ms
    64 bytes from 66.33.194.154: icmp_seq=8 ttl=63 time=34.8 ms
    10 packets transmitted, 9 packets received, 10% packet loss
    round-trip min/avg/max = 34.2/35.1/38.7 ms

  8. Nicky Says:

    Is nimitz totally down?

  9. Brian Roach Says:

    I can ping nimitz from bourbon, but if I try to telnet to it, it doesn’t respond – you never get a login prompt.

    And the database problems aren’t getting any better. If anything, it’s getting worse. I’m getting timeouts now so our ability to sell things on the web is now pretty much nill.

    - Roach

  10. Matt Says:

    My actual webserver seems to be fine, but the MySQL server is indeed at dialup speeds or even slower…

  11. Scott Says:

    All my sites are db driven so they are still unusable and timing out.

  12. ivan raszl Says:

    My sites are still sloooooooooooooow! What the hell is going on? It’s been like what? Two days?

  13. Roach Says:

    Ours as well (Can I say that without it getting deleted?)

  14. Dreamhost User Says:

    Ours as well. And it doesn’t seem to be improving. (Can I say that without it getting deleted?)

  15. JG Says:

    Still going very slow over here (Belgium 11 PM CET)

  16. shaun Says:

    It is getting annoying now. I am getting timeouts to my domains. Any chance of an update?

  17. Jon Says:

    Yeah, our site is still very slow also…I hope ya’ll are still working on it.

  18. dave Says:

    My site loads OK but any part with SQL loads slow like forums etc…. Hope they find a fix soon some of my visitors are getting annoyed along with me…. as slow loading site means slow moving income…..

  19. Vlad Says:

    My site revolves around phpBB, so it’s slow as well.

    I backed up the MySQL database via file download today and was getting only 20k/sec down, where normally it’s over 300…

  20. Anonymous Says:

    our DB is also super slow!

  21. Everything is Great Says:

    Everything I have is working great, even the databases. I guess my databases are on a different server from everyone else experiencing problems.

  22. Anonymous Says:

    Anything having to do with MySql is creeping. i use a lot of Moveable Type, and it keeps timing out. can’t update my site very well at all. :( i know you guys are working on it. Hopefully things get worked out sometime soon. What a headache situation you guys must be going through. Ugh.

  23. Tony Says:

    DB access is still dismally slow. My forum peeps are starting to bitch mightily. Nimitz is the server. :(

  24. pat on the back to dreamhost Says:

    I know you guys are working hard, thanks for keeping us up to date, hopefully we can get this issue resolved, I can only try to understand the pain you’re going through dreamhost… although my ecommerce site is slow… i just know dreamhost is trying their best and that’s what matters… hopefully DH gets the power issue squared away after this fiasco… good luck DH!!

    - a very happy customer

  25. Lee Rosewitz Says:

    Last update was 10:24 AM probably California time. It’s 5:14 PM in Dallas and my system response time has not gotten any better. What is actually being done? I have not gotten an update since the one this morning. With all the people I’m sure are scrambling, could you designate one person to post an update as to what action is being taken? Does this problem move up a notch in priority? Somebody………… anybody………

  26. Dave Says:

    I was about to add to the nag session, but things seem to be improving in the last few minutes. Fingers are crossed.

  27. Andrew Says:

    Yep all my database driven sites are quite slow. Thanks DreamHost for working your asses off for us!

  28. Beth Says:

    Yeah, all my DB-driven sites are abysmally (sp?) slow. Visitors are starting to complain on my sites as well.

  29. MH Says:

    Same situation for me slow slow slow on my MYSQL driven sites. I am sure they are working on the issue and hopefully it is resolved SOOOOON.

  30. Gideon Says:

    Yes, my diary is also very slow. It’s unfortunate because my self-indulgent personal thoughts mean so much to so many! I am serious!

  31. Robert Says:

    They’re working on it. Believe me, the company I used to work for resold web hosting. We had our own dedicated servers, and it was a pain then for about 20 domains. I can’t imagine 120,000! One bug and you have 512 emails. Granted it may be slow, it’s still not “down” (in most cases).

  32. ryan Says:

    my site seems to improve now
    i am using vbulletin and with the help of speed up performance, the site loading okie but still slow though

    anyway, hope they will get it resolve soon

  33. Gideon Says:

    Robert makes a good point. I should have included in my comment that I actually love DreamHost–just to make clear that I wasn’t trying to come off as extremely disparaging.

  34. Shaun Says:

    Yeah, it is frustrating, but where else do you get such a full feature service with ssh for the price. Perhaps they should put some google ads on the emergency page- would pay for a new router ;)

    an update would be nice though

  35. dmacgavin Says:

    Not to be Captain Obvious to all you people here, but they are WELL aware of the problems. Everyone likes to bitch about all their problems, but thats not going to make them work any faster then they already are. This wasn’t your usual power outage, and I am sure there are residual effects even after stuff is up and running that you have to deal with. Hindsight is always 20/20. Instead of giving them complaints, why not commend them on the excellent job that they have done so far in promply getting all the processes up and running that they could safely. It takes alot of work to run a hosting company.

    I personally commend them for what they have done, and their quick response in trying to get everyone going again in the safest possible way.

  36. pat on the back to dreamhost Says:

    i’d personally give DH a beer right now if i could… it’s stressful not getting any sleep i’m sure for some ppl over at DH.. keep up the good work fellas!!

  37. jsterling Says:

    Looks like speeds are starting to return to normal. WTG DH.

  38. Patrick Says:

    Looks like things are getting better. Keep up the good work guys!

  39. phil Says:

    All things are working great now!
    Thanks!
    Phil

Powered by WordPress. Pool theme by Borja Fernandez, modified by DreamHost.
Like WordPress? Consider attending WordCamp LA.
Entries and comments feeds. ^Top^