Router Progress!

September 14, 2005 on 10:24 am | In Updates by nate |

The router is happier, Cisco support is helping.

Ironically, it seems that netflow (a protocol for traffic analysis, which we’ve been using to help figure out what might be going wrong) might be part of the problem.

And I think I mentioned this in a comment on another article, but amidst all the other stuff that went wonky after the power was restored, the router that’s being problematic now lost its active supervisor card (which is basically a router’s CPU) early yesterday. The hot spare supervisor kicked in just like it should have, but just another fun little heartstopper!

More word when we have it!

39 Comments

  1. 1

    Things to be working great exept for mysql taking 4-ever to work. Taking over a minute to get back the info from it. Any idea when that may be up?
    Thanks

    Phil
    http://www.lowdowncustom.com

    Comment by phil — September 14, 2005 #

  2. 2

    Same problem here. At least our non-DB driven pages are loading now, and I’ve got a big red notice on our online shopping main page that says we appologize for the problems.

    - Roach

    Comment by Brian Roach — September 14, 2005 #

  3. 3

    Unfortunately all my sites use the db and so everything for me is still slow

    Comment by Sam — September 14, 2005 #

  4. 4

    My website also uses a db and is slower than a dialup connection…

    Comment by Ryan — September 14, 2005 #

  5. 5

    That’s weird because I’m having latency issues to the site, but the DB seems to be acting normal.

    Pinging dreamhost.com [66.33.201.141] with 32 bytes of data:

    Reply from 66.33.201.141: bytes=32 time=88ms TTL=50

    Reply from 66.33.201.141: bytes=32 time=87ms TTL=50

    Reply from 66.33.201.141: bytes=32 time=87ms TTL=50

    Reply from 66.33.201.141: bytes=32 time=88ms TTL=50

    Ping statistics for 66.33.201.141:

    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),

    Approximate round trip times in milli-seconds:

    Minimum = 87ms, Maximum = 88ms, Average = 87ms

    Comment by Patrick — September 14, 2005 #

  6. 6

    we’re seeing 40ms of latency and sustained 10% packet loss between our webserver and our database server. Beyond that … database query response time is … horrible, even if you’re on the mysql console. 26 seconds to return a query that would normally take, oh, less than a second.

    - Roach

    Comment by Brian Roach — September 14, 2005 #

  7. 7

    Ping from a DH web server to a DH db server:

    PING (66.33.194.154): 56 data bytes
    64 bytes from 66.33.194.154: icmp_seq=0 ttl=63 time=35.1 ms
    64 bytes from 66.33.194.154: icmp_seq=1 ttl=63 time=34.6 ms
    64 bytes from 66.33.194.154: icmp_seq=2 ttl=63 time=38.7 ms
    64 bytes from 66.33.194.154: icmp_seq=3 ttl=63 time=34.9 ms
    64 bytes from 66.33.194.154: icmp_seq=4 ttl=63 time=34.2 ms
    64 bytes from 66.33.194.154: icmp_seq=5 ttl=63 time=34.7 ms
    64 bytes from 66.33.194.154: icmp_seq=6 ttl=63 time=34.3 ms
    64 bytes from 66.33.194.154: icmp_seq=7 ttl=63 time=34.7 ms
    64 bytes from 66.33.194.154: icmp_seq=8 ttl=63 time=34.8 ms
    10 packets transmitted, 9 packets received, 10% packet loss
    round-trip min/avg/max = 34.2/35.1/38.7 ms

    Comment by GD — September 14, 2005 #

  8. 8

    Is nimitz totally down?

    Comment by Nicky — September 14, 2005 #

  9. 9

    I can ping nimitz from bourbon, but if I try to telnet to it, it doesn’t respond - you never get a login prompt.

    And the database problems aren’t getting any better. If anything, it’s getting worse. I’m getting timeouts now so our ability to sell things on the web is now pretty much nill.

    - Roach

    Comment by Brian Roach — September 14, 2005 #

  10. 10

    My actual webserver seems to be fine, but the MySQL server is indeed at dialup speeds or even slower…

    Comment by Matt — September 14, 2005 #

  11. 11

    All my sites are db driven so they are still unusable and timing out.

    Comment by Scott — September 14, 2005 #

  12. 12

    My sites are still sloooooooooooooow! What the hell is going on? It’s been like what? Two days?

    Comment by ivan raszl — September 14, 2005 #

  13. 13

    Ours as well (Can I say that without it getting deleted?)

    Comment by Roach — September 14, 2005 #

  14. 14

    Ours as well. And it doesn’t seem to be improving. (Can I say that without it getting deleted?)

    Comment by Dreamhost User — September 14, 2005 #

  15. 15

    Still going very slow over here (Belgium 11 PM CET)

    Comment by JG — September 14, 2005 #

  16. 16

    It is getting annoying now. I am getting timeouts to my domains. Any chance of an update?

    Comment by shaun — September 14, 2005 #

  17. 17

    Yeah, our site is still very slow also…I hope ya’ll are still working on it.

    Comment by Jon — September 14, 2005 #

  18. 18

    My site loads OK but any part with SQL loads slow like forums etc…. Hope they find a fix soon some of my visitors are getting annoyed along with me…. as slow loading site means slow moving income…..

    Comment by dave — September 14, 2005 #

  19. 19

    My site revolves around phpBB, so it’s slow as well.

    I backed up the MySQL database via file download today and was getting only 20k/sec down, where normally it’s over 300…

    Comment by Vlad — September 14, 2005 #

  20. 20

    our DB is also super slow!

    Comment by Anonymous — September 14, 2005 #

  21. 21

    Everything I have is working great, even the databases. I guess my databases are on a different server from everyone else experiencing problems.

    Comment by Everything is Great — September 14, 2005 #

  22. 22

    Anything having to do with MySql is creeping. i use a lot of Moveable Type, and it keeps timing out. can’t update my site very well at all. :( i know you guys are working on it. Hopefully things get worked out sometime soon. What a headache situation you guys must be going through. Ugh.

    Comment by Anonymous — September 14, 2005 #

  23. 23

    DB access is still dismally slow. My forum peeps are starting to bitch mightily. Nimitz is the server. :(

    Comment by Tony — September 14, 2005 #

  24. 24

    I know you guys are working hard, thanks for keeping us up to date, hopefully we can get this issue resolved, I can only try to understand the pain you’re going through dreamhost… although my ecommerce site is slow… i just know dreamhost is trying their best and that’s what matters… hopefully DH gets the power issue squared away after this fiasco… good luck DH!!

    - a very happy customer

    Comment by pat on the back to dreamhost — September 14, 2005 #

  25. 25

    Last update was 10:24 AM probably California time. It’s 5:14 PM in Dallas and my system response time has not gotten any better. What is actually being done? I have not gotten an update since the one this morning. With all the people I’m sure are scrambling, could you designate one person to post an update as to what action is being taken? Does this problem move up a notch in priority? Somebody………… anybody………

    Comment by Lee Rosewitz — September 14, 2005 #

  26. 26

    I was about to add to the nag session, but things seem to be improving in the last few minutes. Fingers are crossed.

    Comment by Dave — September 14, 2005 #

  27. 27

    Yep all my database driven sites are quite slow. Thanks DreamHost for working your asses off for us!

    Comment by Andrew — September 14, 2005 #

  28. 28

    Yeah, all my DB-driven sites are abysmally (sp?) slow. Visitors are starting to complain on my sites as well.

    Comment by Beth — September 14, 2005 #

  29. 29

    Same situation for me slow slow slow on my MYSQL driven sites. I am sure they are working on the issue and hopefully it is resolved SOOOOON.

    Comment by MH — September 14, 2005 #

  30. 30

    Yes, my diary is also very slow. It’s unfortunate because my self-indulgent personal thoughts mean so much to so many! I am serious!

    Comment by Gideon — September 14, 2005 #

  31. 31

    They’re working on it. Believe me, the company I used to work for resold web hosting. We had our own dedicated servers, and it was a pain then for about 20 domains. I can’t imagine 120,000! One bug and you have 512 emails. Granted it may be slow, it’s still not “down” (in most cases).

    Comment by Robert — September 14, 2005 #

  32. 32

    my site seems to improve now
    i am using vbulletin and with the help of speed up performance, the site loading okie but still slow though

    anyway, hope they will get it resolve soon

    Comment by ryan — September 14, 2005 #

  33. 33

    Robert makes a good point. I should have included in my comment that I actually love DreamHost–just to make clear that I wasn’t trying to come off as extremely disparaging.

    Comment by Gideon — September 14, 2005 #

  34. 34

    Yeah, it is frustrating, but where else do you get such a full feature service with ssh for the price. Perhaps they should put some google ads on the emergency page- would pay for a new router ;)

    an update would be nice though

    Comment by Shaun — September 14, 2005 #

  35. 35

    Not to be Captain Obvious to all you people here, but they are WELL aware of the problems. Everyone likes to bitch about all their problems, but thats not going to make them work any faster then they already are. This wasn’t your usual power outage, and I am sure there are residual effects even after stuff is up and running that you have to deal with. Hindsight is always 20/20. Instead of giving them complaints, why not commend them on the excellent job that they have done so far in promply getting all the processes up and running that they could safely. It takes alot of work to run a hosting company.

    I personally commend them for what they have done, and their quick response in trying to get everyone going again in the safest possible way.

    Comment by dmacgavin — September 14, 2005 #

  36. 36

    i’d personally give DH a beer right now if i could… it’s stressful not getting any sleep i’m sure for some ppl over at DH.. keep up the good work fellas!!

    Comment by pat on the back to dreamhost — September 14, 2005 #

  37. 37

    Looks like speeds are starting to return to normal. WTG DH.

    Comment by jsterling — September 14, 2005 #

  38. 38

    Looks like things are getting better. Keep up the good work guys!

    Comment by Patrick — September 14, 2005 #

  39. 39

    All things are working great now!
    Thanks!
    Phil

    Comment by phil — September 15, 2005 #

Sorry, the comment form is closed at this time.

Powered by WordPress. Pool theme by Borja Fernandez, modified by DreamHost.
Entries and comments feeds. ^Top^