LA Voice / Dreamhost down

Mack Reed who has had far more than his fair share of server downtimes over at LAVoice writes in to say that once again, Dreamhost is down, therefor so is LA Voice. Around 7 PM dreamhost posted this:

Today’s network problems were caused by not 1, not 2, not even 3, but 4 separate issues.

First, one of our older distribution switches decided to give up on life.
After replacing it with newer hardware, everything ran just fine for a couple hours. Then, it decided our network topology had changed (apparently due to a different default configuration since the old days when it was deployed), and started dropping a good percentage of traffic.
This issue also affected another switch that some of our file servers plug into, so customer data was unavailable to a good portion of our hosting servers.
Consequently, one of our more active mail servers tried to dump all of the backed up email all at once, saturating some of the network that it’s on.
Once these configuration issues were resolved, one of the network interface cards in our main firewall machine died, requiring a quick swap.

We’re still working on some of the after-effects, and there may be some slowness while things get caught up, but everything should be back to normal later tonight.

Looks like things are still totally down over there, which is a few steps worse than “some slowness” if you ask me. Might I take this moment to recommend Server Beach?

UPDATE: Tuesday, 5:30am – it’s back up!

9 thoughts on “LA Voice / Dreamhost down”

  1. Thanks for the note, Sean, and thanks for your patience, anyone who uses the site.

    I’ll be pursuing a hosting change first thing Tuesday.

  2. Hey .. thanks for the upadte. I couldn’t get my LA VOICE fix this evening. I have the LA VOICE DTs

  3. Mack:

    While frustrating for you, it also makes it abundantly clear to all of us that the chorus is incomplete without an LAVoice.

    Best wishes. Please let us know if and how we might help.

    Respectfully Yours in Safety and Service,

    Brian Humphrey
    Public Service Officer
    Los Angeles Fire Department

Comments are closed.