All our servers and company laptops went down at pretty much the same time. Laptops have been bootlooping to blue screen of death. It’s all very exciting, personally, as someone not responsible for fixing it.

Apparently caused by a bad CrowdStrike update.

Edit: now being told we (who almost all generally work from home) need to come into the office Monday as they can only apply the fix in-person. We’ll see if that changes over the weekend…

  • ramble81@lemm.ee
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    We had a bad CrowdStrike update years ago where their network scanning portion couldn’t handle a load of DNS queries on start up. When asked how we could switch to manual updates we were told that wasn’t possible. So we had to black hole the update endpoint via our firewall, which luckily was separate from their telemetry endpoint. When we were ready to update, we’d have FW rules allowing groups to update in batches. They since changed that but a lot of companies just hand control over to them. They have both a file system and network shim so it can basically intercept **everything **

  • witx@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    This is proof you shouldn’t invest everything in one technology. I won’t say everyone should change to Linux because it isn’t immune to this, but we need to push companies to support several OS

  • BurnSquirrel@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    I’m so exhausted… This is madness. As a Linux user I’ve busy all day telling people with bricked PCs that Linux is better but there are just so many. It never ends. I think this is outage is going to keep me busy all weekend.

  • Happywop@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    It’s Russia, or Iran or China or even our “ally” Saudi Arabia. So really, it’s time to reset the clock to pre 1989. Cut Russia and China off completely, no investment, no internet, no students no tourist nothing. These people mean and are continually doing us harm and we still plod along and some unscrupulous types become agents for personal profit. Enough.

  • Sʏʟᴇɴᴄᴇ@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    Yep, stuck at the airport currently. All flights grounded. All major grocery store chains and banks also impacted. Bad day to be a crowdstrike employee!

    • iknowitwheniseeit@lemmynsfw.com
      link
      fedilink
      English
      arrow-up
      0
      ·
      11 months ago

      My flight was canceled. Luckily that was a partner airline. My actual airline rebooked me on a direct flight. Leaves 3 hours later and arrives earlier. Lower carbon footprint. So, except that I’m standing in queue so someone can inspect my documents it’s basically a win for me. 😆

  • r00ty@kbin.life
    link
    fedilink
    arrow-up
    0
    ·
    11 months ago

    Apparently at work “some servers are experiencing problems”. Sadly, none of the ones I need to use :(

  • jedibob5@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    Huh. I guess this explains why the monitor outside of my flight gate tonight started BSoD looping. And may also explain why my flight was delayed by an additional hour and a half…

  • AutoTL;DR@lemmings.worldB
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    This is the best summary I could come up with:


    There are reports of IT outages affecting major institutions in Australia and internationally.

    The ABC is experiencing a major network outage, along with several other media outlets.

    Crowd-sourced website Downdetector is listing outages for Foxtel, National Australia Bank and Bendigo Bank.

    Follow our live blog as we bring you the latest updates.


    The original article contains 52 words, the summary contains 52 words. Saved 0%. I’m a bot and I’m open source!

  • richtellyard@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    This is going to be a Big Deal for a whole lot of people. I don’t know all the companies and industries that use Crowdstrike but I might guess it will result in airline delays, banking outages, and hospital computer systems failing. Hopefully nobody gets hurt because of it.