• Railcar8095@lemmy.world
      link
      fedilink
      arrow-up
      15
      ·
      3 months ago

      My ex company had for more than 10 years keept all the data customers shared with us. Structured and standardized, should have been easy peasy.

      Somehow they were “appending wrong” in some way and data was useless. In think they were trying to reduce the size by aggregating a bit, but they did in a way that rendered the data useless.

      Of course the CEO wanted to train models with it anyway…

      • unphazed@lemmy.world
        link
        fedilink
        arrow-up
        5
        ·
        3 months ago

        10 years and no one bothered to pull some information at random? I mean generally companies have a schedule of assessments to ensure records. Even if it’s as simple as checksum.

        • Railcar8095@lemmy.world
          link
          fedilink
          arrow-up
          3
          ·
          3 months ago

          The thing is they had data that expected to be slightly aggregated, do not a 1:1. The problem comes when you try to use the data for analysis and realize it didn’t make any sense

    • Ephera@lemmy.ml
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 months ago

      I doubt anyone said it verbatim, but it happens that they’re deemed lower priority ad infinitum.

  • Maerman@lemmy.world
    link
    fedilink
    arrow-up
    26
    ·
    3 months ago

    So I have lived in South Korea for 6 years now. The fact that this fire has had such a major impact is quite typical of Korean bureaucracy and tech administration. Very few backups, infrastructure held together with scotch tape and bubblegum, overworked devs and maintainers. It’s a bit sad, especially for a country that exports so many tech products.

    • marcos@lemmy.world
      link
      fedilink
      arrow-up
      18
      ·
      3 months ago

      Last time we lost disks at work, there were full backups.

      They were just in the same disks as the data. And because everything is abstracted two times into virtual disks on virtual machines, and containers and volumes, the people responsible for the backups didn’t even know it.

  • shalafi@lemmy.world
    link
    fedilink
    English
    arrow-up
    9
    ·
    3 months ago

    I collect stories like this for when I need to make a case for purchasing new gear or services.

  • Justas🇱🇹@sh.itjust.works
    link
    fedilink
    arrow-up
    3
    ·
    3 months ago

    In Lithuania, healthcare e-services went down after the basement where the servers were kept got flooded in a rainstorm. They went down for a couple of weeks.