• Gsus4@mander.xyz
    link
    fedilink
    English
    arrow-up
    5
    ·
    2 hours ago

    Well, at least the datahoarders can preserve some things when it all goes to shit…

    • UnderpantsWeevil@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      1 hour ago

      90% of Spotify is trash. Much like Audible, it’s just choking on AI generated content and similar worthless vanity projects

  • morto@piefed.social
    link
    fedilink
    English
    arrow-up
    26
    arrow-down
    1
    ·
    5 hours ago

    It would be awesome if we had an app that allowed to stream directly from such torrents, and had a user-made recommendation system to replace the discovery algorithm :D

    • Bizzle@lemmy.world
      link
      fedilink
      English
      arrow-up
      19
      arrow-down
      1
      ·
      4 hours ago

      Stremio + Torrentio does this for TV but I haven’t found an equivalent for music. Hoping to be proven wrong 🤞

      • WhiteOakBayou@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        49 minutes ago

        Something as easy as stremio but for music. Connect to listenbrainz instead of trakt. Then only serve from the spotify collection because of their extensive metadata. With multi device sign in and syncing like stremio. Then a Kodi add on for the libreelec people.

    • nutsack@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      7
      ·
      edit-2
      4 hours ago

      data hoarders already have everything in here and far more, and the web release versions are a lower priority. thinking of red.sh here

  • blitzen@lemmy.ca
    link
    fedilink
    English
    arrow-up
    76
    arrow-down
    8
    ·
    9 hours ago

    As far as I’ve read, the database is largely low bitrate files, and some AI. The value here is metadata and preservation of “rare” music.

    • hietsu@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      27
      ·
      edit-2
      6 hours ago

      Nope, I would not call 160kbps Vorbis low bitrate, it’s roughly quality of 192kbps MP3. Only the ”popularity=0” stuff (so stuff with so few listens that Spotify does not keep record of) were re-encoded to 75kbps Opus, which as a modern codec is much better than it sounds like but of course re-encode is not great for already lossless stuff.

      For purists there are those Tidal downloader sites available everywhere for free lossless music, even 24-bit hires FLAC.

      • blitzen@lemmy.ca
        link
        fedilink
        English
        arrow-up
        6
        arrow-down
        1
        ·
        4 hours ago

        Opus is what I’m encoding my working library to. I like ripping to flac (and archiving them as such), but the advantages to smaller file sizes for the working library are worth it for me. So far, I’m really liking the format.

        I keep the archive on spinning hard drives, but the opus library on ssd (which makes browsing much quicker, and no unnecessary spinning up the hard drives.)

    • selokichtli@lemmy.ml
      link
      fedilink
      English
      arrow-up
      12
      ·
      5 hours ago

      It’s not lossless but current ogg vorbis at 160kbps is absolutely transparent for the vast majority of people. That’s actually what I chose to keep my own collection, I mean, outside of the lossless albums that I absolutely want to flawlessly preserve.

    • borokov@lemmy.world
      link
      fedilink
      English
      arrow-up
      84
      ·
      9 hours ago

      Yep, most of tracks were already available on “various” sources, but this time they directly scraped the whole Spotify database.

      It’s really nice from them to backup Spotify database on a distributed system, and for free ! This ensure Spotify business won’t be endanger in case of critical hardware failure.

    • navigator@piefed.zip
      link
      fedilink
      English
      arrow-up
      7
      ·
      6 hours ago

      Not mine, because I’m not famous enough for people to pirate my music lol. It would be flattering for me to be included in this batch of scraped music.

      • HeyJoe@lemmy.world
        link
        fedilink
        English
        arrow-up
        21
        ·
        8 hours ago

        300tb is a lot, but its kind of crazy to think this entire company only needs 300tb storage arrays to function. I wonder how they handle things internally. I would imagine at least 1 backup server ready to go in HA. I wonder if they have multiple regions across the country that also serves up the same setup.

        • rainwall@piefed.social
          link
          fedilink
          English
          arrow-up
          8
          ·
          edit-2
          3 hours ago

          Likely cloned Netflix’s “netflix in a box” design, where they drop a large 200TB+ NAS in thousands of different CDN datecenters with their most popular content cached so that total traffic is minimal across the internet at large.

          Spotify mainly being music with very little video likely makes this even easier.

          • mojofrododojo@lemmy.world
            link
            fedilink
            English
            arrow-up
            7
            arrow-down
            1
            ·
            6 hours ago

            “Are you an incel with few friends, no job, and a deep seated hate for melanin? COME JOIN ICE!”

        • JohnEdwa@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          5
          ·
          5 hours ago

          IIRC there’s still like 700TB of low popularity music missing, but it is only something like 0.4% of listens.
          And they need a more storage overall because they have to set up datecenters around the world - doesn’t make sense to stream tens of millions of connections across the ocean. But that also gives all the backups one would need for “free”.

        • 🦄🦄🦄@feddit.org
          link
          fedilink
          English
          arrow-up
          6
          ·
          edit-2
          6 hours ago

          Afaik 300 TB is just the most popular music and around a third of all tracks. The blog post on anna’s is quite entertaining tho.

          • HeyJoe@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            ·
            6 hours ago

            Oh I know, I work in the industry as well. Our company backups alone for workstations and servers is just under 1 petabyte. This is then replicated to an offsite location which is also out disaster recovery location, and also stored in long term storage in Azure. This is just backups, sooo much money for backups haha. Thats why I am shocked that this entire company can run off of 300tb which is a lot, but nothing when you think of it being the entire business model for them.

            I think the craziest thing ive seen is we have these instruments that do genome testing and sequencing and they would create like 10tb worth of data per month. Every month they got there own 10tb drive handed to them to backup their stuff on there own on top of the ones we did for them.

  • Eryn6844@piefed.blahaj.zone
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    1
    ·
    8 hours ago

    not sure why you want that much music most of it garbage. i would like some of the podcasts that people dont post anywhere else though. all hail the data hoaders.

  • mrmaplebar@fedia.io
    link
    fedilink
    arrow-up
    26
    arrow-down
    12
    ·
    9 hours ago

    I wish I could think anything positive about this, but I can’t imagine anyone who actually cares about music needs or wants this. Instead it’ll almost certainly be used as an illegal and unethical dataset to further train bullshit AI to make slop songs. As easy as it is for people to claim “preservation”, I do have to question the motives of stuff like this…

    Fuck AI. Support your favorite human artists.

    • paraphrand@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      5 hours ago

      Yeah, the people who are racing to download it all want to use it for profit. AI companies, companies that run databases, etc.

    • Grimy@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      4 hours ago

      It’s a good thing if you are smart enough to understand that AI isn’t going away. Universal bought udio, the “legal” variant of the dataset will be used to train models, only they will be closed source, censored and come with a ToS that gives all the rights from the generated music to the record companies from the get go.

      At least this gives open source a chance.

    • paper_moon@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      ·
      edit-2
      8 hours ago

      I guess it’s easier packaged in a torrent rather than individual downloads, but I do question why anyone would need this if all they were doing was training AI, as everything is already available on YouTube for free. You don’t need to hack a company to get the audio. Now if you’re a human trying to actually listen to the songs, obviously the Spotify torrent will sound much better, assuming the hack captured the higher quality audio streams from Spotify. All the youtube downloaders sound like crap because its like 128kbps m4a (at least on newpipe, though you can do 160kbps opus if you want)

    • llama@lemmy.zip
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      2
      ·
      8 hours ago

      Same it seems useless to me. The real value is knowing how songs relate to each other in terms of being played before/after other songs, and that’s only available via internal datasets that they could never scrape anyway.

      • Telorand@reddthat.com
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 hours ago

        Everybody starts somewhere. Few come out the gate being Depeche Mode. That doesn’t mean it’s not worth the struggle to get better.

        • Cloudstash@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          6 hours ago

          Exactly, bars just got higher so in a few years or so human artists will generally be even better, and they too will be chased by AI so the chain is created.