• 0 Posts
  • 1.68K Comments
Joined 3 years ago
cake
Cake day: August 27th, 2023

help-circle









  • I again submit the last two years where model collapse did not happen. The doom-and-gloom predictions - some rather gleeful - plainly missed the mark. The proliferation of generated content has not in fact ruined the content generators, and it’s sure not because we’re any good at marking generated content. Early symptoms went away entirely and the problem has been practically addressed.

    As for “unlearning,” universality is why it’s a made-up problem. Nobody loudly complains that x-rays make doctors worse at feeling around for lumps.


  • That’s a lot of “could” and “will” from an article a year old, primarily about concerns from two years ago, while image models to-day keep getting smaller and better. They didn’t find a second internet’s worth of JPEGs. Better training on the same data, or even better labels on less data, beats a simple obsession with scale.

    Yes, photocopying a photocopy will degrade, but diffusion is a denoising algorithm. Un-degrading an image is its central function. ‘Make it look less AI’ is how you get generative adversarial networks.

    Anyway, the grim truth is that the central concern is mistaken. Training data for cancer screening does not require the patient lived.


  • The doctors were better, until someone yanked the tool away. That’s how every tool works! Even going from a handsaw to a table saw and back will make you lose some skill with the handsaw, because your brain focused on higher-level goals and finer motions. That’s not proof a table saw is bad for woodworking. The problem is “and back.”

    since apparently AI can’t feed into AI without collapse

    Have you checked on that narrative? It’s been a while. Things stopped getting yellow. Improvements continued.






  • Reminded of I Am Legend’s premiere, where $6.87 gas got a nervous laugh from the audience.

    And then years later we actually hit that price through normal economic trends, and chuds blamed Biden like it was his fault.

    And now those same chuds refuse to blame The Idiot for surpassing that price as unambiguous consequences of his warmongering.

    I would have preferred the zombies. Even if they do that late-2000s CGI stretchy jaw thing.



  • Tools can be useful well before they’re taken for granted. Art software was always a hot mess. 3D software’s still a hot mess. People nonetheless find immense utility in these programs.

    This tech would be a non-issue if it didn’t actually work. Chatbots can code now, and they’re good enough that I’ve seen critics fixate on maintainability, which is about as high-level as complaints could be. The big fat datacenter versions have caused sharp divisions by reimplementing open-source projects, using completely different structure in other languages entirely. The offline laptop versions are only months behind. Shit is getting weird in this house.