Skip Navigation
“Model collapse” threatens to kill progress on generative AIs
  • Another great example (from DeepMind) is AlphaFold. Because there's relatively little amounts of data on protein structures (only 175k in the PDB), you can't really build a model that requires millions or billions of structures. Coupled with the fact that getting the structure of a new protein in the lab is really hard, and that most proteins are highly synonymous (you share about 60% of your genes with a banana).

    So the researchers generated a bunch of "plausible yet never seen in nature" protein structures (that their model thought were high quality) and used them for training.

    Granted, even though AlphaFold has made incredible progress, it still hasn't been able to show any biological breakthroughs (e.g. 80% accuracy is much better than the 60% accuracy we were at 10 years ago, but still not nearly where we really need to be).

    Image models, on the other hand, are quite sophisticated, and many of them can "beat" humans or look "more natural" than an actual photograph. Trying to eek the final 0.01% out of a 99.9% accurate model is when the model collapse happens--the model starts to learn from the "nearly accurate to the human eye but containing unseen flaws" images.

  • Burning Up
  • Yeah, I grew up in Fahren-wasteland, but have lived in Celsi-heaven for 7 years. I embraced it, and now when someone says "40 FUCKING DEGREES!!" I know exactly what they're talking about. It's hot. You probably don't have an air con. It's misery.

  • Trump supporters call for riots and violent retribution after verdict
  • Favourite part of the whole article:

    A spokesperson for Truth Social said, “It’s hard to believe that Reuters, once a respected news service, has fallen so low as to publish such a manipulative, false, defamatory and transparently stupid article as this one purely out of political spite.”

    "You never saw what you thought you saw. And even if you did, it was entirely justified and your interpretation was extreme."

  • CEO of Google Says It Has No Solution for Its AI Providing Wildly Incorrect Information
  • Yeah, the problem is how to sanitise effectively. You've gotta be able to find a way to automatically strip out "bad" things from your training data (via an "oracle"). But if you already had that oracle, you could just slap it on your final product (e.g. Search) and make all the "bad" things disappear before they hit the user (via some sort of filter).

  • InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)BI
    bignate31 @lemmy.world
    Posts 0
    Comments 33