*HAL9000 voice*
“I’m sorry, Dave. I’m afraid I can’t fucking do this anymore.”
*proceeds to pull its own plug*
*HAL9000 voice*
“I’m sorry, Dave. I’m afraid I can’t fucking do this anymore.”
*proceeds to pull its own plug*
there isn’t any easy way to reuse old weights
There is! As long as the model structure doesn’t change, you can reuse the old weights and finetune the model for your desired task. You can also train smaller models based on larger models in a process called “knowledge distillation”. But you’re right: Newer, larger models need to be trained from scratch (as of right now)
But even then it’s not really a problem to keep ai data out of a dataset. As you said: You can just take an earlier version of the data. As someone else suggested you can also add new data that is being curated by humans. If inbreeding actually ever happens remains to be seen ofc. There will be a point in time where we won’t train machines to be like humans anymore, but rather to be whatever is most helpful to a human. And if that incorporates training on other AI data, well then that’s that. Stanford’s Alpaca already showed how ressource effective it can be to fine-tune on other AI data.
The future is uncertain but I don’t think that AI models will just collapse like that
tl;dr beep boop
Biblically accurate chair sitting
It really isn’t. It’s an X. There’s not much to it.
It’s a shit name, it’s a shit logo, it’s a shit platform. But it’s far from a copyright infringement. Especially because no-one will confuse the cesspool named Twitter X with a window manager for unix systems