With foundation models running out of data for training, companies are placing their bets on the use of synthetic data for training the models. But based on a recent research paper, “indiscriminate use of model-generated content in training causes irreversible defects in the resulting models”.
