TY - UNPB ID - dl3-b-recursive-synthetic-support-1 TI - The Curse of Recursion: Training on Generated Data Makes Models Forget AU - Ilia Shumailov AU - Zakhar Shumaylov AU - Yiren Zhao AU - Yarin Gal AU - Nicolas Papernot AU - Ross Anderson PY - 2023 T2 - arXiv preprint UR - https://arxiv.org/abs/2305.17493 N1 - Primary publisher or author arXiv abstract and metadata inspected via web on 2026-10-28; no independent proof or benchmark replication. ER - TY - UNPB ID - dl3-b-recursive-synthetic-support-2 TI - Self-Consuming Generative Models Go MAD AU - Sina Alemohammad AU - Josue Casco-Rodriguez AU - Lorenzo Luzi AU - Ahmed Imtiaz Humayun AU - Hossein Babaei AU - Daniel LeJeune AU - Ali Siahkoohi AU - Richard G. Baraniuk PY - 2023 T2 - arXiv preprint UR - https://arxiv.org/abs/2307.01850 N1 - Primary publisher or author arXiv abstract and metadata inspected via web on 2026-10-28; no independent proof or benchmark replication. ER - TY - UNPB ID - dl3-b-recursive-synthetic-support-3 TI - Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data AU - Matthias Gerstgrasser AU - Rylan Schaeffer AU - Apratim Dey AU - et al. PY - 2024 T2 - arXiv preprint UR - https://arxiv.org/abs/2404.01413 N1 - Primary publisher or author arXiv abstract and metadata inspected via web on 2026-10-28; no independent proof or benchmark replication. ER - TY - UNPB ID - dl3-b-recursive-synthetic-support-4 TI - Self-Instruct: Aligning Language Models with Self-Generated Instructions AU - Yizhong Wang AU - Yeganeh Kordi AU - Swaroop Mishra AU - Alisa Liu AU - Noah A. Smith AU - Daniel Khashabi AU - Hannaneh Hajishirzi PY - 2022 T2 - arXiv preprint UR - https://arxiv.org/abs/2212.10560 N1 - Primary publisher or author arXiv abstract and metadata inspected via web on 2026-10-28; no independent proof or benchmark replication. ER - TY - UNPB ID - dl3-b-recursive-synthetic-support-5 TI - Self-training Improves Pre-training for Natural Language Understanding AU - Jingfei Du AU - Edouard Grave AU - Beliz Gunel AU - Vishrav Chaudhary AU - Onur Celebi AU - Michael Auli AU - Ves Stoyanov AU - Alexis Conneau PY - 2020 T2 - arXiv preprint UR - https://arxiv.org/abs/2010.02194 N1 - Primary publisher or author arXiv abstract and metadata inspected via web on 2026-10-28; no independent proof or benchmark replication. ER - TY - UNPB ID - dl3-b-recursive-synthetic-support-6 TI - On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes AU - Rishabh Agarwal AU - Nino Vieillard AU - Yongchao Zhou AU - Piotr Stanczyk AU - Sabela Ramos AU - Matthieu Geist AU - Olivier Bachem PY - 2023 T2 - arXiv preprint UR - https://arxiv.org/abs/2306.13649 N1 - Primary publisher or author arXiv abstract and metadata inspected via web on 2026-10-28; no independent proof or benchmark replication. ER -