TY - CONF ID - dl3-b-deduplication-training-measure-1 TI - Deduplicating Training Data Makes Language Models Better AU - Katherine Lee AU - Daphne Ippolito AU - Andrew Nystrom AU - Chiyuan Zhang AU - Douglas Eck AU - Chris Callison-Burch AU - Nicholas Carlini PY - 2022 T2 - Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) UR - https://aclanthology.org/2022.acl-long.577/ N1 - Primary publisher or author arXiv abstract and metadata inspected via web on 2026-10-28; no independent proof or benchmark replication. DO - 10.18653/v1/2022.acl-long.577 SP - 8424 EP - 8445 ER - TY - UNPB ID - dl3-b-deduplication-training-measure-2 TI - Deduplicating Training Data Mitigates Privacy Risks in Language Models AU - Nikhil Kandpal AU - Eric Wallace AU - Colin Raffel PY - 2022 T2 - arXiv preprint UR - https://arxiv.org/abs/2202.06539 N1 - Primary publisher or author arXiv abstract and metadata inspected via web on 2026-10-28; no independent proof or benchmark replication. ER - TY - UNPB ID - dl3-b-deduplication-training-measure-3 TI - SemDeDup: Data-efficient learning at web-scale through semantic deduplication AU - Amro Abbas AU - Kushal Tirumala AU - Dániel Simig AU - Surya Ganguli AU - Ari S. Morcos PY - 2023 T2 - arXiv preprint UR - https://arxiv.org/abs/2303.09540 N1 - Primary publisher or author arXiv abstract and metadata inspected via web on 2026-10-28; no independent proof or benchmark replication. ER - TY - UNPB ID - dl3-b-deduplication-training-measure-4 TI - DataComp: In search of the next generation of multimodal datasets AU - Samir Yitzhak Gadre AU - Gabriel Ilharco AU - Alex Fang AU - et al. PY - 2023 T2 - arXiv preprint UR - https://arxiv.org/abs/2304.14108 N1 - Primary publisher or author arXiv abstract and metadata inspected via web on 2026-10-28; no independent proof or benchmark replication. ER - TY - UNPB ID - dl3-b-deduplication-training-measure-5 TI - Beyond neural scaling laws: beating power law scaling via data pruning AU - Ben Sorscher AU - Robert Geirhos AU - Shashank Shekhar AU - Surya Ganguli AU - Ari S. Morcos PY - 2022 T2 - arXiv preprint UR - https://arxiv.org/abs/2206.14486 N1 - Primary publisher or author arXiv abstract and metadata inspected via web on 2026-10-28; no independent proof or benchmark replication. ER - TY - UNPB ID - dl3-b-deduplication-training-measure-6 TI - Scaling Data-Constrained Language Models AU - Niklas Muennighoff AU - Alexander M. Rush AU - Boaz Barak AU - Teven Le Scao AU - Aleksandra Piktus AU - Nouamane Tazi AU - Sampo Pyysalo AU - Thomas Wolf AU - Colin Raffel PY - 2023 T2 - arXiv preprint UR - https://arxiv.org/abs/2305.16264 N1 - Primary publisher or author arXiv abstract and metadata inspected via web on 2026-10-28; no independent proof or benchmark replication. ER -