TY  - UNPB
ID  - dl3-a06-1
TI  - Neural Machine Translation of Rare Words with Subword Units
AU  - Rico Sennrich
AU  - Barry Haddow
AU  - Alexandra Birch
PY  - 2015
T2  - arXiv primary author manuscript
UR  - https://arxiv.org/abs/1508.07909
N1  - Original arXiv bibliographic record and abstract inspected on 2026-10-28; full proof and source experiments not independently audited.
ER  - 

TY  - UNPB
ID  - dl3-a06-2
TI  - Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates
AU  - Taku Kudo
PY  - 2018
T2  - arXiv primary author manuscript
UR  - https://arxiv.org/abs/1804.10959
N1  - Original arXiv bibliographic record and abstract inspected on 2026-10-28; full proof and source experiments not independently audited.
ER  - 

TY  - UNPB
ID  - dl3-a06-3
TI  - SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing
AU  - Taku Kudo
AU  - John Richardson
PY  - 2018
T2  - arXiv primary author manuscript
UR  - https://arxiv.org/abs/1808.06226
N1  - Original arXiv bibliographic record and abstract inspected on 2026-10-28; full proof and source experiments not independently audited.
ER  - 

TY  - UNPB
ID  - dl3-a06-4
TI  - ByT5: Towards a token-free future with pre-trained byte-to-byte models
AU  - Linting Xue
AU  - Aditya Barua
AU  - Noah Constant
AU  - Rami Al-Rfou
AU  - Sharan Narang
AU  - Mihir Kale
AU  - Adam Roberts
AU  - Colin Raffel
PY  - 2021
T2  - arXiv primary author manuscript
UR  - https://arxiv.org/abs/2105.13626
N1  - Original arXiv bibliographic record and abstract inspected on 2026-10-28; full proof and source experiments not independently audited.
ER  - 

TY  - UNPB
ID  - dl3-a06-5
TI  - CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation
AU  - Jonathan H. Clark
AU  - Dan Garrette
AU  - Iulia Turc
AU  - John Wieting
PY  - 2021
T2  - arXiv primary author manuscript
UR  - https://arxiv.org/abs/2103.06874
N1  - Original arXiv bibliographic record and abstract inspected on 2026-10-28; full proof and source experiments not independently audited.
ER  - 

TY  - UNPB
ID  - dl3-a06-6
TI  - Byte Latent Transformer: Patches Scale Better Than Tokens
AU  - Artidoro Pagnoni
AU  - Ram Pasunuru
AU  - Pedro Rodriguez
AU  - John Nguyen
AU  - Benjamin Muller
AU  - Margaret Li
AU  - Chunting Zhou
AU  - Lili Yu
AU  - Jason Weston
AU  - Luke Zettlemoyer
AU  - Gargi Ghosh
AU  - Mike Lewis
AU  - Ari Holtzman
AU  - Srinivasan Iyer
PY  - 2024
T2  - arXiv primary author manuscript
UR  - https://arxiv.org/abs/2412.09871
N1  - Original arXiv bibliographic record and abstract inspected on 2026-10-28; full proof and source experiments not independently audited.
ER  -