TY  - UNPB
ID  - dl3-a05-1
TI  - An Explanation of In-context Learning as Implicit Bayesian Inference
AU  - Sang Michael Xie
AU  - Aditi Raghunathan
AU  - Percy Liang
AU  - Tengyu Ma
PY  - 2021
T2  - arXiv primary author manuscript
UR  - https://arxiv.org/abs/2111.02080
N1  - Original arXiv bibliographic record and abstract inspected on 2026-10-28; full proof and source experiments not independently audited.
ER  - 

TY  - UNPB
ID  - dl3-a05-2
TI  - What Can Transformers Learn In-Context? A Case Study of Simple Function Classes
AU  - Shivam Garg
AU  - Dimitris Tsipras
AU  - Percy Liang
AU  - Gregory Valiant
PY  - 2022
T2  - arXiv primary author manuscript
UR  - https://arxiv.org/abs/2208.01066
N1  - Original arXiv bibliographic record and abstract inspected on 2026-10-28; full proof and source experiments not independently audited.
ER  - 

TY  - UNPB
ID  - dl3-a05-3
TI  - What learning algorithm is in-context learning? Investigations with linear models
AU  - Ekin Akyürek
AU  - Dale Schuurmans
AU  - Jacob Andreas
AU  - Tengyu Ma
AU  - Denny Zhou
PY  - 2022
T2  - arXiv primary author manuscript
UR  - https://arxiv.org/abs/2211.15661
N1  - Original arXiv bibliographic record and abstract inspected on 2026-10-28; full proof and source experiments not independently audited.
ER  - 

TY  - UNPB
ID  - dl3-a05-4
TI  - Transformers learn in-context by gradient descent
AU  - Johannes von Oswald
AU  - Eyvind Niklasson
AU  - Ettore Randazzo
AU  - João Sacramento
AU  - Alexander Mordvintsev
AU  - Andrey Zhmoginov
AU  - Max Vladymyrov
PY  - 2022
T2  - arXiv primary author manuscript
UR  - https://arxiv.org/abs/2212.07677
N1  - Original arXiv bibliographic record and abstract inspected on 2026-10-28; full proof and source experiments not independently audited.
ER  - 

TY  - UNPB
ID  - dl3-a05-5
TI  - Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
AU  - Sewon Min
AU  - Xinxi Lyu
AU  - Ari Holtzman
AU  - Mikel Artetxe
AU  - Mike Lewis
AU  - Hannaneh Hajishirzi
AU  - Luke Zettlemoyer
PY  - 2022
T2  - arXiv primary author manuscript
UR  - https://arxiv.org/abs/2202.12837
N1  - Original arXiv bibliographic record and abstract inspected on 2026-10-28; full proof and source experiments not independently audited.
ER  - 

TY  - UNPB
ID  - dl3-a05-6
TI  - In-context Learning and Induction Heads
AU  - Catherine Olsson
AU  - Nelson Elhage
AU  - Neel Nanda
AU  - Nicholas Joseph
AU  - Nova DasSarma
AU  - Tom Henighan
AU  - Ben Mann
AU  - Amanda Askell
AU  - Yuntao Bai
AU  - Anna Chen
AU  - Tom Conerly
AU  - Dawn Drain
AU  - Deep Ganguli
AU  - Zac Hatfield-Dodds
AU  - Danny Hernandez
AU  - Scott Johnston
AU  - Andy Jones
AU  - Jackson Kernion
AU  - Liane Lovitt
AU  - Kamal Ndousse
AU  - Dario Amodei
AU  - Tom Brown
AU  - Jack Clark
AU  - Jared Kaplan
AU  - Sam McCandlish
AU  - Chris Olah
PY  - 2022
T2  - arXiv primary author manuscript
UR  - https://arxiv.org/abs/2209.11895
N1  - Original arXiv bibliographic record and abstract inspected on 2026-10-28; full proof and source experiments not independently audited.
ER  -