The Inductive Bias of In-Context Learning: Rethinking Pretraining Example Design

Yoav Levine, Noam Wies, Daniel Jannai, Dan Navon, Yedid Hoshen, Amnon Shashua. The Inductive Bias of In-Context Learning: Rethinking Pretraining Example Design. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net, 2022. [doi]

Authors

Yoav Levine

This author has not been identified. Look up 'Yoav Levine' in Google

Noam Wies

This author has not been identified. Look up 'Noam Wies' in Google

Daniel Jannai

This author has not been identified. Look up 'Daniel Jannai' in Google

Dan Navon

This author has not been identified. Look up 'Dan Navon' in Google

Yedid Hoshen

This author has not been identified. Look up 'Yedid Hoshen' in Google

Amnon Shashua

This author has not been identified. Look up 'Amnon Shashua' in Google