On the Effect of Instruction Tuning Loss on Generalization
Instruction Tuning has emerged as a pivotal post-training paradigm that enables pre-trained language models to better follow user …
PDF Cite DOI
SMART: Submodular Data Mixture Strategy for Instruction Tuning
Instruction Tuning involves finetuning a language model on a collection of instruction-formatted datasets in order to enhance the …
PDF Cite Poster Video DOI