How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM?
Paper
• 2502.14502 • Published
• 91
Knowledge Packing
Models and datasets from the paper: "How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM?" https://arxiv.org/abs/2502.14502
-
-
s-nlp/Llama-3.1-8B-Instruct-TriviaQA-HighlyKnown
Viewer • Updated • 91k • 40 -
s-nlp/Llama-3.1-8B-Instruct-DBpedia-HighlyKnown
Viewer • Updated • 21k • 20 -
s-nlp/Mistral-7b-0.3-Instruct-TriviaQA-HighlyKnown
Viewer • Updated • 91k • 32 -
s-nlp/Mistral-7b-0.3-Instruct-DBpedia-HighlyKnown
Viewer • Updated • 21k • 7 -
s-nlp/Knowledge-Packing-Llama-3.1-8B-Instruct-3000Unknown-10Paraphrases
Question Answering • Updated -
s-nlp/Knowledge-Packing-Llama-3.1-8B-Instruct-3000Unknown-10HighKnown
Question Answering • Updated -
s-nlp/Knowledge-Packing-Llama-3.1-8B-Instruct-500Unknown-10HighKnown
Question Answering • Updated -
s-nlp/Knowledge-Packing-Llama-3.1-8B-Instruct-500Unknown-10Paraphrases
Question Answering • Updated