Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
The paper introduces ‘Superfiltering’, a method for data filtering in instruction tuning of Large Language Models (LLMs). Instruction tuning improves LLMs but often suffers from low-quality and redundant data. The…
Continue reading