data filtering

The paper introduces ‘Superfiltering’, a method for data filtering in instruction tuning of Large Language Models (LLMs). Instruction tuning improves LLMs but often suffers from low-quality and redundant data. The…