LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild
The article presents LoraRetriever, a new framework that adaptively retrieves and composes multiple Low-Rank Adaptations (LoRAs) according to the input prompts in large language models (LLMs). It aims to enhance…
Continue reading