Loop Copilot is a novel AI system that allows users to create and fine-tune music via an interactive, multi-round dialogue interface. This system uses a large language model to understand user intentions and choose suitable AI models for task execution. Each backend model specializes in a specific task and their results are combined to meet user requirements. Loop Copilot maintains essential musical attributes in a centralized table to ensure musical coherence. The system’s effectiveness was evaluated through interviews and questionnaires, demonstrating its utility in facilitating music creation and potential for broader applications.
Publication date: 19 Oct 2023
Project Page: https://sites.google.com/view/loop-copilot
Paper: https://arxiv.org/pdf/2310.12404