On the Relationship between Skill Neurons and Robustness in Prompt Tuning
The research focuses on Prompt Tuning, a parameter-efficient fine-tuning method for pre-trained large language models. The authors investigate the concept of ‘skill neurons’ – neurons that are highly predictive for…
Continue reading