A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment TechniquesMegh ThakkarQuentin Fournieret al.2024ACL 2024
Combining Domain and Alignment Vectors to Achieve Better Knowledge-Safety Trade-offs in LLMsMegh ThakkarYash Moreet al.2024NeurIPS 2024