Unleashing the Power of Task-Specific Directions in Parameter Efficient Fine-tuning
A PEFT article which dives into the power of task-specific directions.
Sep 2, 2024
See Further for Parameter Efficient Fine-tuning by Standing on the Shoulders of Decomposition
A generalized framework for parameter efficient fine-tuning.
Jul 7, 2024
FLoRA: Low-Rank Core Space for N-dimension
A PEFT method aiming to preserve the topological structure of N-dimensional parameter space while seeking low-rank representations.
May 23, 2024