Unleashing the Power of Task-Specific Directions in Parameter Efficient Fine-tuning
A PEFT article which dives into the power of task-specific directions.
Jan 23, 2025
Maintaining Structural Integrity in Parameter Spaces for Parameter Efficient Fine-Tuning
A PEFT method aiming to preserve the topological structure of N-dimensional parameter space while seeking low-rank representations.
Jan 23, 2025
Unveiling the Mystery of Weight in Large Foundation Models: Gaussian Distribution Never Fades
Unveil the structure and behavior of weight in large foundation models.
Jan 20, 2025
See Further for Parameter Efficient Fine-tuning by Standing on the Shoulders of Decomposition
A generalized framework for parameter efficient fine-tuning.
Jul 7, 2024